1
0
mirror of synced 2026-01-05 21:02:13 -05:00
Commit Graph

13 Commits

Author SHA1 Message Date
Ella Rohm-Ensing
4bef54d1b9 Add README info about using your local CDK locally and in docker (#20082)
* Add README info about installing the local CDK locally and in Docker

* Add '|| true' to validate_dockerignore()

* Update airbyte-cdk/python/README.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2022-12-05 17:52:35 -05:00
Volodymyr Pochtar
a142141c98 Revert "Revert "feat: replace openjdk with amazoncorretto:17.0.4 on connectors for seсurity compliance (#17511)" (#17820)" (#17833)
This reverts commit e47c94ecff.
2022-10-11 14:22:54 +03:00
Volodymyr Pochtar
e47c94ecff Revert "feat: replace openjdk with amazoncorretto:17.0.4 on connectors for seсurity compliance (#17511)" (#17820)
This reverts commit ab71f5bc29.
2022-10-11 11:58:01 +03:00
Volodymyr Pochtar
ab71f5bc29 feat: replace openjdk with amazoncorretto:17.0.4 on connectors for seсurity compliance (#17511) 2022-10-10 12:35:39 +03:00
girarda
fd13ab1970 Fix CONNECTORS_BASE build for M1 (#10925)
* Pass in arm64

* default value

* fix
2022-03-07 17:30:41 -08:00
Serhii Chvaliuk
158151230c Remove intermediate docker images with DOCKER_BUILDKIT=1 (#9408)
* DOCKER_BUILDKIT=1 added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-01-12 16:28:04 +02:00
Jared Rhizor
25674fc306 upgrade to Gradle 7.3.1 / Java 17 (#7964)
* upgrade gradle

* upgrade to Java 17 (and fix a few of the node versioning misses)

* oops

* try to run a different format version

* fix spotless by upgrading / reformatting some files

* fix ci settings

* upgrade mockito to avoid other errors

* undo bad format

* fix "incorrect" sql comments

* fmt

* add debug flag

* remove

* bump

* bump jooq to a version that has a java 17 dist

* fix

* remove logs

* oops

* revert jooq upgrade

* fix

* set up java for connector test

* fix yaml

* generate std source tests

* fail zombie job attempts and add failure reason (#8709)

* fail zombie job attempts and add failure reason

* remove failure reason

* bump gcp dependencies to pick up grpc update (#8713)

* Bump Airbyte version from 0.33.9-alpha to 0.33.10-alpha (#8714)

Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>

* Change CDK "Caching" header to "nested streams & caching"

* Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* move S3Config into destination-s3; update dependencies accordingly (#8562)

Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Iryna Grankova <87977540+igrankova@users.noreply.github.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
2021-12-10 16:57:54 -08:00
Harsha Teja Kanna
3e7f95c25a 🎉 Support build on MacOS M1 (Apple Silicon) (#7104)
- See this doc for details: https://github.com/airbytehq/airbyte/blob/master/docs/contributing-to-airbyte/developing-locally.md
- Unit test does not work yet.
2021-10-19 11:20:21 -07:00
Harsha Teja Kanna
84b3fbd8db 🎉 Added optional platform flag for build image script (#6000) 2021-09-14 23:37:07 -07:00
Sherif A. Nada
894c4d5f49 Allow following symlinks when building docker images (#1332) 2020-12-15 11:53:34 -08:00
Jared Rhizor
674ee2cf72 enforce order of installing python dependencies (#1149)
* fix python install order

* fix base install reqs dependencies

* don't clobber dependencies

* remove cacheIf forcing

* it wasn't clobbering actually

* fix pip version

* loosen pyyaml version

* Revert "loosen pyyaml version"

This reverts commit 5a4eb3bc08.

* move tap-adwords dependency

* downgrade shopify api version used to match

* run seed init

* add test curl

* Revert "add test curl"

This reverts commit caee9ee9ee.

* revert to simpler docker times

* rename task function so it doesn't match the task name

* turn off buildkit

* fix redshift dir for credentials

* add twilio and freshdesk to seed yaml

* fix typo

* get shopify passing similar to the adwords fix
2020-12-01 17:40:58 -08:00
Jared Rhizor
05404bdd58 improve caching (#1005)
* python caching

* improve gradle caching

* store pip cache dir

* debugging info

* split build steps and temporarily remove testing infra from build

* fix formatting error

* fix another syntax error

* split repo caches

* switch pip dir

* use git hash instead of rehashing everything

* syntax

* list directories

* list after cache population

* list .docker

* specify custom output cache directory for docker

* only build bigquery and use buildx on ci

* add build command

* use docker driver instead of docker-container

* use correct key

* use local registry

* allow push failure

* make sure to tag first

* move part of node caching and restore rest of actual build

* cleanup

* clean up mssql gradle file

* toggle on inline cache

* try save and load method instead

* use separate tar for each image

* limit to 20

* always succeed even though disk space runs out

* try to just pull the public image to see if that's faster

* use cachefrom

* revert back to local registry version

* see how buildkit compares

* address review comments

* add comments
2020-11-19 13:14:46 -08:00
Jared Rhizor
e1d7add50a mostly incremental builds (#817)
* support cached builds for base -> base-java -> snowflake

* use plugin for image building

* fix matching on COPY from

* remove docker.gradle

* tmp commit

* update connectors

* finish rest of build files

* fix ide errors

* more build fixes

* clean up

* clean up for new soruces

* fix spotless

* fix flake problems

* add recommended empty file

* python caching

* fixes upon review

* clean up docker and build test files

* clean up python

* clean up

* fix integration test dependencies

* fix standard tests

* fix

* remove symlink

* re-add requirements to fix normalizatioon build

* fix symlink

* fix dumbest build problem of all

* add missing integration test def

* fix missing dep

* remove class exclusion

* move trim so null source versions are allowed

* rename map

* fix hardcoded value

* remove unnecessary dep

* use dashes for salesforce package name

* fix typo

* DRY and fix test image name

* Fix edit

* assert string is not empty

* build integration test image only for integrationTest

* move code generator to tools and rename docker build tasks

* make source test depend on integration test build, not the other way

* remove guard because the docker build should exist before the integrationtest is applied

* remove comment

* DRY up airbyte-source-test

* fix plugin compilation

* add missing dependency

* rename getTaggedImage to getDevTaggedImage

* fix test vs main docker build bug
2020-11-09 11:00:11 -08:00