* Add deployment mode to env shared with jobs
* Add adaptive runners
* Migrate postgres source to use adaptive runner
* Add an array of specs in docker image spec definition
* Add copyright
* Parse docker image spec with specs list
* Update spec yaml files
* Pass in DEPLOYMENT_MODE to docker compose file
* Revert "Parse docker image spec with specs list"
This reverts commit 8fe41dd3b7.
* Revert changes in docker image spec
* Read cloud specific spec files based on deployment mode
* Revert "Update spec yaml files"
This reverts commit 059f326432.
* Publish cloud spec file if necessary
* Fix upload script
* Move test files
* Update docker compose file
* Format code
* Add comment about spec filename
* Add unit tests
* Remove redundant jdbc acceptance test
When running `PostgresStrictEncryptJdbcSourceAcceptanceTest`, the `discover` method tests always fail because there are unexpected columns in the catalog:
- `wakeup_at`
- `last_visited_at`
- `last_comment_at`
These columns only exist in `PostgresJdbcSourceAcceptanceTest`. And this failure cannot be reproduced locally.
The hypothesis is that when the JDBC unit tests are run on CI, they are run in parallel, and the same testcontainer is used for both tests. That's why the strict encrypt test can discover columns from the oridinary unit test.
Given that the JDBC strict encrypt test is basically redundant, it is removed.
* explicitly use buildx for connector publish
* ... and use it
* use docker-container driver
* use `driver docker-container` only for normalization
* Update tools/integrations/manage.sh
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
* Rename docker secrets and parameterize docker user
* Apply suggestions from code review
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
* Bump faker version to test M1 Connector builds
* add PR link to changelog
* Remove birhtday, it doesn't obey seed
* bump readme
* more birthday to remove
* remove image specificity in publish-command
* Set AMI for testing.
* test with including buildx emulators
* auto-bump connector version
* add TODO comment
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* feat: add publish-external command to slash commands to publish external connector images
* fix: publish only stpec to cache
* fix: according to new script changes
* fix: removed tox installation
* fix: version is not read from command
* Download spark jdbc driver in build cmd
* Download jdbc driver in ci integration test
* Update comments
* Set up cloud sdk
* Add comments
* Download jdbc driver from databricks directly
* Update readme
* Use unzip command
* Install unzip for databricks
* Add databricks build status
* Close database
* Log more error information
* Close database when checking connection
* Update spec
* tool for creating schemas from configured_catalog within genson stripping `required`
* gen from all output (add_schema for all)
* all except extra_strategies
* apply extra strategies
* merge && small upd
* upd docstring
* add AIRBYTE_ENTRYPOINT for kubernetes support
* bump versions
* bump version in seed
* Update generic template
* keep scaffold sources at 0.1.0
* add missing newline
* handle python base versions correctly
* re-bump mysql and postgres sources
* re-bump snowflake destination
* add skip tests option
* switch to running tests
* reverse conditional to make it safer
* fix publish to include the test running
* fix iterable version
* fix file generation
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Create new test_ephemeral and refactor with test_normalization
* Add notes in docs
* Refactor common normalization tests into DbtIntegrationTest
* Bumpversion of normalization image
* fix connector base versioning
* only run integration tests in non-bases directories
* upgrade datamodel-code-generator which coincidentally has already fixed this issue with generating List of Lists
* bump forgotten hubspot version
* fix build
