* feat: add publish-external command to slash commands to publish external connector images
* fix: publish only stpec to cache
* fix: according to new script changes
* fix: removed tox installation
* fix: version is not read from command
* Add a job notification
The new scheduler was missing a notification step after the job is done.
This is needed in order to report the number of record of a sync.
* Acceptance test with the new scheduler
Add a new github action task to run the acceptances test with the new scheduler
* Retry if the failure
* PR comments
* Download spark jdbc driver in build cmd
* Download jdbc driver in ci integration test
* Update comments
* Set up cloud sdk
* Add comments
* Download jdbc driver from databricks directly
* Update readme
* Use unzip command
* Install unzip for databricks
* Add databricks build status
* Close database
* Log more error information
* Close database when checking connection
* Update spec
* updated ci performance test sh script
* updated ci performance test sh script
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* run tests
* update ci creds
* update performance test yaml file
* update performance test yaml file
* update performance test yaml file
* update performance test yaml file
* update performance test sh file
* update performance test sh file
* update performance test sh file
* update performance test sh file
* update java to 17 version in yaml file for performance tests
* update java to 17 version in yaml file for performance tests
* update java to 17 version in yaml file for performance tests
* update java to 17 version in yaml file for performance tests
* update java to 17 version in yaml file for performance tests
* clean test logs
* remove test logs
* remove test logs
* remove test logs
* return performance test logs
* add readme by performance tests
* Destination Snowflake update check method to verify permission for stages
* fix for jdk 17
* fix for jdk 17
* fix with ci secrets
* fix with ci secrets
* removed snowflake secrets from ci_credentials.sh
* bump version
Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>
* update logic
* add new options
* fix unit tests
* format
* fix incorrect docker status
* remove addl options
* format
* update docs
* restore removed file
* CI should be skipped connectors without secrets
* updated ci performance test sh script
* updated ci performance test sh script
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
- Add the CONFIGS_DATABASE_MINIMUM_FLYWAY_MIGRATION_VERSION and JOBS_DATABASE_MINIMUM_FLYWAY_MIGRATION_VERSION. These are env vars that will determine if the database is ready for an application to start.
- Add the CONFIGS_DATABASE_INITIALIZATION_TIMEOUT_MS and the JOBS_DATABASE_INITIALIZATION_TIMEOUT_MS env vars to determine how long an application should wait for the DB before giving up.
- Create the MinimumFlywayMigrationVersionCheck class. This class contains all the assertions to check if 1) a database is initialised. 2) a database meets the minimum migration version.
- Remove all set up operations from the ServerApp. Use MinimumFlywayMigrationVersionCheck operations instead.
- I also had to modify the Databases and BaseDatabaseInstance classes to support connecting to a database with timeouts. We would previously try forever.
- Add Bootloader to the relevant docker files and Kube files.
- Clean up the migration acceptance tests so it's clear what is happening.
* updated ci performance test sh script
* updated ci performance test sh script
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* set all params to one arg
* 7947 Add info about skipped/failed tests to github test message
* 7947 Update docs
* 7947 Add failed test to source stripe
* 7947 Move logic connected to skipped_failed_info info function
* 7947 Remove failed test from source stripe
* 7947 Remove test changes from source-stripe
* Source Google Sheets #8313 - migrate to the CDK
* Source Google Sheets #8313 - fixing unit tests
* Source Google Sheets #8313 - reformat
* Source Google Sheets #8313 - update ci_credentials
* Source Google Sheets #8313 - bump version and update docs
* Rename GcsStorageBucket to GcsLogBucket.
* Update all references to GCP_STORAGE_BUCKET to GCS_LOG_BUCKET.
* Undo this for configuration files for older Airbyte versions.
* Clean up Job env vars. (#8462)
* Rename MAX_SYNC_JOB_ATTEMPTS to SYNC_JOB_MAX_ATTEMPTS.
* Rename MAX_SYNC_TIMEOUT_DAYS to SYNC_JOB_MAX_TIMEOUT_DAYS.
* Rename WORKER_POD_TOLERATIONS to JOB_POD_TOLERATIONS.
* Rename WORKER_POD_NODE_SELECTORS to JOB_POD_NODE_SELECTORS.
* Rename JOB_IMAGE_PULL_POLICY to JOB_POD_MAIN_CONTAINER_IMAGE_PULL_POLICY.
* Rename JOBS_IMAGE_PULL_SECRET to JOB_POD_MAIN_CONTAINER_IMAGE_PULL_SECRET.
* Rename JOB_SOCAT_IMAGE to JOB_POD_SOCAT_IMAGE.
* Rename JOB_BUSYBOX_IMAGE to JOB_POD_BUSYBOX_IMAGE.
* Rename JOB_CURL_IMAGE to JOB_POD_CURL_IMAGE.
* Rename KUBE_NAMESPACE to JOB_POD_KUBE_NAMESPACE.
* Rename RESOURCE_CPU_REQUEST to JOB_POD_MAIN_CONTAINER_CPU_REQUEST.
* Rename RESOURCE_CPU_LIMIT to JOB_POD_MAIN_CONTAINER_CPU_LIMIT.
* Rename RESOURCE_MEMORY_REQUEST to JOB_POD_MAIN_CONTAINER_MEMORY_REQUEST.
* Rename RESOURCE_MEMORY_LIMIT to JOB_POD_MAIN_CONTAINER_MEMORY_LIMIT.
* Remove worker suffix from created pods to reduce confusion with actual worker pods.
* Use sync instead of worker to name job pods.
