* Fix the error reading offset file meanwhile Debezium is writing.
Enable CDC checkpointing to Postgres.
Minor change in the variable name to fit the type.
* Add final statement on exception ;)
* Add comments to CDC Checkpoint tests.
Clean a bit.
* Bump connector versioning
* Add log message
* Fix changelog
* auto-bump connector version
* Manually generate definitions
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* set ssl_mode to require on remaining db sources
* update readmes
* update expected specs
* auto-bump connector version
* bump mysql version manually
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* make ssl mode default to require for postgres on cloud
* update dockerfiles and readme
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* MS SQL does not support schema change in incremental model
* make schema change test optional
* fix compilation errors in postgres-strict-encrypt destination
* deparallelize integration tests for destination postgres
* deparalellize MS SQL integration tests
* remove broken SSH tunnel test from destination-postgres-strict-encrypt
* Pass argument along, add test that should pass and test that should fail
* Add tests with additionalProperties
* Set additionalproperties=false when not set|
* Parametrize test cases
* Make the behavior 'optional'
* Fix parametrization for all combinations
* Improve CI credentials README and rename param
* Update naming to be clearer about columns only
* record_has_unexpected_field > record_has_unexpected_column
* Automated Change
* Add bypass for beta + ga connectors that failed
* Update docs and TODOs
* Update changelog and dockerfile
* Update TODO
* Update a few neglected connectors
* Remove uploaded file
* Update dockerfile after merge conflict
---------
Co-authored-by: marcosmarxm <marcosmarxm@users.noreply.github.com>
* add pattern descriptors to more fields in github and postgres sources
* update dockerfiles and readmes
* auto-bump connector version
* manually bump github seed source files
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* connectors-ci: only send commit status on PR
* increase timeout
* try semaphore
* disable qa check code format for testing semaphore
* fix typo and change semaphore
* disable acceptance tests
* use semaphore
* restore ga builds
* use CacheSharingMode.SHARED, renable acceptance tests, semaphore of 5
* expose concurrency as a CLI option, set it to 10 on the workflow
* clean
* use xlarge runner
* // 15
* declare inputs
* better job naming
* better job naming
* use run-name
* use run-name
* Cleanup createDatabase() code
Move methods from AbstractJdbcSource
Moved methods until createDataSource outside of the abstract class
* Quick cleanups/renames
* Add tests
* copy tests from other branch
* switch to >
* [wip] wire up tests
* make tests work
* fixes
* nicer test structure
* maybe add feature flag?
* pattern matching
* also add version check
* formatting
* refactor test also
* extract test + fix method call
* minor tweaks
* add context to log message
* put workspace id in normalization input
* use non-semver tag
* add flag for version of normalization
* also flag old version
* add test
* missed part of the commit
* format
* add test for null workspace ID
* Revert "also flag old version"
This reverts commit 3be601d16c.
* Revert "missed part of the commit"
This reverts commit 47a67b4631.
* always apply flag, even if we're behind a version
* derp
* Add more logging to the normalization activity
* Update charts and kustomize for the feature flag
* fix clickhouse integration test
* remove replace_identifiers
* Revert "remove replace_identifiers"
This reverts commit 0e7ded5a7b.
* fix replace_identifiers
* garbage debug logs
* stop trying to setup duckdb test
* wake up and choose violence
* fix mssql
* exclude duckdb from tests
* make snowflake happy
* uncomment tests
* derp
* derpderp
* format
* format
* also fix redshift???
* maybe now everything works???
* remove debug logs
* use special docker tag
* bump to new tag
* use random test schema in publish also
* properly cleanup
* remove feature flag stuff
* version bump + changelog
* Automated Commit - Formatting Changes
* bump definitions
---------
Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
Co-authored-by: Jimmy Ma <jimmy@airbyte.io>
Co-authored-by: octavia-squidington-iii <octavia-bot@airbyte.io>
Co-authored-by: edgao <edgao@users.noreply.github.com>
* more tests
* format
* format
* check orders separately per group
* typo
* add examples to docstring
* prepare release
---------
Co-authored-by: Augustin <augustin@airbyte.io>
* add grouping and collapsing fields to postgres source
* add auth group to github source connector
* revert postgres field order changes and adjust group of schemas field
* inject group into ssh tunnel spec for postgres only, through overloaded methods
* Automated Change
* bump Dockerfile versions and update changelogs
* bump strict encrypt version as well
* fix postgres acceptance test
* fix acceptance test again
* fix all postgres acceptance tests
* add newline
* undo other changes to postgres readme file
* add security group to tunnel_method in expected_spec.json
* bump version of strict encrypt
* manually bump versions in seed files
---------
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
* destination-s3-glue: Fix data type for emitted at column
The `_ab_emitted_at` column is actually a numeric type and not a string. This updates
the generated schema to treat it as the proper type.
* fix tests
* rollback seed dest spec update
* auto-bump connector version
---------
Co-authored-by: Tobias Macey <tmacey@mit.edu>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Update current schema vs catalog validation to omit airbyte metadata fields
* Bumped versions for postgres, mssql, and mySQL + changelog
* Bumped dockerfile version of strict encrypt
* Manually generate definitions for mysql
* Manually generate definitions for mssql
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* added view and storage to pages, updated SAT
* added unittests
* added changelog, fixed type in docs
* added checking for stream Audit to skip it if user doesn't have permissions
* refactored plan validation
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
