* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Added docs, bump dockerfiles
* airbyte-5172 Fix PR comments.
* airbyte-5172 Fixed PR comments.
* airbyte-5172 bumped connector version.
* Fix data type tests in CdcPostgresSourceComprehensiveTest
* update style format
* bump version for postgres source
* bump version for postgres source in json definition
* remove unnecessary comments from test and bump version for postgres strict encrypt source
* resolved potential conflicts with debezium utils in mssql converter implementation
* resolved potential conflicts with debezium utils in mssql converter implementation
* Update notes for money type in postgres.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Update docs/integrations/sources/postgres.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* added test cases for converting data values for postgres cdc, remove time zone utc from test container
* remove redundant void message from test
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* update style format
* fix time zone in DebeziumConverterUtilsTest
* set utc time zone in DataTypeUtils
* set utc time zone for date format
* revert changes regarding timezone in date format, disable tests with number and duration
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Add transactionTimestamp field
* Update CDC_timestamp type in integrations and tests
* no jsonschema timestamp type, use string
* Linting
* format
* fix compilation error
* fix compilation error
* fix test output
* upgrade version for mssql,mysql,postgres
* stupid mistake! forgot to upgrade docker file
Co-authored-by: danieldiamond <danieldiamond1@gmail.com>
* throw exception if we close engine before snapshot is complete + increase timeout for subsequent records
* add comment + bump postgres version to use new changes
* 🐛 Source PostgreSQL: Fixed PostgreSQL CDC numeric handling
* Rm unnecessary tests for non-CDC
* Add more values to test in postgres cdc numeric
* Fix comment so it points to psql docs instead
* Oops, added to the wrong test file
* Add sourceType as well
* Fix precision on tests
* add AIRBYTE_ENTRYPOINT for kubernetes support
* bump versions
* bump version in seed
* Update generic template
* keep scaffold sources at 0.1.0
* add missing newline
* handle python base versions correctly
* re-bump mysql and postgres sources
* re-bump snowflake destination
* add skip tests option
* switch to running tests
* reverse conditional to make it safer
* fix publish to include the test running
* fix iterable version
* fix file generation
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.
Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
* spike
* more
* debezium wip
* use oneof for configuration
* iterator wrapping structure
* push current
* working loop
* move capability into source
* hack it into a sharable state
* debezium test runner (#2617)
* CDC Wait for Values (#2618)
* output actual AirbyteMessages for cdc (#2631)
* message conversion
* fmt
* add lsn extraction and comparison (#2613)
* postgres cdc catalog (#2673)
* update cdc catalog
* A
* table selection for cdc (#2690)
* table selection for cdc
* fix broken merge
* also test double quote in name
* Add state management to CDC (#2718)
* CDC: Fix Producer/Consumer State Machine (#2721)
* CDC Postgres Tests (#2777)
* fix postgres cdc image name and run check before reading data (#2785)
* minor postgres cdc fixes
* add test and fix check behavior
* fix
* improve comment
* remove unused props, remove todos, add some more sanity tests (#2791)
* cdc: add offset store tests (#2793)
* clean (#2798)
* postgres cdc docs (#2784)
* cdc docs
* Update docs/integrations/sources/postgres.md
Co-authored-by: Charles <giardina.charles@gmail.com>
* address gcp
* learn too english
* add link
* add more disk space warnings
* add additional cdc use case
* add information on how to find postgresql.conf
* add how to find the file
Co-authored-by: Charles <giardina.charles@gmail.com>
* various merge conflict fixes (#2799)
* cdc standard tests (#2813)
* require cdc users to create publications & update docs (#2818)
* postgres cdc race condition
* working? but different process
* add additional logging to help debug in the future
* everything done except working config
* remove unintended change
* Use oneOf in PG CDC spec (#2827)
* add oneOf configuration for postgres cdc (#2831)
* add oneof configuration for cdc postgres
* fmt
Co-authored-by: Charles <giardina.charles@gmail.com>
* fix test (#2834)
* fix test
* bump version
* add docs on creating replica identities (#2838)
* add docs on creating replica identities
* emphasize danger
* grammar
* bump pg version in source catalog
* generate seed files
Co-authored-by: cgardens <giardina.charles@gmail.com>
* Handle destination sync mode in destinations
* Source & Destination sync modes are required (#2500)
* Provide Migration script making sure it is always defined for previous sync configs
* Fix JdbcSource handling of tables with same names in different schemas
* Previously the JdbcSource was combining the columns of any tables with the same name across different schemas into a single stream in the catalog.
* This was caught because in those tables there were columns of the same name with different types which triggered a precondition to check for this.
* The fix makes sure we group by both schema name and table name.
* Adds test to the standard jdbc tests to catch this case.
* This test does NOT run for mysql as, mysql has no concept of schemas.
