* Postgres Source: fixed truncated precision if the value of the millisecond or second is 0
* check CI with 1.15.3 testcontainer
* check CI with 1.15.3 testcontainer
* returned latest version of testcontainer
* fixed checkstyle
* fixed checkstyle
* returned latest testcontainer version
* updated CHANGELOG
* bump version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Fall back to parsing w/ or w/o TZ if parsing a date or a time string fails
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Switch to measure max row byte size
* Reduce fetch size change logs
* Update unit tests
* Determine jdbc buffer size based on max memory
* Bump postgres version
* Bump postgres version
* Bump mysql version
* Bump mssql version
* Format java code
* Increase hikari connection timeout
* Update data source default parameters
* auto-bump connector version
* Mark postgres 0.4.21 as not published
* Revert "Bump mysql version"
This reverts commit ad9135258c.
* Fix unit test
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* cdc - add support of tsquery type
* rebase on master
* Add changes made by the build
* Update version in Dockerfile
* auto-bump connector version
Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Remove host in azure username
* Bump version
* Fix test
* Replace host with jdbc_url
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Default scaffold to use adaptive streaming config
* Switch more connectors to use adaptive streaming config
* Bump version for cockroach db
* Bump version for db2
* Bump mssql version
* Bump mysql version
* Bump oracle version
* Bump postgres version
* Bump redshift version
* Bump snowflake version
* Bump tidb version
* auto-bump connector version
* Fix db2 findbug issue
* auto-bump connector version
* auto-bump connector version
* auto-bump connector version
* auto-bump connector version
* Fix more findbug issues
* auto-bump connector version
* auto-bump connector version
* auto-bump connector version
* Fix findbug issue for mysql-strict-encrypt
* Fix findbugs issue for oracle source
* auto-bump connector version
* Remove suppress warnings annotation
* Fix oracle encrypt tests
* Fix oracle encrypt acceptance test
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* JDBC sources: update for sources that not have permissions issues
* Postgres, CockroachDB and DB2 sources: updated case when user has none permitted table
* Postgres, CockroachDB and DB2 sources: updated case when user has none permitted table
* Postgres, CockroachDB and DB2 sources: bump versions
* Postgres, CockroachDB and DB2 sources: bump source specs
* Postgres, CockroachDB and DB2 sources: revert changes for postgres-strict-encrypt
* Add skeleton to support all postgres types
* Consolidate type tests
* Fix corner cases
* Bump postgres version
* Add tests for time and timetz
* Format code
* Revert date to timestamp
* Update comment
* Fix unit tests
* 🐛 Jdbc sources: switch from "string" to "array" schema type for columns with JDBCType.ARRAY (#8749)
* support array for jdbc sources
* fixed PR comments, added test cases
* added more elements for test case
* Fix test case
* add array test case for JdbcSourceOperations
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
* Revert changes to support special number values
Postgres source cannot handle these special values yet
See https://github.com/airbytehq/airbyte/issues/8902
* Revert infinity and nan assertion in unit tests
This reverts commit 3bee7d19ea.
* Update documentation
* Bump postgres source version in seed
Co-authored-by: Yurii Bidiuk <35812734+yurii-bidiuk@users.noreply.github.com>
* Fix postgres money type > 1000
* Convert money to double
* Bump source postgres version
* Do not bump version in seed yet
* Check type ignoring case
* Test insertion with currency symbol
* Test parsing money string method
* Add test case with currency symbol and negative values
* Update version date
* Bump seed version
* airbyte-8254 Source Postgres: views are not listed during schema discovery
* airbyte-8254 Source Postgres: views are not listed during schema discovery
* airbyte-8254 Source Postgres: views are not listed during schema discovery
* airbyte-8254 Remove GRANTEE and PRIVILEGE constants from AbstractJdbcSource.java
* airbyte-8254 Version bumped.
* airbyte-8254 Version bumped.
* airbyte-8254 Version bumped.
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Do not list tables we do not have access to in the connection settings
* airbyte-5172 Added docs, bump dockerfiles
* airbyte-5172 Fix PR comments.
* airbyte-5172 Fixed PR comments.
* airbyte-5172 bumped connector version.
* Fix data type tests in CdcPostgresSourceComprehensiveTest
* update style format
* bump version for postgres source
* bump version for postgres source in json definition
* remove unnecessary comments from test and bump version for postgres strict encrypt source
* resolved potential conflicts with debezium utils in mssql converter implementation
* resolved potential conflicts with debezium utils in mssql converter implementation
* Update notes for money type in postgres.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Update docs/integrations/sources/postgres.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* added test cases for converting data values for postgres cdc, remove time zone utc from test container
* remove redundant void message from test
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* update style format
* fix time zone in DebeziumConverterUtilsTest
* set utc time zone in DataTypeUtils
* set utc time zone for date format
* revert changes regarding timezone in date format, disable tests with number and duration
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Add transactionTimestamp field
* Update CDC_timestamp type in integrations and tests
* no jsonschema timestamp type, use string
* Linting
* format
* fix compilation error
* fix compilation error
* fix test output
* upgrade version for mssql,mysql,postgres
* stupid mistake! forgot to upgrade docker file
Co-authored-by: danieldiamond <danieldiamond1@gmail.com>
* throw exception if we close engine before snapshot is complete + increase timeout for subsequent records
* add comment + bump postgres version to use new changes
* 🐛 Source PostgreSQL: Fixed PostgreSQL CDC numeric handling
* Rm unnecessary tests for non-CDC
* Add more values to test in postgres cdc numeric
* Fix comment so it points to psql docs instead
* Oops, added to the wrong test file
* Add sourceType as well
* Fix precision on tests
* add AIRBYTE_ENTRYPOINT for kubernetes support
* bump versions
* bump version in seed
* Update generic template
* keep scaffold sources at 0.1.0
* add missing newline
* handle python base versions correctly
* re-bump mysql and postgres sources
* re-bump snowflake destination
* add skip tests option
* switch to running tests
* reverse conditional to make it safer
* fix publish to include the test running
* fix iterable version
* fix file generation
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.
Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
* spike
* more
* debezium wip
* use oneof for configuration
* iterator wrapping structure
* push current
* working loop
* move capability into source
* hack it into a sharable state
* debezium test runner (#2617)
* CDC Wait for Values (#2618)
* output actual AirbyteMessages for cdc (#2631)
* message conversion
* fmt
* add lsn extraction and comparison (#2613)
* postgres cdc catalog (#2673)
* update cdc catalog
* A
* table selection for cdc (#2690)
* table selection for cdc
* fix broken merge
* also test double quote in name
* Add state management to CDC (#2718)
* CDC: Fix Producer/Consumer State Machine (#2721)
* CDC Postgres Tests (#2777)
* fix postgres cdc image name and run check before reading data (#2785)
* minor postgres cdc fixes
* add test and fix check behavior
* fix
* improve comment
* remove unused props, remove todos, add some more sanity tests (#2791)
* cdc: add offset store tests (#2793)
* clean (#2798)
* postgres cdc docs (#2784)
* cdc docs
* Update docs/integrations/sources/postgres.md
Co-authored-by: Charles <giardina.charles@gmail.com>
* address gcp
* learn too english
* add link
* add more disk space warnings
* add additional cdc use case
* add information on how to find postgresql.conf
* add how to find the file
Co-authored-by: Charles <giardina.charles@gmail.com>
* various merge conflict fixes (#2799)
* cdc standard tests (#2813)
* require cdc users to create publications & update docs (#2818)
* postgres cdc race condition
* working? but different process
* add additional logging to help debug in the future
* everything done except working config
* remove unintended change
* Use oneOf in PG CDC spec (#2827)
* add oneOf configuration for postgres cdc (#2831)
* add oneof configuration for cdc postgres
* fmt
Co-authored-by: Charles <giardina.charles@gmail.com>
* fix test (#2834)
* fix test
* bump version
* add docs on creating replica identities (#2838)
* add docs on creating replica identities
* emphasize danger
* grammar
* bump pg version in source catalog
* generate seed files
Co-authored-by: cgardens <giardina.charles@gmail.com>
