* Add a drop table hook to drop scd tables in case of overwrite sync
* Add an integration test for dropping SCD table on overwrite
* skip new test for Oracle and TiDB
* Add normalization run after initial reset
* Bump normalization version
* add icon for clickhouse in destination folder
* use http port only in clickhouse
* declare driver: http for dbt explicitly
* bump destination clickhouse version
Co-authored-by: restrry <restrry@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Cleaned error messages factory PR
* Bumped MySQL and Postgres version
* Fixed messages and typos in test
* Fixes the changelog conflict with per-stream state
* Added note for flaky test
* Bumps mysql version to match changelog
* Added exception objects to all LOGGER.error for more visibility
* auto-bump connector version [ci skip]
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Update dbt-clickhouse version to 1.1.7 to support AirByte on ClickHouse cloud
* Fix quote handling in Clickhouse normalization tests
* Update test output for Clickhouse
* Bump version and update changelog
Co-authored-by: guykohen <guy@clickhouse.com>
* generate airbyte_type:integer
* normalization accepts `airbyte_type: integer`
* handles ints+longs
* update avro for consistency
* delete long type for now, treat all ints as longs
* update avro type mappings
{type:number, airbyte_type:integer} -> long
{type:number, airbyte_type:big_integer} -> string (i.e. "unbounded integer")
* fix test
* remove long handling
* Revert "remove long handling"
This reverts commit 33ade8d2831e675c3545ac6019d200ec312e54d9.
* Revert "update avro type mappings"
This reverts commit 5b0349badad7545efe8e1191291a628445fe1c84.
* Revert "delete long type for now, treat all ints as longs"
This reverts commit 018efd4a5d0c59f392fd8e3b0d0967c666b72947.
* Revert "update avro for consistency"
This reverts commit bcf47c6799b5906deb4f219d7f6e64ea73b41b74.
* newline@eof
* update test
* slightly better local tests
* fix test
* missed a few cases
* postgres tests use correct hostnames
* fix normalization
* fix int macro
* add test case
* normalization test output
* handle int/long correctly
* fix types for other DBs
* uint32 -> bigint; tests
* add type value assertions
* more test updates
* regenerate output
* reconcile big_integer to match docs
* update comment
* fix type
* fix mysql constructor call
* bigint only has 38 digits
* fix s3 ints, fix DAT test case
* big_integer should be string
* reduce to 28 digit big_ints
* fix test setup, mysql
* kill big_integer tests
* regenerate output
* version bumps
* auto-bump connector version [ci skip]
* auto-bump connector version [ci skip]
* auto-bump connector version [ci skip]
* auto-bump connector version [ci skip]
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* add datatypes
* up
* up
* add MySQL
* add MSSQL
* fix
* add macros
* add macros
* upd
* upd
* upd for clickhouse
* Return datetime2 for MS SQL
* Upd time type for mysql
* Upd datetime for MySQL
* update
* upd date type for clickhouse
* up
* auto-generate
* bump version
* bump version
* Normalization for Snowflake destination: added support for key pair authentication
* Normalization for Snowflake destination: updated changelogs
* Normalization for Snowflake destination: renamed property passphrase to password
* Normalization for Snowflake destination: bump normalization version in NormalizationRunnerFactory
* Normalization for Snowflake destination: added unit tests and change file creating process
* Normalization for Snowflake destination: added unit tests and change file creating process
* Normalization for Snowflake destination: added unit tests and change file creating process
Now after `base-normalization` SAT the Destination Redshift will be automatically cleaned up from test leftovers. Other destinations are not covered yet.
* fix: postgres string type
* feat: added TODO for removal
* fix: better comment style
* Update airbyte-integrations/bases/base-normalization/dbt-project-template/macros/cross_db_utils/datatypes.sql
Added the dbt upgrade condition to TODO
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
* Mssql destination: enable DAT tests for mssql destination, use nvarchar and datetime2 by default
* Mssql destination: update array handling in test
* Mssql destination: update array and JSON handling in test
* Mssql destination: remove unused method
* bugfix bigquery tests, dataset_location added
* basic-normalization.md updated
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
* Mssql destination: change parent class for mssql test
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
