* add Dataset ID parse method
* add BigQuery Destination unit test
* update change log
* fit to the latest code base
* update change log
* change var name to const name
* change public method to private
* add test cases for testGetDatasetIdFail
* add integration test for dataset-id prefixed with project-id
* fix getDatasetId
* add comment to parameterized test provider
* update docker image versions
* update docker image versions again
* use instanceprofile to auth if id is not provided
* restore support for using endpoint
* update readme
* update changelog
* update documentation, add setup guide
* Update docs/integrations/destinations/s3.md
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
* minor fixes
* add error message
* now using RuntimeException
* Update airbyte-integrations/connectors/destination-s3/src/main/java/io/airbyte/integrations/destination/s3/S3DestinationConfig.java
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
* bump connector version
* update seed file
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
* Fix GCS Avro file processing with invalid "-" character
* Extend test data to cover the case
* incr ver
* s3 ver upd
* add dependency
* add dependency
* Support array field with empty items specification
* Remove all exceptions
* Format code
* Bump connector versions
* Bump bigquery versions
* Update docs
* Remove unused code
* Update doc for PR #9363
* Update doc about defaulting all improperly typed fields to string
* Ignore bigquery
* Update version and doc
* Update doc
* Bump version in seed
* [9044] Destination-gcs\destination-bigquery(gcs) - updated check() method to handle that user has both storage.objects.create and storage.multipartUploads.create roles
* Snowflake destination: do not create schema if it exists
* Snowflake destination: move common constants to parent class
* Snowflake destination: bump version
* Snowflake destination: bump version
* clarify confusing parts of setting up staging for bq destination
* Added Storage Admin
* update gcs destination docs too
* fix indentation
* Update required permission list
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
* Files title/description update for issue # 8950
* Version update for issue # 8950
* Changelogs update for PR #9158
* update destination_specs.yaml with new version
* update version for destination-mssql-strict-encrypt
* fix destination-mssql-strict-encrypt integration tests
Co-authored-by: mkhokh <mariia.khokh@globallogic.com>
* add part_size to Snowflake-s3, Bihquery-gcs
* add part size for bigquery-denormalized
* update changelog md
* add limints for part size
* update bigquery version
* Implement destination null
* Update existing testing destinations
* Merge in logging consumer
* Remove old destination null
* Add documentation
* Add destination to build and summary
* Fix test
* Update acceptance test
* Log state message
* Remove unused variable
* Remove extra statement
* Remove old null doc
* Add dev null destination
* Update doc to include changelog for dev null
* Format code
* Fix doc
* Register e2e test destination in seed
* Destination Snowflake update check method to verify permission for stages
* fix for jdk 17
* fix for jdk 17
* fix with ci secrets
* fix with ci secrets
* removed snowflake secrets from ci_credentials.sh
* bump version
Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>
* add ClickHouse destination
* update docs
* format code
* code improvement as per code review
* add ssh tunneling and ssl/tls support and code enhancement
* merge from master
* disable testCustomDbtTransformationsFailure test
* fix string format bug
* fix reserved keywords bug and disable dbt
* disable dbt in expect result
* add type hints
* bump connector version
Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
* initial commit, working sending single messages
* Adds Unit Tests, removes un-implemented features from Spec, yields sent messages, fixed fifo suffix match, adds bootstrap
* Remove yield from RECORD message
* Complete readme for sqs
* Formatting
* Minor tidying of unit tests
* Add references in docs pages
* formatting
* Add docs links
* formatting
* add new region
* update seed files for destination-gcs
* add region northamerica-northeast2
* update changelog
* Change version to 0.1.15
* Revert version in seed before publishing
* Bump seed version and update sepc
Co-authored-by: Antonio G <antonio@datascope.io>
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
Co-authored-by: LiRen Tu <tuliren@gmail.com>
* add new region
* update seed files for destination-gcs
* add region northamerica-northeast2
* update changelog
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
* add kinesis destination connector
* format code
* add javadoc and general documentation
* fix buffer bug and refactor code
* rename vars to common airbyte usage
* run format
* run format + seed file
* add eof
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
