* [18713] Destination-bigquery: updated Check method to test for non-billable project
* fixed typo in comments
* Bumped version
* auto-bump connector version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* destination-s3-glue
* reimplement schema generation to use recursion
* configure serialization library
* include data on update
* flatten data field
* improve location path
* generate s3-glue destination
* refactor s3-glue as separate connector
* add acceptance tests and cleanup
* check field presence
* override test image name
* add s3-glue readme
* format files
* add redpanda readme
* add s3 glue to source def
* auto-bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* first commit
* normalized code and integration test
* add bootstrap.md
* add doris to destination def
* auto-bump connector version
* format files
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Adds TLS check to mongodb destination and migrates util constants
* Migrates MongodbSourceUitls to general purprose Utils file
* Updates expected_spec.json to include SSH tunnel
* Bumps connector version and removes connector from being hidden in UI
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 🎉 New Desination: Heap Analytics [python cdk]
- implement a heap client to load data via the server-side API: https://developers.heap.io/reference/server-side-apis-overview
- the connector supports a generic data source, and the api_type determines the output schema. The output schema is dynamic.
- users pick the columns that will be loaded to the destination
- Consequently, each configured catalog only includes one stream
* add a bootstrap to illustrate the connector
* add destination dest def
* run format all files
* correct unit test
* auto-bump connector version
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Add SSH tunnel for MongoDB Destination
* Fixed host/port resolution issues with Docker containers
* Formatting changes
* Bump version number and adds documentation for SSH tunnel
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* make bucket_path required
* check for nonempty path
* not required
* handle null/empty path
* version bump + changelog
* fix comment
* auto-bump connector version
* format
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* log the full stacktrace rather than just message
* version bumps + changelog
* auto-bump connector version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* 16250 Destination Redis: Add SSH support
* 16250 Resolve port issue
* 11679 Bump version
* auto-bump connector version
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Add support for using URL in tunneled config
* Add support for SSH tunneling to destination-elasticsearch and destination-elasticsearch-strict-encrypt
* Adds logic to fail upon non-deterministic custom S3 endpoint and documentation for insecure settings
* Reused config factory settings to a single static variable
* Updated error message and example in the spec.json to match expectation of secured endpoint
* Added validation check within the base s3
* Integrated AdaptiveDestinationRunner with S3Destination
* Reduced visibility for testing and fixed AdaptiveDestinationRunner issue
* Adds speicifc secure protocol with S3 and empty endpoint check
* Bumps docker version and adds comments and clearer string methods
* auto-bump connector version [ci skip]
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* add icon for clickhouse in destination folder
* use http port only in clickhouse
* declare driver: http for dbt explicitly
* bump destination clickhouse version
Co-authored-by: restrry <restrry@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* Make error more descriptive in case of no encryption state
* Fix failing test
* Change error message on strict-encrypt postgres destination as well. Fix failing test
* update versions and changelogs
* auto-bump connector version [ci skip]
* auto-bump connector version [ci skip]
* auto-bump connector version [ci skip]
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
* added destination-r2 spec
added base-java-s3 module
updated common s3 lib
local
changed dependency of s3 in all realted modules
minor style fixes
added common module for s3 integration tests
* fix configuration for r2 integration tests
* fix configuration for r2 integration tests
* added docs for destination-r2
* minor import fixes
* mark test as disabled
* fixed imports in destination-snowflake
* restored styling task
* added tests for S3DEstinationConfig
* added upload threads count configuration for r2(due to limitations)
* deleted parquet format type
* Fix import in gcs
* Fix import in redshift
* Fix import in snowflake
* Fix one more import in gcs
* Fix one more import in redshift
* Fix import in databricks
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
* stop overriding namespace?
* set namespace if needed
* also check for empty namespace
* version bump + changelog
* auto-bump connector version [ci skip]
* sanitize dataset id
* auto-bump connector version [ci skip]
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
