1
0
mirror of synced 2025-12-22 11:31:02 -05:00
Commit Graph

120 Commits

Author SHA1 Message Date
Edward Gao
3991e28549 Destination Clickhouse: increase test timeout (#69717) 2025-11-19 15:17:28 -08:00
Aaron ("AJ") Steers
a7be6e6a0f chore: Sort externalDocumentationUrls by type then title (do not merge) (#69742)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2025-11-18 21:51:00 -08:00
Aaron ("AJ") Steers
16aaee0b9e feat: Add external documentation URLs to all destination connectors (Group A) (#69353)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-11-17 21:11:07 -08:00
Francis Genet
553a19ea01 [Databricks] Now processing queries in batches in DatabricksDestinationHandler.kt (#63311) 2025-07-15 13:44:42 -07:00
Davin Chia
54a7dc5bc7 chore: move remaining certified Destinations new build flow. (#60282)
Destination S3 errors are due to flaky tests.

Destination Databricks tests are erroring out for other reasons.
2025-05-14 17:13:04 -04:00
Aaron ("AJ") Steers
05965c781e chore: add poe_tasks.toml for all java connectors (#59670) 2025-05-05 17:28:27 -07:00
devin-ai-integration[bot]
ceaf322225 chore(destination): Upgrade all Java destination connectors to use java-connector-base:2.0.1 (#56355)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: davin@airbyte.io <davin@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2025-03-24 18:59:36 -04:00
Sena Heydari
e44d30aa70 🐛 Destination Databricks: Fix destination check test table collisions when multiple connections write to same schema. (#55232)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-03-13 13:19:56 -03:00
Augustin
4c6f68039a destination-databricks: Use airbyte/java-connector-base:2.0.0 (#51506) 2025-01-15 17:43:24 +01:00
Augustin
ab839cc9fb destination-databricks: Use airbyte/java-connector-base:1.0.0 (#49898)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-01-09 16:18:55 +01:00
Edward Gao
5bf3f27e38 Destination Databricks: bump resource reqs for check (#48779) 2024-12-03 08:10:39 -08:00
Stephane Geneix
d94b348c17 destination-databricks: update all dependencies (#45438) 2024-09-18 14:19:22 -07:00
Edward Gao
8d04d840ba Destination databricks: move to intengrations (#45439) 2024-09-12 15:51:06 -07:00
Gireesh Sreepathi
bb1833cbf5 Destination Databricks: Create namespace if missing in CHECK (#45208) 2024-09-09 11:02:47 -07:00
Evan Tahler
5bf11d9d9b Destination Databricks - clarify catalog name option (#45115) 2024-09-04 01:38:08 +03:00
Evan Tahler
44a96f879a destination databricks - update docs for access token connections (#44941) 2024-08-30 16:04:01 -07:00
Edward Gao
10f8f3f088 Destination Databricks: Handle table name casing correctly (#44506) 2024-08-22 22:06:25 +03:00
Edward Gao
34f58fab6d Destination databricks: Remove user/pass auth (#40712) 2024-08-14 21:11:38 +03:00
Augustin
601c3c455c Rename registries to registryOverrides in connector metadata (#43757) 2024-08-13 16:10:56 +02:00
Edward Gao
ae4d65e692 Destination Databricks: Implement refreshes (#40692) 2024-08-01 08:45:18 -07:00
Edward Gao
4ad05cd7c5 Destination Databricks: Add generation_id+sync_id (#40689) 2024-07-15 08:21:06 -07:00
Gireesh Sreepathi
c627ce878c 🧱 private preview with Unity catalog and Oauth using service principal (#37613) 2024-05-19 11:08:51 -07:00
Augustin
31c95da499 [skip ci] Add connectorTestSuitesOptions to metadata (#38188) 2024-05-15 15:04:10 -05:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Evan Tahler
4342182cae Remove duplicate S3 regions from destination specs (#36846) 2024-04-05 16:24:26 -05:00
Cynthia Yin
cb8a2edce7 Destination Databricks: pin cloud + OSS version to 1.1.0 (#34125) 2024-01-10 14:17:57 -06:00
Evan Tahler
64cd1ce789 AWS Destinations: New AWS regions (#33924) 2024-01-05 10:51:10 -06:00
Marius Posta
30a5127168 enable groovy formatting in airbyte-ci format config, remove spotless from gradle build (#33013)
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-12-01 09:27:16 -08:00
Stephane Geneix
c642d81b84 Stephane/enable javac errors 1 (#32467) 2023-11-13 18:07:58 -06:00
Augustin
368ba78b64 🧹doc: update connectors README and remove acceptance-test-docker.sh (#32209) 2023-11-06 12:36:07 -06:00
Stephane Geneix
9c6ed93a9d Revert "update all connectors for new CDK version and more stringent javac checks"
This reverts commit 18ad87bbd1.
2023-11-02 15:42:28 -07:00
Stephane Geneix
18ad87bbd1 update all connectors for new CDK version and more stringent javac checks 2023-11-02 15:24:58 -07:00
Marius Posta
7cd8020ac8 java CDK: hoist top-level gradle projects into CDK (#31960)
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-10-30 12:03:06 -07:00
Augustin
ac6f44cf2c remove Dockerfile and .dockerignore for Java connectors (#31769) 2023-10-24 15:08:13 -05:00
Marius Posta
f8edc18039 airbyte-ci,gradle: replace airbyte-docker with airbyte-ci (#30743) 2023-10-04 08:38:17 -07:00
Aaron ("AJ") Steers
da32fc86bf 🚀 Launch Java CDK v0.1.0 (PR #30383)
- Launch Java CDK `v0.1.0`. 🚀
- Remove `airbyte-docker` gradle plugin from java connectors.
- Add `airbyte-java-connector` gradle plugin.
- Remove `airbyte-commons` from global build.gradle.
- Add `/publish-java-cdk` slash command.
- Initial launch of `/airbyte-ci` slash command to test connectors.
2023-09-27 15:46:02 -07:00
Marius Posta
51c67d7eaa gradle: remove airbyteDocker.outputs dependencies (#30314) 2023-09-11 17:16:27 -07:00
Marius Posta
ef2849e35e gradle: fix airbyteDocker task inputs (#30187) 2023-09-07 03:46:31 -07:00
Marius Posta
f5c7c1c0b8 chore: get ./gradlew format to pass for the whole repo (same java style) (#29786) 2023-08-24 05:09:42 -05:00
Edward Gao
ab04c3b2da DATs: Fix spurious failures (#29734) 2023-08-22 17:44:04 -05:00
Ben Church
40781313da Update Internal Fields: update ql levels to better resemble previous high strictness (#29450) 2023-08-15 18:03:10 -05:00
Evan Tahler
9f515a867f DAT tearDown should cleanup *all* schemas used (#29312)
* DAT `tearDown` should cleanup *all* schemas used

* redshift too

* push all method signature changes

* Automated Commit - Format and Process Resources Changes

* use hashset

* TEST_SCHEMAS on setup as well

* fix call

* Automated Commit - Format and Process Resources Changes

---------

Co-authored-by: evantahler <evantahler@users.noreply.github.com>
2023-08-11 11:40:49 -07:00
Ben Church
2f7deaee02 [skip ci] Metadata: Remove leading underscore (#29024)
* DNC

* Add test models

* Add model test

* Remove underscore from metadata files

* Regenerate models

* Add test to check for key transformation

* Allow additional fields on metadata

* Delete transform
2023-08-03 10:56:13 -07:00
Ben Church
e9490e3fb6 Connector Levels: Add new internal metadata fields (#28904)
* Add airbyte internal

* Add tests

* First pass

* Set destinations to same levels as sources

* Best guess at missing statuses

* Best guess at _ql

* Add separate enum class

* Fix support level name

* Update templates

* Add one more test
2023-08-01 18:08:33 -05:00
Gaëtan Podevijn
eb14b968d8 Destination Databricks: connector supports schema evolution (schemaMerge) #26658 (#26942)
* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector (#1)

* Ssdp 165/enable schema evolution in the airbyte databricks connector (#4)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Ssdp 165/add doc (#5)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Edit connector doc
2023-06-08 14:56:34 -03:00
Ben Church
1dabc6208e Metadata: add tags field (#26320)
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-05-26 16:13:09 -07:00
Augustin
fd3655707e connectors-ci: add finalize_build logic to handle custom Dockerfiles (#26489) 2023-05-25 09:32:19 +02:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Akash Kulkarni
889a5bc50b Run formatter (#25901) 2023-05-09 10:03:22 -07:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00