jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 02:51:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

59 Commits

Author SHA1 Message Date
Francis Genet
553a19ea01 [Databricks] Now processing queries in batches in DatabricksDestinationHandler.kt (#63311) 2025-07-15 13:44:42 -07:00
Ian Alton
01cd16654e 11059 multi-instance, versioned docs (#58095) 
Co-authored-by: devin-ai-integration[bot] <158243242+devin-ai-integration[bot]@users.noreply.github.com>
 2025-04-24 02:58:09 +03:00
devin-ai-integration[bot]
ceaf322225 chore(destination): Upgrade all Java destination connectors to use java-connector-base:2.0.1 (#56355) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: davin@airbyte.io <davin@airbyte.io>
Co-authored-by: Davin Chia <davinchia@gmail.com>
 2025-03-24 18:59:36 -04:00
Sena Heydari
e44d30aa70 🐛 Destination Databricks: Fix destination check test table collisions when multiple connections write to same schema. (#55232) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-03-13 13:19:56 -03:00
Augustin
4c6f68039a destination-databricks: Use airbyte/java-connector-base:2.0.0 (#51506) 2025-01-15 17:43:24 +01:00
Augustin
ab839cc9fb destination-databricks: Use airbyte/java-connector-base:1.0.0 (#49898) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-01-09 16:18:55 +01:00
Edward Gao
5bf3f27e38 Destination Databricks: bump resource reqs for check (#48779) 2024-12-03 08:10:39 -08:00
Stephane Geneix
d94b348c17 destination-databricks: update all dependencies (#45438) 2024-09-18 14:19:22 -07:00
Edward Gao
8d04d840ba Destination databricks: move to intengrations (#45439) 2024-09-12 15:51:06 -07:00
Gireesh Sreepathi
bb1833cbf5 Destination Databricks: Create namespace if missing in CHECK (#45208) 2024-09-09 11:02:47 -07:00
Edward Gao
d02d29c054 Destination databricks: add banner for gcp oauth (#45127) 2024-09-04 19:03:59 +03:00
Evan Tahler
5bf11d9d9b Destination Databricks - clarify catalog name option (#45115) 2024-09-04 01:38:08 +03:00
Evan Tahler
44a96f879a destination databricks - update docs for access token connections (#44941) 2024-08-30 16:04:01 -07:00
Edward Gao
10f8f3f088 Destination Databricks: Handle table name casing correctly (#44506) 2024-08-22 22:06:25 +03:00
Edward Gao
34f58fab6d Destination databricks: Remove user/pass auth (#40712) 2024-08-14 21:11:38 +03:00
Edward Gao
ae4d65e692 Destination Databricks: Implement refreshes (#40692) 2024-08-01 08:45:18 -07:00
Edward Gao
4ad05cd7c5 Destination Databricks: Add generation_id+sync_id (#40689) 2024-07-15 08:21:06 -07:00
Audrey Maldonado
b9690ba76e Wrapping changelog in details for a collapsible view (#38801) 2024-06-04 13:40:53 -04:00
Gireesh Sreepathi
c627ce878c 🧱 private preview with Unity catalog and Oauth using service principal (#37613) 2024-05-19 11:08:51 -07:00
Evan Tahler
4342182cae Remove duplicate S3 regions from destination specs (#36846) 2024-04-05 16:24:26 -05:00
Cynthia Yin
cb8a2edce7 Destination Databricks: pin cloud + OSS version to 1.1.0 (#34125) 2024-01-10 14:17:57 -06:00
Evan Tahler
64cd1ce789 AWS Destinations: New AWS regions (#33924) 2024-01-05 10:51:10 -06:00
Joe Reuter
e2789b4f03 Update docusaurus to 3 (#33041) 2023-12-11 17:03:18 +01:00
Evan Tahler
2214883d57 databricks: remove note about normalization (#31969) 2023-10-30 16:36:20 +00:00
Evan Tahler
9210547af5 [Docs] No Deduped + Hostory, Append + Deduped is the future! (#29114) 
* [Docs] No `Deduped + Hostory`, `Append + Deduped` is the future!

* fix links
 2023-08-08 15:07:49 -07:00
Gaëtan Podevijn
eb14b968d8 ✨ Destination Databricks: connector supports schema evolution (schemaMerge) #26658 (#26942) 
* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector (#1)

* Ssdp 165/enable schema evolution in the airbyte databricks connector (#4)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Ssdp 165/add doc (#5)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Edit connector doc
 2023-06-08 14:56:34 -03:00
Edward Gao
d9a50be557 Destination Databricks: use hive_metastore if catalog not set (#25366) 
* use hive_metastore if catalog not set

* Automated Change

* add test case

* version bump + changelog

* auto-bump connector version

---------

Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-20 17:42:26 -07:00
Yevhen Sukhomud
fd70eb614d 24153 Destination Databricks: Fix support for external tables on S3 (#24657) 
* 24153 Destination Databricks: Update s3 source external

* 24153 Destination Databricks: Fixed databricks.md formatting

* 24153 Destination Databricks: Update the version

* auto-bump connector version

---------

Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-19 13:28:32 -07:00
Julien Diennet
d50a801446 Update databricks.md (#24778) 2023-04-03 13:22:18 -03:00
Yevhen Sukhomud
7ae1de24af Destination Databricks: Support managed tables (#23965) 
* 23036 Destination Databricks: support managed tables

* 23036 Destination Databricks: Update Databricks version to 1.0.0

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-21 10:51:08 +07:00
Sophia Wiley
5512befeb1 Docs: updated links from .io to .com (#23652) 
* updated links

* edited contributors link

* deleted line about CDK in docs
 2023-03-06 17:27:55 +01:00
Liren Tu
c872042a6b Databricks destination: ensure encrypted JDBC connection (#18032) 
* Add ssl=1 to databricks jdbc url

* Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-15 14:10:48 -07:00
Ashley Baer (PTC)
1b134d866f 🎉 Destination Databricks: Support Azure storage (#15140) (#15329) 
* 🎉 Destination Databricks: Support Azure storage (#15140)

* Update docs and version.

* Revert unintentional change to S3 config parsing.

* Revert unnecessary additional table property.

* change spec.json

* Ignore azure integration test

* Add issue link

* auto-bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-15 01:37:08 -07:00
Simon Späti
8a74d39ac3 📖 Removing existing Glossary of Terms and link to new Data Glossary (#17313) 2022-10-03 12:37:34 +02:00
Liren Tu
fd547c64d7 🐛 Avro related destinations: fix field name clashing with combined restrict (#16243) 
* Add test case for allOf and oneOf

* Bump version

* Add pr id

* Bump gcs version

* Bump dest jdbc

* Bump redshift

* Bump snowflake

* Bump databricks

* Bump bigquery

* Revert "Bump dest jdbc"

This reverts commit f10497e96a.

* Use a new pat to avoid api rate limit

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* Revert databricks bump

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-01 18:06:27 -07:00
oneshcheret
823a79b69a S3, Databricks and Gcs destinations fix test and publish (#15360) 
* Postgres source added items for array data type

* Postgres source updated tests for array data type

* S3 destination fix key pair oauth test

* S3 destination clean code

* S3 destination bump version

* S3 destination bump version

* Databricks and gcs destinations bump versions

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-05 17:21:56 +03:00
Alexander Tsukanov
82297a9b18 🎉Redshift, Databricks, Snowflake, S3 Destinations: Make S3 output filename configurable (#14494) 
airbyte-4184: Make S3 output filename configurable
 2022-07-15 15:56:21 +03:00
VitaliiMaltsev
095b403c7b Remove additionalProperties: false from JDBC destination connectors (#14618) 
* Remove additional properties from JDBC destinations spec

* Remove additional properties from JDBC destinations spec

* removed additionalProperties from Databricks destination and MSSql Destination

* updated Changelog

* bump version

* bump Oracle Strict encrypt

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-15 01:00:41 +03:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) 
This reverts commit a2c194a11f.
 2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369) 
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
 2022-07-08 14:18:27 -05:00
George Claireaux
e63458fabb Publishing java connectors with better formatted stacktrace in Trace messages (#13852) 
* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Fix md and lg spacing scss vars (#13886)

* Delete TEMP-testing-command.yml

* auto-bump connector version

* Delete publish-command.yml

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* Update _variables.scss

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
 2022-06-17 16:15:24 +01:00
Andy
fe6eda5b37 🎉 Destination databricks: rename to databricks lakehouse (#13722) 
* Update Databricks naming

* Update destination_spec

* Update BOOTSTRAP.md

* Update Dockerfile

* Update README.md

* Update spec.json

* Update databricks.md

* Update databricks.md

* Update airbyte-integrations/connectors/destination-databricks/BOOTSTRAP.md

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>
 2022-06-13 17:56:01 -07:00
Simon Späti
93c413c0ed 📚 Destination Databricks: Clarify on Destination Format with Delta-Table (#13396) 2022-06-10 18:06:27 +02:00
LiRen Tu
bb46941867 🎉 Databricks destination: rename to Databricks delta lake (#13630) 
* Rename databricks connector

* Rename connector in the seed

* Update changelog with pr id

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-06-08 18:22:55 -07:00
LiRen Tu
5ddef8639a 📝 Databricks destination: clarify server hostname in the doc (#12943) 2022-05-17 20:37:07 -07:00
LiRen Tu
7c35b03595 🎉 Databricks destination: use new jdbc driver and open source the connector (#12861) 
* Migrate to public databricks jdbc driver

* Update documentation

* Bump version

* Format code

* Check in databricks in seed file

* Check in databricks 0.2.0

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-05-16 14:48:52 -07:00
LiRen Tu
bd59726668 Publish new connectors to log offending json fields in json to avro conversion for debugging (#12578) 
* Publish new connectors to log debugging info in json to avro conversion

* Add pull request id

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-05-04 11:47:07 -07:00
Lake Mossman
3d8a0dc048 Add ExitOnOutOfMemoryError to java connectors and bump versions (#10256) 2022-02-14 15:49:15 -08:00
LiRen Tu
679ce18042 🎉 Destination databricks: move driver downloading to gradle (#9995) 
* Download jdbc driver in dockerfile

* Download jdbc driver in dockerfile

* Remove driver downloading from ci

* Update document

* Update public doc

* Download jdbc driver in gradle

* Clean up gradle file

* Clean up dockerfile

* Fix typo
 2022-02-02 02:16:53 -08:00
Iryna Grankova
8237a70ce9 🎉 Destination databricks: update fields specifications (#9153) 
* Files title/description update for issue # 8948

* Version update for issue # 8948

* Changelogs update for PR #9153

* Update changelog

Co-authored-by: LiRen Tu <tuliren@gmail.com>
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
 2022-01-06 21:16:46 -08:00