1
0
mirror of synced 2026-01-03 06:02:23 -05:00
Commit Graph

28 Commits

Author SHA1 Message Date
Liren Tu
c872042a6b Databricks destination: ensure encrypted JDBC connection (#18032)
* Add ssl=1 to databricks jdbc url

* Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 14:10:48 -07:00
Ashley Baer (PTC)
1b134d866f 🎉 Destination Databricks: Support Azure storage (#15140) (#15329)
* 🎉 Destination Databricks: Support Azure storage (#15140)

* Update docs and version.

* Revert unintentional change to S3 config parsing.

* Revert unnecessary additional table property.

* change spec.json

* Ignore azure integration test

* Add issue link

* auto-bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 01:37:08 -07:00
Simon Späti
8a74d39ac3 📖 Removing existing Glossary of Terms and link to new Data Glossary (#17313) 2022-10-03 12:37:34 +02:00
Liren Tu
fd547c64d7 🐛 Avro related destinations: fix field name clashing with combined restrict (#16243)
* Add test case for allOf and oneOf

* Bump version

* Add pr id

* Bump gcs version

* Bump dest jdbc

* Bump redshift

* Bump snowflake

* Bump databricks

* Bump bigquery

* Revert "Bump dest jdbc"

This reverts commit f10497e96a.

* Use a new pat to avoid api rate limit

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* Revert databricks bump

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 18:06:27 -07:00
oneshcheret
823a79b69a S3, Databricks and Gcs destinations fix test and publish (#15360)
* Postgres source added items for array data type

* Postgres source updated tests for array data type

* S3 destination fix key pair oauth test

* S3 destination clean code

* S3 destination bump version

* S3 destination bump version

* Databricks and gcs destinations bump versions

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 17:21:56 +03:00
Alexander Tsukanov
82297a9b18 🎉Redshift, Databricks, Snowflake, S3 Destinations: Make S3 output filename configurable (#14494)
airbyte-4184: Make S3 output filename configurable
2022-07-15 15:56:21 +03:00
VitaliiMaltsev
095b403c7b Remove additionalProperties: false from JDBC destination connectors (#14618)
* Remove additional properties from JDBC destinations spec

* Remove additional properties from JDBC destinations spec

* removed additionalProperties from Databricks destination and MSSql Destination

* updated Changelog

* bump version

* bump Oracle Strict encrypt

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-15 01:00:41 +03:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
George Claireaux
e63458fabb Publishing java connectors with better formatted stacktrace in Trace messages (#13852)
* start

* revert

* azblob

* bq

* bq denorm

* megapublish baaaabyyyy

* fix needs

* matrix connectors

* auto-bump connector version

* dont failfast and max parallel 5

* multi runno

* minor

* testing matrix agents

* name

* testing multi agents

* tmp fix

* new multi agents

* multi test

* tryy

* let's do this

* magico

* fix

* label test

* couple more connector bumps

* temp

* things

* check this

* lets gooo

* more connectors

* Fix md and lg spacing scss vars (#13886)

* Delete TEMP-testing-command.yml

* auto-bump connector version

* Delete publish-command.yml

* added comment describing bash part

* running single thread

* catch sentry cli

* auto-bump connector version

* Update _variables.scss

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
2022-06-17 16:15:24 +01:00
Andy
fe6eda5b37 🎉 Destination databricks: rename to databricks lakehouse (#13722)
* Update Databricks naming

* Update destination_spec

* Update BOOTSTRAP.md

* Update Dockerfile

* Update README.md

* Update spec.json

* Update databricks.md

* Update databricks.md

* Update airbyte-integrations/connectors/destination-databricks/BOOTSTRAP.md

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>
2022-06-13 17:56:01 -07:00
Simon Späti
93c413c0ed 📚 Destination Databricks: Clarify on Destination Format with Delta-Table (#13396) 2022-06-10 18:06:27 +02:00
LiRen Tu
bb46941867 🎉 Databricks destination: rename to Databricks delta lake (#13630)
* Rename databricks connector

* Rename connector in the seed

* Update changelog with pr id

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-08 18:22:55 -07:00
LiRen Tu
5ddef8639a 📝 Databricks destination: clarify server hostname in the doc (#12943) 2022-05-17 20:37:07 -07:00
LiRen Tu
7c35b03595 🎉 Databricks destination: use new jdbc driver and open source the connector (#12861)
* Migrate to public databricks jdbc driver

* Update documentation

* Bump version

* Format code

* Check in databricks in seed file

* Check in databricks 0.2.0

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-16 14:48:52 -07:00
LiRen Tu
bd59726668 Publish new connectors to log offending json fields in json to avro conversion for debugging (#12578)
* Publish new connectors to log debugging info in json to avro conversion

* Add pull request id

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-04 11:47:07 -07:00
Lake Mossman
3d8a0dc048 Add ExitOnOutOfMemoryError to java connectors and bump versions (#10256) 2022-02-14 15:49:15 -08:00
LiRen Tu
679ce18042 🎉 Destination databricks: move driver downloading to gradle (#9995)
* Download jdbc driver in dockerfile

* Download jdbc driver in dockerfile

* Remove driver downloading from ci

* Update document

* Update public doc

* Download jdbc driver in gradle

* Clean up gradle file

* Clean up dockerfile

* Fix typo
2022-02-02 02:16:53 -08:00
Iryna Grankova
8237a70ce9 🎉 Destination databricks: update fields specifications (#9153)
* Files title/description update for issue # 8948

* Version update for issue # 8948

* Changelogs update for PR #9153

* Update changelog

Co-authored-by: LiRen Tu <tuliren@gmail.com>
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
2022-01-06 21:16:46 -08:00
LiRen Tu
b6a93c4e09 Update Databricks doc (#7618) 2021-11-03 20:34:08 -07:00
LiRen Tu
c9c41dcd08 🎉 Destination S3 & GCS: support additional properties (#7288)
* Log json schema

* Use patched json avro converter

* Rename schema

* Update unit test cases

* Fix ab ap field schema conversion

* Rename files

* Add unit test cases

* Fix dependency for databricks

* Bump versions

* Update documentations

* Update gcs doc

* Set additional properties field name

* Revert s3 and gcs version

* Specify extra props fields

* Refactor json avro conversion doc

* Update connector doc

* Fix databricks spec typo

* Bump connector versions in seed
2021-11-03 11:37:24 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
LiRen Tu
914531cc21 Add accept-terms property to databricks spec (#6792)
* Add accept-terms property to databricks spec

* Update PR id

* Update version

* Update sample config
2021-10-05 12:38:29 -07:00
Abhi Vaidyanatha
bf665cb280 Fix language consistency in Databricks page (#6360)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-21 15:52:25 -07:00
LiRen Tu
2390b5492d Fix more doc issues (#6072) 2021-09-14 22:19:31 -07:00
LiRen Tu
e837048418 🎉 New Destination: Databricks (#5998)
Implement new destination connector for databricks delta lake.
Resolves #2075.

Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-09-14 16:55:53 -07:00
LiRen Tu
679ddf4580 Revert "Add skeleton for databricks destination (#5629)" (#6066)
This reverts commit 79256c46b5.
2021-09-14 16:54:05 -07:00
George Claireaux
79256c46b5 Add skeleton for databricks destination (#5629)
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
Co-authored-by: LiRen Tu <tuliren@gmail.com>
2021-09-14 16:51:52 -07:00