jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 02:51:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

482 Commits

Author SHA1 Message Date
Stephane Geneix
b2b9b7fa21 reduce interrupt and shutdown delays to 1 minutes and 2 minutes when stopping a connector (initially set at 60minutes and 70minutes) (#35527) 
Fixes #32348 
discussed here : https://airbytehq-team.slack.com/archives/C02U2SSHP9S/p1708552465201999
 2024-02-23 14:12:28 -08:00
Marius Posta
2b370f84c2 source-mysql: bump patch version following #35569 (#35573) 
Co-authored-by: Stephane Geneix <stephane@airbyte.io>
 2024-02-23 00:19:56 -04:00
Akash Kulkarni
1162302069 [Source-mysql] : Adopt 0.21.4 and reduce cdc state compression threshold to 1MB (#35525) 2024-02-21 19:24:56 -08:00
Akash Kulkarni
40a5edc5fe [Source-mysql] : Add config to throw an error on invalid CDC position (#35338) 2024-02-20 14:09:05 -08:00
Marius Posta
e3ab5b6aab source-mysql: add and adopt TestDatabaseWithInvalidDatabaseName (#35210) 2024-02-15 09:30:48 -08:00
Akash Kulkarni
5bab3df367 Add airbyte trace utility to emit analytics messages & emit messages for MongoDB, Postgres & MySQL (#35036) 2024-02-13 19:10:38 -04:00
Akash Kulkarni
62e5528e57 Don't emit final state if there is an underlying stream failure (#34869) 
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2024-02-13 12:31:54 -04:00
Xiaohan Song
82d9197587 🐛 source-mysql Support special chars in dbname (#34580) 2024-02-12 11:06:16 -08:00
Xiaohan Song
b85f9994f4 [Source-mysql] Add soft link in mysql test db (#35045) 2024-02-09 14:28:05 -08:00
Marius Posta
796c0ee494 source-mysql: adopt cleaned-up cdk (#34750) 2024-02-09 14:04:41 -06:00
Augustin
9dc5bf3965 source-postgres/mysql: fix wrong tags in metadata (#34980) 2024-02-07 16:18:02 -06:00
Marius Posta
6f0fd7a2b9 refactor debezium harness in CDK, push connector-specific logic down to connectors (#34573) 2024-01-27 14:05:47 -06:00
Xiaohan Song
b290208391 Add count in state message for incremental syncs (#33005) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
 2024-01-09 21:05:57 -04:00
Xiaohan Song
18e0e7741a ✨ Introduce StateIteratorProcessor in CDK (#33312) 2024-01-03 15:29:12 -08:00
Subodh Kant Chaturvedi
5b915c6837 mysql-source: remove LEGACY state flag (#33436) 2023-12-19 23:45:51 +05:30
Akash Kulkarni
4c9908496b Add debugger drivers for MongoDB & MySQL (#33356) 
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
 2023-12-12 20:07:46 -04:00
Rodi Reich Zilberman
f5ae28fc0c 🐛 Rodi/port zero date time behavior fix (#33210) 
Co-authored-by: Robert Tomczak <36033856+robertomczak@users.noreply.github.com>
Co-authored-by: robertomczak <robertomczak@users.noreply.github.com>
 2023-12-11 11:09:14 -08:00
Stephane Geneix
3cc5188e93 rename getImageModifiers into getContainerModifiers everywhere (#32958) 
simple refactor
 2023-12-07 20:08:47 -08:00
Stephane Geneix
d648ec5125 introduce ImageModifier to MySql source (#32900) 
introduce imageModifier to MySql so we don't use strings everywhere
 2023-12-07 15:50:38 -08:00
Stephane Geneix
0b8b11b3e5 introduce BaseImage to MySql source (#32899) 
introduce baseImage to MySql so we don't use strings everywhere
 2023-12-07 15:38:42 -08:00
Akash Kulkarni
ea8cf787cf [Source MySQL] : Improvements to schema snapshotting and error handling (#33082) 
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
 2023-12-07 11:24:38 -08:00
Xiaohan Song
e66bc43063 🐛 Source mysql: remove the culprit line for mysql not releasing (#33079) 2023-12-04 23:02:34 +00:00
Marius Posta
30a5127168 enable groovy formatting in airbyte-ci format config, remove spotless from gradle build (#33013) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-12-01 09:27:16 -08:00
Xiaohan Song
2d26337bda Use parse base64Binary to parse binary related data (#32610) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-11-30 15:05:45 -04:00
Duy Nguyen
665e4f73ad source-mysql: merge strict encrypt variant into standard main mysql source (#31062) 
Co-authored-by: erohmensing <erohmensing@gmail.com>
Co-authored-by: nguyenaiden <nguyenaiden@users.noreply.github.com>
Co-authored-by: erohmensing <erohmensing@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
Co-authored-by: Marius Posta <marius@airbyte.io>
 2023-11-29 10:45:28 -04:00
Xiaohan Song
d7c8f35c28 [Mysql] Apply initial setup time to Debezium setup time (#32662) 2023-11-28 13:54:35 -08:00
Marius Posta
d97a399a24 source-mysql, source-mssql: parallelize test execution (#32772) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-11-27 12:49:06 -06:00
Stephane Geneix
49043b570f 🐛 📝 re-update all connectors for new CDK version and more stringent javac checks (#32125) 2023-11-08 18:21:14 -04:00
Augustin
368ba78b64 🧹doc: update connectors README and remove acceptance-test-docker.sh (#32209) 2023-11-06 12:36:07 -06:00
Stephane Geneix
a2f8eec7f8 update CDK to 0.4.1 (#32193) 2023-11-04 09:53:08 -04:00
Marius Posta
cb552f9902 source-mysql: use CDK 0.4.0 (#32174) 2023-11-04 01:58:25 +00:00
Stephane Geneix
9c6ed93a9d Revert "update all connectors for new CDK version and more stringent javac checks" 
This reverts commit 18ad87bbd1.
 2023-11-02 15:42:28 -07:00
Stephane Geneix
18ad87bbd1 update all connectors for new CDK version and more stringent javac checks 2023-11-02 15:24:58 -07:00
Rodi Reich Zilberman
1e8e6402bc Revert "Automated Commit - Formatting Changes" (#32077) 2023-11-01 15:38:25 -05:00
Rodi Reich Zilberman
f5c87968ca ✨URL encode username and password fields (#32028) 
Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-11-01 15:22:27 -05:00
Akash Kulkarni
85d266ac20 Bump DBZ version from 2.2.0 -> 2.4.0 for mssql, mysql (#32024) 2023-11-01 13:55:13 -04:00
Marius Posta
7cd8020ac8 java CDK: hoist top-level gradle projects into CDK (#31960) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-10-30 12:03:06 -07:00
Augustin
ac6f44cf2c remove Dockerfile and .dockerignore for Java connectors (#31769) 2023-10-24 15:08:13 -05:00
Rodi Reich Zilberman
7e92375438 bump cdk version for postgres, mysql sources (#31322) 2023-10-12 10:38:54 -07:00
Rodi Reich Zilberman
3d9578fdac Cap each log field (message, stacktrace) to max 32K characters (#30806) 
Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-10-11 13:34:53 -07:00
Rodi Reich Zilberman
79080c88f5 Update tests to current Jackson lib behavior (#31197) 
Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-10-11 08:23:50 -07:00
Akash Kulkarni
4787b7124f Pin cdk back to 0.1.0 for postgres, mysql, mssql (#31085) 2023-10-04 18:11:05 -05:00
Jonathan Pearlin
60b0c9d023 Set the user timezone for tests (#31057) 
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-10-04 16:29:41 -05:00
Marius Posta
70af278945 source-mysql*: force-pin jooq version (#30939) 2023-09-29 17:23:03 -04:00
Aaron ("AJ") Steers
da32fc86bf 🚀 Launch Java CDK v0.1.0 (PR #30383) 
- Launch Java CDK `v0.1.0`. 🚀
- Remove `airbyte-docker` gradle plugin from java connectors.
- Add `airbyte-java-connector` gradle plugin.
- Remove `airbyte-commons` from global build.gradle.
- Add `/publish-java-cdk` slash command.
- Initial launch of `/airbyte-ci` slash command to test connectors.
 2023-09-27 15:46:02 -07:00
Akash Kulkarni
2097c0e4e4 Update MySQL streaming config (#30744) 2023-09-26 15:45:13 -07:00
Ben Church
5d8278900f Github Action: Add format.yml workflow (#30604) 
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: octavia-approvington <octavia-approvington@users.noreply.github.com>
 2023-09-21 18:11:41 -05:00
Duy Nguyen
11ad938152 [Source-MySQL] Enable Enhanced Standard sync with PK -> Cursor switch (#30556) 
Enable enhanced standard sync
 2023-09-21 13:38:05 -07:00
Prateek Mukhedkar
6beba9d4d9 Source MySQL: Release Airbyte Certified MySQL Source connector (#30620) 2023-09-20 14:03:56 -07:00
Prateek Mukhedkar
1c0fd1b40e Source MySQL: Tagging MySQL variants as GA in metadata. Prep for Airbyte Certified/Bronze release (#30558) 
Co-authored-by: Ben Church <ben@airbyte.io>
 2023-09-19 16:38:57 -07:00