jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-20 18:39:31 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

281 Commits

Author SHA1 Message Date
Xiaohan Song
b9dc2053cf Mysql to emit stream initial loader (#36932) 
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
 2024-05-03 12:30:53 -07:00
Rodi Reich Zilberman
bdb3556b8a bump connectors to latest CDK version (#37781) 2024-05-02 16:52:11 -04:00
Akash Kulkarni
914f044354 [Certified sources] : Bump cdk versions to disable DBZ retries (#37742) 2024-05-01 15:07:37 -04:00
Akash Kulkarni
2b260de9d0 [DB source error messages] : Better error messages when switching between global/per-stream modes (#37507) 2024-04-30 19:18:43 -04:00
Xiaohan Song
587e874eb5 Remove excessive logs in counter (#37541) 2024-04-24 13:31:46 -04:00
Akash Kulkarni
097709a187 [Source-mysql/mssql] : Remove legacy bad values handling code (#37476) 2024-04-22 20:10:54 -04:00
Akash Kulkarni
bae63044cc [Source-mysql/mssql] : Populate null values (#37111) 2024-04-16 14:25:27 -07:00
Akash Kulkarni
cb9eae3681 [Source-mysql] : Add meta error handling in initial load path (#37328) 2024-04-15 14:49:14 -07:00
Akash Kulkarni
5587167ddc [Source-mysql] : Remove mysql initial source operations (#37324) 2024-04-15 12:58:54 -04:00
Rodi Reich Zilberman
1e9ee1dbb8 Prevent conversion of null fields (#36919) 2024-04-11 20:30:38 -04:00
Rodi Reich Zilberman
27e851c5ca Add maxSecondsBetweenMessages to metadata yaml (#36872) 2024-04-05 19:57:44 -07:00
Xiaohan Song
9d53013112 not throwing config error (#36577) 2024-04-05 16:58:54 -04:00
Xiaohan Song
3c35466413 MySQL to adapt to new cdk (#36742) 2024-04-05 13:10:17 -04:00
Xiaohan Song
2637e97e23 [source-mysql] merge state manager (#35529) 2024-02-29 14:30:25 -04:00
Akash Kulkarni
ae39cbe82f Fix error message for saved offset not valid. (#35675) 2024-02-27 17:54:30 -04:00
Stephane Geneix
b2b9b7fa21 reduce interrupt and shutdown delays to 1 minutes and 2 minutes when stopping a connector (initially set at 60minutes and 70minutes) (#35527) 
Fixes #32348 
discussed here : https://airbytehq-team.slack.com/archives/C02U2SSHP9S/p1708552465201999
 2024-02-23 14:12:28 -08:00
Marius Posta
2b370f84c2 source-mysql: bump patch version following #35569 (#35573) 
Co-authored-by: Stephane Geneix <stephane@airbyte.io>
 2024-02-23 00:19:56 -04:00
Akash Kulkarni
1162302069 [Source-mysql] : Adopt 0.21.4 and reduce cdc state compression threshold to 1MB (#35525) 2024-02-21 19:24:56 -08:00
Akash Kulkarni
40a5edc5fe [Source-mysql] : Add config to throw an error on invalid CDC position (#35338) 2024-02-20 14:09:05 -08:00
Akash Kulkarni
5bab3df367 Add airbyte trace utility to emit analytics messages & emit messages for MongoDB, Postgres & MySQL (#35036) 2024-02-13 19:10:38 -04:00
Akash Kulkarni
62e5528e57 Don't emit final state if there is an underlying stream failure (#34869) 
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2024-02-13 12:31:54 -04:00
Xiaohan Song
82d9197587 🐛 source-mysql Support special chars in dbname (#34580) 2024-02-12 11:06:16 -08:00
Marius Posta
796c0ee494 source-mysql: adopt cleaned-up cdk (#34750) 2024-02-09 14:04:41 -06:00
Marius Posta
6f0fd7a2b9 refactor debezium harness in CDK, push connector-specific logic down to connectors (#34573) 2024-01-27 14:05:47 -06:00
Xiaohan Song
b290208391 Add count in state message for incremental syncs (#33005) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
 2024-01-09 21:05:57 -04:00
Xiaohan Song
18e0e7741a ✨ Introduce StateIteratorProcessor in CDK (#33312) 2024-01-03 15:29:12 -08:00
Subodh Kant Chaturvedi
5b915c6837 mysql-source: remove LEGACY state flag (#33436) 2023-12-19 23:45:51 +05:30
Akash Kulkarni
4c9908496b Add debugger drivers for MongoDB & MySQL (#33356) 
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
 2023-12-12 20:07:46 -04:00
Rodi Reich Zilberman
f5ae28fc0c 🐛 Rodi/port zero date time behavior fix (#33210) 
Co-authored-by: Robert Tomczak <36033856+robertomczak@users.noreply.github.com>
Co-authored-by: robertomczak <robertomczak@users.noreply.github.com>
 2023-12-11 11:09:14 -08:00
Akash Kulkarni
ea8cf787cf [Source MySQL] : Improvements to schema snapshotting and error handling (#33082) 
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
 2023-12-07 11:24:38 -08:00
Xiaohan Song
2d26337bda Use parse base64Binary to parse binary related data (#32610) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-11-30 15:05:45 -04:00
Duy Nguyen
665e4f73ad source-mysql: merge strict encrypt variant into standard main mysql source (#31062) 
Co-authored-by: erohmensing <erohmensing@gmail.com>
Co-authored-by: nguyenaiden <nguyenaiden@users.noreply.github.com>
Co-authored-by: erohmensing <erohmensing@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
Co-authored-by: Marius Posta <marius@airbyte.io>
 2023-11-29 10:45:28 -04:00
Xiaohan Song
d7c8f35c28 [Mysql] Apply initial setup time to Debezium setup time (#32662) 2023-11-28 13:54:35 -08:00
Marius Posta
d97a399a24 source-mysql, source-mssql: parallelize test execution (#32772) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-11-27 12:49:06 -06:00
Tim Roes
c5db1e947b 📚 Documentation November 2023 overhaul (#32811) 
Co-authored-by: Natalie Kwong <38087517+nataliekwong@users.noreply.github.com>
Co-authored-by: timroes <timroes@users.noreply.github.com>
Co-authored-by: nataliekwong <nataliekwong@users.noreply.github.com>
 2023-11-26 11:57:38 -08:00
Stephane Geneix
49043b570f 🐛 📝 re-update all connectors for new CDK version and more stringent javac checks (#32125) 2023-11-08 18:21:14 -04:00
Alexandre Cuoci
ecb56bbbc2 mysql doc rewrite (#32189) 
Co-authored-by: Lake Mossman <lake@airbyte.io>
 2023-11-07 01:48:51 +00:00
Stephane Geneix
a2f8eec7f8 update CDK to 0.4.1 (#32193) 2023-11-04 09:53:08 -04:00
Rodi Reich Zilberman
1e8e6402bc Revert "Automated Commit - Formatting Changes" (#32077) 2023-11-01 15:38:25 -05:00
Rodi Reich Zilberman
f5c87968ca ✨URL encode username and password fields (#32028) 
Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-11-01 15:22:27 -05:00
Akash Kulkarni
85d266ac20 Bump DBZ version from 2.2.0 -> 2.4.0 for mssql, mysql (#32024) 2023-11-01 13:55:13 -04:00
Marius Posta
7cd8020ac8 java CDK: hoist top-level gradle projects into CDK (#31960) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-10-30 12:03:06 -07:00
Rodi Reich Zilberman
7e92375438 bump cdk version for postgres, mysql sources (#31322) 2023-10-12 10:38:54 -07:00
Rodi Reich Zilberman
3d9578fdac Cap each log field (message, stacktrace) to max 32K characters (#30806) 
Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-10-11 13:34:53 -07:00
Akash Kulkarni
2097c0e4e4 Update MySQL streaming config (#30744) 2023-09-26 15:45:13 -07:00
Duy Nguyen
11ad938152 [Source-MySQL] Enable Enhanced Standard sync with PK -> Cursor switch (#30556) 
Enable enhanced standard sync
 2023-09-21 13:38:05 -07:00
Prateek Mukhedkar
6beba9d4d9 Source MySQL: Release Airbyte Certified MySQL Source connector (#30620) 2023-09-20 14:03:56 -07:00
Duy Nguyen
fca0b6f62e [Source-MySQL] Correctly set Debezium MySQL connector database timezone property (#30333) 
Co-authored-by: subodh <subodh1810@gmail.com>
 2023-09-14 16:10:14 -05:00
Rodi Reich Zilberman
0936143f1e 🐛 Only take table size info for streams syncing via primary key (#30375) 
Co-authored-by: subodh <subodh1810@gmail.com>
 2023-09-13 14:35:10 -05:00
Subodh Kant Chaturvedi
6f0c4e2594 mysql-source-cdc: enable compression logic for schema history (#30308) 
Co-authored-by: subodh1810 <subodh1810@users.noreply.github.com>
Co-authored-by: Prateek Mukhedkar <prateek@airbyte.io>
 2023-09-13 13:14:01 -05:00