1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

139 Commits

Author SHA1 Message Date
Akash Kulkarni
9b9ec1cecd [source-postgres] : Remove legacy bad values handling code (#37445) 2024-04-22 13:47:57 -04:00
Akash Kulkarni
0296c43169 [Db analytics] : add message for data type serialization error (#36981) 2024-04-10 15:46:15 -07:00
Akash Kulkarni
1815e38dd8 [Source-Postgres] : Bump cdk, reduce timeout (#36865) 2024-04-10 15:36:17 -04:00
Marius Posta
2495575795 java-cdk: re-export airbyte-api dependency (#36759) 2024-04-03 10:43:05 -07:00
Akash Kulkarni
2825239050 [Source-Postgres] : Toggle useLocalCdk = false (#36739) 2024-04-01 19:35:38 -04:00
Akash Kulkarni
e3f3379120 [Source-postgres] : Move to new Kotlin CDK (#36584) 2024-04-01 16:51:04 -04:00
Akash Kulkarni
9dee83729e [Source-postgres] : Source operations suport for meta column (#36432) 2024-03-26 10:27:20 -07:00
Xiaohan Song
1b99f1ab89 DBZ iterator migration to use SourceStateIterator (#36333) 2024-03-25 21:50:33 -07:00
Xiaohan Song
3eb18c9737 Move cursor state decorating iterator to sourceStateIterator (#35599) 2024-03-21 13:47:02 -07:00
Rodi Reich Zilberman
838a50d844 Revert "sanity"
This reverts commit 817dbe4d15.
2024-03-19 09:00:57 -07:00
Rodi Reich Zilberman
817dbe4d15 sanity 2024-03-19 08:59:57 -07:00
Akash Kulkarni
ee6b1a0ee6 [source-postgres] : Add retries back to the DBZ connector (#35904) 2024-03-11 15:31:43 -07:00
Xiaohan Song
1bb7a1c0bb [source-postgres] State counter on postgres (#34724)
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
Co-authored-by: Joe Bell <joseph.bell@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: SatishChGit <satishchinthanippu@gmail.com>
Co-authored-by: evantahler <evan@airbyte.io>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Anton Karpets <anton.karpets@globallogic.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <akash@airbyte.io>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Artem Inzhyyants <36314070+artem1205@users.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Patrick Nilan <nilan.patrick@gmail.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: Chandler Prall <chandler.prall@gmail.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Cole Snodgrass <cole@airbyte.io>
Co-authored-by: Anatolii Yatsuk <tolikyatsuk@gmail.com>
Co-authored-by: bgroff <bgroff@users.noreply.github.com>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: Ryan Waskewich <156025126+rwask@users.noreply.github.com>
Co-authored-by: maxi297 <maxi297@users.noreply.github.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Håkon Åmdal <hakon@aamdal.com>
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: nguyenaiden <duy@airbyte.io>
Co-authored-by: Natalie Kwong <38087517+nataliekwong@users.noreply.github.com>
Co-authored-by: terencecho <3916587+terencecho@users.noreply.github.com>
Co-authored-by: Alex Birdsall <ambirdsall@gmail.com>
2024-03-07 13:45:26 -04:00
Akash Kulkarni
4fcff41901 [Source-postgres]: Add logging in case of multiple records with same LSN (#35842) 2024-03-06 21:09:44 -04:00
Akash Kulkarni
5bab3df367 Add airbyte trace utility to emit analytics messages & emit messages for MongoDB, Postgres & MySQL (#35036) 2024-02-13 19:10:38 -04:00
Marius Posta
edcd5ed8a4 source-postgres: adopt CDK 0.20.4 (#35224) 2024-02-13 11:56:23 -08:00
Marius Posta
7ff484868f source-postgres: adopt cleaned-up cdk (#34751) 2024-02-09 11:41:39 -08:00
Stephane Geneix
05613a6532 remove useLocalCdk for source-postgres (#34981) 2024-02-07 14:17:14 -08:00
Stephane Geneix
e7dc82c0c7 make exclusive containers first class citizens (#34892)
Co-authored-by: Marius Posta <marius@airbyte.io>
2024-02-07 14:00:41 -08:00
Subodh Kant Chaturvedi
6e4ed761d0 db-sources-java-cdk: fix logic to calculate the state stats count in db sources iterator (#34948) 2024-02-08 02:01:16 +05:30
Akash Kulkarni
38d48d2daf Bump source-mysql and source-postgres to cdk version 0.16.3 (#34723) 2024-02-01 13:45:16 -04:00
Marius Posta
6f0fd7a2b9 refactor debezium harness in CDK, push connector-specific logic down to connectors (#34573) 2024-01-27 14:05:47 -06:00
Marius Posta
d01bb65dcb java CDK: build no longer downloads files from connector registry (#34441) 2024-01-25 11:44:48 -08:00
Marius Posta
ff81b95ecc java cdk: remove wal2json support (#34119) 2024-01-10 12:14:40 -08:00
Subodh Kant Chaturvedi
b3cb243660 postgres-source: remove LEGACY state flag (#33437) 2023-12-19 23:47:49 +05:30
Akash Kulkarni
f827af10be [Part 1 ] : Hackday project to debug connections (#33027)
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
2023-12-11 17:21:50 -08:00
Akash Kulkarni
e11d765cb8 Better attribution of DBZ closing reason (#32686) 2023-11-28 21:04:00 -04:00
Marius Posta
23f3b6c570 source-postgres: fix useLocalCdk = true (#32891) 2023-11-28 12:38:21 -08:00
Marius Posta
d97a399a24 source-mysql, source-mssql: parallelize test execution (#32772)
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-11-27 12:49:06 -06:00
Marius Posta
f604110df4 java CDK: skip dropping database in PostgresTestDatabase::close (#32377)
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-11-09 13:41:24 -06:00
Stephane Geneix
3f42418c15 🐛 📝 don't missparse +/-infinity in postgres-source (#31856) 2023-11-09 18:33:44 +00:00
Marius Posta
5013f954f2 java CDK, source-postgres: parallelize tests (#32314) 2023-11-08 16:29:59 -06:00
Stephane Geneix
49043b570f 🐛 📝 re-update all connectors for new CDK version and more stringent javac checks (#32125) 2023-11-08 18:21:14 -04:00
Stephane Geneix
a2f8eec7f8 update CDK to 0.4.1 (#32193) 2023-11-04 09:53:08 -04:00
Marius Posta
61c24c97ed source-postgres: use CDK 0.4.0 (#32173) 2023-11-03 14:29:26 -07:00
Stephane Geneix
9c6ed93a9d Revert "update all connectors for new CDK version and more stringent javac checks"
This reverts commit 18ad87bbd1.
2023-11-02 15:42:28 -07:00
Stephane Geneix
18ad87bbd1 update all connectors for new CDK version and more stringent javac checks 2023-11-02 15:24:58 -07:00
Akash Kulkarni
b08b09d7ea source-postgres : Bump deebezium version 2.2.0 -> 2.4.0 (#32068)
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
Co-authored-by: Marius Posta <marius@airbyte.io>
2023-11-01 13:15:43 -07:00
Marius Posta
bc78d2138c java CDK, source-postgres: speed up tests involving debezium (#31976)
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2023-10-31 09:04:41 -07:00
Marius Posta
7cd8020ac8 java CDK: hoist top-level gradle projects into CDK (#31960)
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-10-30 12:03:06 -07:00
Marius Posta
96954c7cad Revert "java CDK, source-postgres: speed up tests involving debezium … (#31975) 2023-10-30 12:00:24 -07:00
Marius Posta
9307d8bf98 java CDK, source-postgres: speed up tests involving debezium (#31924) 2023-10-30 11:58:28 -07:00
Stephane Geneix
412da024ac 🐛 📝 actually fix postgres standby error message by using the latest CDK (#31804)
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
2023-10-25 15:01:12 -07:00
Akash Kulkarni
52520d01ce Migrate source-postgres-strict-encrypt logic into source-postgres and make it the default cloud image (#31486)
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
2023-10-18 12:39:08 -07:00
Duy Nguyen
896fa4bafd [Source-Postgres] Update PostgresConverter to correctly stringify BigDecimals without scientific notation (#31309) 2023-10-13 10:11:35 -07:00
Rodi Reich Zilberman
7e92375438 bump cdk version for postgres, mysql sources (#31322) 2023-10-12 10:38:54 -07:00
Akash Kulkarni
a373733cb0 Fix typo in Java CDK (#31196) 2023-10-10 10:34:33 -05:00
Akash Kulkarni
4787b7124f Pin cdk back to 0.1.0 for postgres, mysql, mssql (#31085) 2023-10-04 18:11:05 -05:00
Jonathan Pearlin
60b0c9d023 Set the user timezone for tests (#31057)
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: postamar <postamar@users.noreply.github.com>
2023-10-04 16:29:41 -05:00
Aaron ("AJ") Steers
da32fc86bf 🚀 Launch Java CDK v0.1.0 (PR #30383)
- Launch Java CDK `v0.1.0`. 🚀
- Remove `airbyte-docker` gradle plugin from java connectors.
- Add `airbyte-java-connector` gradle plugin.
- Remove `airbyte-commons` from global build.gradle.
- Add `/publish-java-cdk` slash command.
- Initial launch of `/airbyte-ci` slash command to test connectors.
2023-09-27 15:46:02 -07:00