jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-22 03:21:25 -05:00
Code Issues Packages Projects Releases Wiki Activity
22,318 Commits 5,109 Branches 518 Tags
baf4633ab8b51a55276115ea083837d8632fe217
Commit Graph

357 Commits

Author SHA1 Message Date
Xiaohan Song
b104667a0c Stream status on postgres (#38716) 
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
 2024-05-29 13:05:20 -07:00
Evan Tahler
a914027d74 [docs] Vendor-Specific limitations added to troubleshooting sections (#38351) 
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
 2024-05-21 14:42:22 +00:00
Xiaohan Song
0db33b8494 Revert "source-postgres: connect with adaptiveFetch=true" (#38365) 2024-05-20 19:23:09 -04:00
Marius Posta
c97bbfc4ed source-postgres: connect with adaptiveFetch=true (#38289) 
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2024-05-20 10:49:19 -07:00
Evan Tahler
3a971c3791 Mention transaction id wrap around in xmin warning (#38235) 2024-05-17 12:44:46 -05:00
Evan Tahler
49fc60dea2 source-postgres - Streams not in the CDC publication still have a cursor and PK (#38303) 2024-05-16 16:18:26 -07:00
Subodh Kant Chaturvedi
073b94062c db-sources: disable counts for state messages for FULL_REFRESH streams (#38208) 
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2024-05-15 11:15:26 -07:00
Akash Kulkarni
fcbfaa376f [DB source errors] : Handle common transient errors (#38104) 2024-05-13 20:27:07 -04:00
Xiaohan Song
59cdc36db6 [source-postgres] Fix final state message on state (#38171) 2024-05-13 19:17:03 -04:00
Xiaohan Song
4b92f751cd [source-postgres] bugfix: Exclude views in incremental iterator (#38130) 2024-05-10 18:55:03 -04:00
Xiaohan Song
80920d1394 Postgres on Resumable full refresh (#37112) 2024-05-10 12:13:37 -04:00
Tyler B
9d95dc0cfe Update postgres.md (#38096) 2024-05-09 12:48:05 -07:00
Akash Kulkarni
d26bd10c87 [DB sources] : Add plumbing for adding transient errors (#38030) 2024-05-09 10:21:58 -07:00
Alex
c4a2a26bd7 Postgres Docs: Fix Changelog Formatting (#38047) 2024-05-07 15:24:23 -05:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Rodi Reich Zilberman
f7f7f7ef2e Set debezium num retries property to zero (#37758) 2024-05-02 03:04:03 -04:00
Rodi Reich Zilberman
deabdbb16a Add debezium engine logs (#37754) 2024-05-01 20:25:57 -04:00
Akash Kulkarni
201e7e3630 [Source-postgres] : Remove debezium retries (#37726) 2024-05-01 08:26:29 -07:00
Xiaohan Song
587e874eb5 Remove excessive logs in counter (#37541) 2024-04-24 13:31:46 -04:00
Akash Kulkarni
d790b7d5df [Source-postgres] : Better error messages on switching between sync m… (#37509) 2024-04-24 12:39:07 -04:00
Akash Kulkarni
9b9ec1cecd [source-postgres] : Remove legacy bad values handling code (#37445) 2024-04-22 13:47:57 -04:00
Akash Kulkarni
fda082966f [Source-postgres] : Populate airyte_meta.changes for xmin path (#36982) 2024-04-10 16:25:23 -07:00
Akash Kulkarni
0296c43169 [Db analytics] : add message for data type serialization error (#36981) 2024-04-10 15:46:15 -07:00
Akash Kulkarni
1815e38dd8 [Source-Postgres] : Bump cdk, reduce timeout (#36865) 2024-04-10 15:36:17 -04:00
Marius Posta
2495575795 java-cdk: re-export airbyte-api dependency (#36759) 2024-04-03 10:43:05 -07:00
Akash Kulkarni
2825239050 [Source-Postgres] : Toggle useLocalCdk = false (#36739) 2024-04-01 19:35:38 -04:00
Akash Kulkarni
e3f3379120 [Source-postgres] : Move to new Kotlin CDK (#36584) 2024-04-01 16:51:04 -04:00
Akash Kulkarni
9dee83729e [Source-postgres] : Source operations suport for meta column (#36432) 2024-03-26 10:27:20 -07:00
Xiaohan Song
1b99f1ab89 DBZ iterator migration to use SourceStateIterator (#36333) 2024-03-25 21:50:33 -07:00
Xiaohan Song
3eb18c9737 Move cursor state decorating iterator to sourceStateIterator (#35599) 2024-03-21 13:47:02 -07:00
Akash Kulkarni
609d602cec [Source-postgres] : Compare each record’s lsn_commit value instead of lsn_proc. (#35939) 2024-03-13 12:49:09 -07:00
Akash Kulkarni
ee6b1a0ee6 [source-postgres] : Add retries back to the DBZ connector (#35904) 2024-03-11 15:31:43 -07:00
Xiaohan Song
1bb7a1c0bb [source-postgres] State counter on postgres (#34724) 
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
Co-authored-by: Joe Bell <joseph.bell@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: SatishChGit <satishchinthanippu@gmail.com>
Co-authored-by: evantahler <evan@airbyte.io>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Anton Karpets <anton.karpets@globallogic.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <akash@airbyte.io>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Artem Inzhyyants <36314070+artem1205@users.noreply.github.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Patrick Nilan <nilan.patrick@gmail.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: Chandler Prall <chandler.prall@gmail.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Cole Snodgrass <cole@airbyte.io>
Co-authored-by: Anatolii Yatsuk <tolikyatsuk@gmail.com>
Co-authored-by: bgroff <bgroff@users.noreply.github.com>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: Ryan Waskewich <156025126+rwask@users.noreply.github.com>
Co-authored-by: maxi297 <maxi297@users.noreply.github.com>
Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Håkon Åmdal <hakon@aamdal.com>
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Subodh Kant Chaturvedi <subodh1810@gmail.com>
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: nguyenaiden <duy@airbyte.io>
Co-authored-by: Natalie Kwong <38087517+nataliekwong@users.noreply.github.com>
Co-authored-by: terencecho <3916587+terencecho@users.noreply.github.com>
Co-authored-by: Alex Birdsall <ambirdsall@gmail.com>
 2024-03-07 13:45:26 -04:00
Akash Kulkarni
4fcff41901 [Source-postgres]: Add logging in case of multiple records with same LSN (#35842) 2024-03-06 21:09:44 -04:00
Akash Kulkarni
ae39cbe82f Fix error message for saved offset not valid. (#35675) 2024-02-27 17:54:30 -04:00
Marius Posta
407cba86a5 source-postgres: bump patch version following #35569 (#35572) 
Co-authored-by: Stephane Geneix <stephane@airbyte.io>
 2024-02-23 00:23:14 -04:00
Akash Kulkarni
0bf645cffd [Source-Postgres] : Add config to throw an error on invalid CDC position (#35304) 2024-02-20 10:27:55 -08:00
Akash Kulkarni
5bab3df367 Add airbyte trace utility to emit analytics messages & emit messages for MongoDB, Postgres & MySQL (#35036) 2024-02-13 19:10:38 -04:00
Marius Posta
edcd5ed8a4 source-postgres: adopt CDK 0.20.4 (#35224) 2024-02-13 11:56:23 -08:00
Marius Posta
7ff484868f source-postgres: adopt cleaned-up cdk (#34751) 2024-02-09 11:41:39 -08:00
Akash Kulkarni
e6fff38310 [source-postgres] : Provide option to advance LSN (#34781) 2024-02-08 12:13:12 -08:00
Stephane Geneix
e7dc82c0c7 make exclusive containers first class citizens (#34892) 
Co-authored-by: Marius Posta <marius@airbyte.io>
 2024-02-07 14:00:41 -08:00
Subodh Kant Chaturvedi
6e4ed761d0 db-sources-java-cdk: fix logic to calculate the state stats count in db sources iterator (#34948) 2024-02-08 02:01:16 +05:30
Akash Kulkarni
38d48d2daf Bump source-mysql and source-postgres to cdk version 0.16.3 (#34723) 2024-02-01 13:45:16 -04:00
Marius Posta
6f0fd7a2b9 refactor debezium harness in CDK, push connector-specific logic down to connectors (#34573) 2024-01-27 14:05:47 -06:00
Xiaohan Song
99622315a6 🐛Source Postgres: xmin query should only happen if user chose that mode (#34465) 2024-01-24 14:16:25 -08:00
Marcos Marx
6d73558210 Docs: update Postgres source add info about what is going to be replicated (#34362) 2024-01-18 20:19:58 -03:00
Marius Posta
ff81b95ecc java cdk: remove wal2json support (#34119) 2024-01-10 12:14:40 -08:00
Subodh Kant Chaturvedi
b3cb243660 postgres-source: remove LEGACY state flag (#33437) 2023-12-19 23:47:49 +05:30
Akash Kulkarni
b05e985a00 [Source-postgres] : Advance Postgres LSN for PG 14 & below (#33605) 2023-12-19 08:18:50 -08:00