Rodi Reich Zilberman
5610f7211f
Remove CDC metafield decoration from streams that cannot be incremental - no pk ( #68651 )
2025-10-28 09:27:42 -07:00
Subodh Kant Chaturvedi
1b48ee9adf
feat: improve temporal representation in proto + shared encoder/decoder for source and dest ( #67016 )
...
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com >
2025-10-21 22:31:47 +05:30
Rodi Reich Zilberman
a421083ca4
CDK changes only ( #67152 )
2025-10-07 10:51:43 -07:00
Rodi Reich Zilberman
856acc93cd
Extract CDK proto encoding ( #66152 )
...
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2025-09-10 16:44:03 -07:00
Rodi Reich Zilberman
8ed6f3e14e
CDC state fixes ( #63377 )
2025-07-30 18:01:08 -07:00
Rodi Reich Zilberman
8724d83401
Migrate concurrency setting ( #63349 )
...
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2025-07-22 15:06:37 -07:00
Rodi Reich Zilberman
4dc9bbce6e
Rodi/cdc state socket mode ( #62932 )
2025-07-17 11:28:15 -07:00
Rodi Reich Zilberman
045491d8fe
Rodi/refactor output consumer ( #62862 )
2025-07-10 12:59:25 -07:00
Rodi Reich Zilberman
cbf42c3333
Socket mode in bulk extract CDK ( #60993 )
2025-07-07 12:54:08 -07:00
Jimmy Ma
63aab18316
feat: enable destination discover ( #61395 )
...
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2025-06-06 15:21:49 -07:00
Rodi Reich Zilberman
cfc1243bd2
concurrent mysql read ( #60218 )
2025-05-29 13:38:46 -07:00
Edward Gao
1547001387
bulk CDK: stop validating configs ( #59709 )
2025-05-08 08:16:18 -07:00
Wenqi Hu
5f684ec129
[source volcano] Make sure metadata decoration is enabled for trigger based CDC ( #55200 )
2025-03-06 09:43:00 -08:00
Wenqi Hu
f0a96b3c1c
[source volcano] Decorate stream with cursor field for trigger based CDC stream ( #53152 )
2025-02-12 22:31:22 +02:00
Wenqi Hu
968566d28a
[source volcano] Allow field to be used as CDC cursor ( #52677 )
2025-02-02 20:11:13 -08:00
Marius Posta
14c6c9db8c
bulk-cdk-extract*: remove StateQuerier ( #52051 )
2025-01-30 19:02:38 +00:00
Ryan Br...
a333001441
fix: sets emittedAt for trace messages to reflect actual emission time ( #51613 )
...
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2025-01-17 15:54:59 -08:00
Rodi Reich Zilberman
b3f56fb349
Set cdc metadata fields types to match legacy connectors ( #51029 )
2025-01-13 22:24:18 +02:00
Xiaohan Song
afb589435c
[bulk-cdk] state manager only reports stream with count in it ( #48587 )
...
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2024-12-23 15:25:04 -05:00
Marius Posta
2783be115c
bulk-cdk-core-extract: remove GlobalLockResource ( #49132 )
2024-12-20 11:43:31 -05:00
Marius Posta
426cabccd9
bulk-cdk: fix loss of numerical precision when deserializing JSON ( #49920 )
2024-12-18 15:43:20 -05:00
Marius Posta
b9ea48e137
source-mysql: better datatype integration tests ( #49844 )
2024-12-18 02:29:28 +02:00
Rodi Reich Zilberman
61c57771c9
CDC partition reader should be allowed to complete its work with no t… ( #48889 )
2024-12-11 13:33:44 -08:00
Rodi Reich Zilberman
5f9d290800
Handle empty table states ( #48629 )
2024-12-03 01:10:23 +02:00
Marius Posta
8aec55d738
bulk-cdk: CDC-related fixes and tweaks ( #48602 )
2024-11-22 20:58:51 +00:00
Rodi Reich Zilberman
e193fb30ce
Re-sync in case of stale offset ( #48578 )
2024-11-21 09:27:27 -08:00
Marius Posta
4ae0ce69e3
bulk-cdk-core-extract: fix mistaken assumption about non-global streams ( #48466 )
2024-11-12 14:09:30 -08:00
Rodi Reich Zilberman
b03023d78e
Don't emit state message with null stream status ( #48441 )
2024-11-11 06:46:09 -08:00
Marius Posta
ae241be9c5
bulk-cdk: correct handling of MetaFields ( #46975 )
2024-10-28 14:28:41 -05:00
Rodi Reich Zilberman
0d3bb8148e
Fix the default flow of cdc cursor ( #46961 )
2024-10-17 11:52:42 -07:00
Rodi Reich Zilberman
5e5a349473
Dont run snapshot feeds in case cdc stopped for stale offset ( #46876 )
2024-10-15 00:33:57 +00:00
Rodi Reich Zilberman
c49109208e
9894 cdc toolkit add time limit for snapshot partitions running in cdc scenario wass ( #46699 )
2024-10-10 14:48:27 -07:00
Edward Gao
39b32b33a6
Bulk CDK: Rename stuff to prevent conflicts ( #46650 )
2024-10-09 00:12:35 +03:00
Marius Posta
4b8f113a6e
bulk-cdk-core-extract: fix TRACE STATUS message emission ( #46314 )
2024-10-04 11:54:07 -07:00
Marius Posta
a81daada5d
bulk-cdk-toolkits-extract-cdc,source-mysql-v2: flesh out CDC ( #45887 )
2024-10-02 16:56:52 +03:00
Johnny Schmidt
56d1650e66
Bulk CDK Core: Rename ConfigJsonObj to ConnectorSpecification ( #45905 )
2024-09-30 21:43:38 +03:00
Marius Posta
65622a9b0a
bulk-cdk-core-extract: fix another global state checkpoint bug in StateManager ( #45927 )
2024-09-26 16:14:36 -07:00
Xiaohan Song
308515f274
[source-mysql-v2] Add CDC columns in discover ( #45865 )
2024-09-26 18:56:33 +00:00
Marius Posta
5bb93d5e39
bulk-cdk-core-extract: fix StateManager checkpoint bug ( #45899 )
2024-09-25 13:44:43 -07:00
Marius Posta
c183eaa19c
bulk-cdk-core-extract: improve RootReaderIntegrationTest failure msgs ( #45902 )
2024-09-25 09:11:27 -07:00
Akash Kulkarni
8bc8f30c4d
[CDC toolkit] : Bootstrapping mysql cdc functionality ( #44837 )
...
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com >
Co-authored-by: Marius Posta <marius@airbyte.io >
2024-09-21 03:54:16 +03:00
Marius Posta
5daf229ee1
bulk-cdk: StreamIdentifier ( #45680 )
2024-09-19 20:35:10 +03:00
Marius Posta
400abf6f3d
bulk-cdk: decouple from protocol model somewhat ( #45627 )
2024-09-19 08:30:50 -07:00
Johnny Schmidt
e9bf4e7724
Bulk Load CDK: Destination check outputs status ( #45637 )
2024-09-19 08:26:02 -07:00
Stephane Geneix
16b8d35cea
java-cdks: update all libraries ( #45432 )
...
This PR upgrades various library dependencies across multiple modules in the Airbyte CDK. It includes updates to Jackson, Guava, Apache Commons, Log4j, Kotlin coroutines, TestContainers, and other libraries.
2024-09-18 13:50:05 -07:00
Marius Posta
e4fec50536
bulk-cdk: improve AirbyteConnectorRunner and CliRunner ( #45374 )
2024-09-11 05:41:38 -07:00
Marius Posta
130bff81fe
bulk-cdk-core-base: optimized record serialization ( #44880 )
2024-08-29 20:11:11 +00:00
Marius Posta
abd9da9ba3
bulk-cdk: source output performance improvements ( #44865 )
2024-08-28 13:12:59 -07:00
Marius Posta
70732cac5c
bulk-cdk: add more exception classifier implementations, add extra checks ( #44824 )
2024-08-27 18:13:20 +00:00
Marius Posta
e297fc0ecf
bulk-cdk: add ExceptionClassifier, revamp exception handling ( #44608 )
2024-08-23 14:17:43 -07:00
