1
0
mirror of synced 2025-12-25 02:09:19 -05:00
Commit Graph

2381 Commits

Author SHA1 Message Date
Rodi Reich Zilberman
b9e9116edf sanity 2025-12-17 23:00:57 -08:00
Rodi Reich Zilberman
f3299c9abc sanity 2025-12-17 22:57:18 -08:00
Rodi Reich Zilberman
2430ddecf2 discover streams fix for views in xmin 2025-12-16 22:27:11 -08:00
Rodi Reich Zilberman
6990cdec06 sanity 2025-12-16 12:08:55 -08:00
Rodi Reich Zilberman
4a3449c109 Merge branch 'source-postgres/bulk-cdk' into rodi/postgres-xmin 2025-12-12 21:00:25 -08:00
Rodi Reich Zilberman
266607674b sanity 2025-12-12 20:36:59 -08:00
Rodi Reich Zilberman
e145cf12b7 Merge branch 'master' into source-postgres/bulk-cdk 2025-12-12 15:00:18 -08:00
Rodi Reich Zilberman
353e8bea95 Rodi/bulk postgres fix snapshot (#69716) 2025-12-12 14:52:41 -08:00
Edward Gao
dc92c5a254 Bulk Load CDK: add int/number coercion tests (#70230) 2025-12-11 19:24:21 +00:00
Ryan Br...
6a48afc369 Add CDC_CURSOR_COLUMN to load cdk for reference. (#70852) 2025-12-10 15:34:29 -08:00
Matt Bayley
d4eb6b6c85 switch Comparable to PartiallyOrdered (#70826) 2025-12-10 13:42:30 -08:00
Ryan Br...
9e8263dab3 Map the namespace before creating the final table names. (#70827) 2025-12-09 19:39:50 -08:00
Matt Bayley
7c887d7ff8 fix position comparison bug and comment (#70820) 2025-12-09 14:06:23 -08:00
Ryan Br...
8f9119be2d Rbroughan/cdk component test fixes plus escape hatch (#70714) 2025-12-09 10:48:12 -08:00
Wenqi Hu
c0eb6dcb4b Fix CDC race condition when Debezium engine thread closes before record emitted (#70360) 2025-12-05 09:43:15 -08:00
Rodi Reich Zilberman
9f8de389c0 testing 2025-12-04 22:29:20 -08:00
Matt Bayley
197d7cfcee source-postgres: fix unsupported pseudo column discovery (#70339) 2025-12-04 11:20:52 -08:00
Ryan Br...
8e437b321d Rbroughan/dest stream table schema final (#70279) 2025-12-03 13:29:15 -08:00
Jimmy Ma
a515e9ae81 chore: add dependency injection tests (#69845)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-12-02 09:42:07 -08:00
Edward Gao
652c2eda86 Bulk load CDK: more schema evolution test cases (#69343) 2025-12-01 21:00:05 +00:00
Aaron ("AJ") Steers
5938dee934 docs(bulk-cdk): Add API documentation links to README and CONTRIBUTING (#69811)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2025-11-21 11:22:42 -08:00
Aaron ("AJ") Steers
130339b57f feat(bulk-cdk): Add Dokka documentation generation with Vercel deployment (#69752)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2025-11-21 09:30:17 -08:00
Edward Gao
aacf63d66a Bulk load cdk: improve component tests' upsert test coverage (#69338) 2025-11-20 00:43:33 +00:00
Wenqi Hu
88758565c0 Fix default partition_id value for CheckpointOnlyPartitionReader (#69753) 2025-11-19 20:51:21 +00:00
Rodi Reich Zilberman
cb7cc145d5 Merge branch 'master' into source-postgres/bulk-cdk 2025-11-18 08:46:05 -08:00
Edward Gao
e10b9022ad Bulk CDK: check that we aren't republishing _any_ version (#69330) 2025-11-14 08:13:29 -08:00
Wenqi Hu
e62b337005 Support multiple ts precision decoding (#69326) 2025-11-13 16:59:54 -08:00
Edward Gao
f943c0f299 Bulk load CKD: schema evolution test suite (#69234) 2025-11-13 23:17:28 +00:00
Wenqi Hu
dadad3a8ee Fix duplicate metadata key in JdbcMetadataQuerier (#69309) 2025-11-12 16:54:23 -08:00
Francis Genet
409566389d Remove a random println from our code (#69288) 2025-11-11 15:42:44 -08:00
Rodi Reich Zilberman
ce42e776be 9834 java l3 mysql cdc null values in flexible milestone cpms and flexible milestone positions streams (#69254) 2025-11-11 15:18:00 -08:00
Edward Gao
be3a818445 Bulk load CDK: break down ensureSchemaMatches (#69090) 2025-11-11 19:02:57 +00:00
Francis Genet
79a014e1c2 [GCS-DL] More CDK changes on the IcebergTableSynchronizer (#69267) 2025-11-11 18:58:09 +00:00
sophiecuiy
0d9d75d52a case sensitivity fix (#69225)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-11-10 16:32:43 -08:00
Subodh Kant Chaturvedi
c6c51ebf0f chore(dataflow-cdk): remove logs from state store cause it confuses users (#69214) 2025-11-10 08:07:08 +05:30
Francis Genet
313a09e375 [GCS-DL] Make getOperation in iceberg public (#69243) 2025-11-07 14:28:45 -08:00
Francis Genet
9aaf7265b7 Update the IcebergTableSynchronizer.kt to allow us to force commit between schema updates (#69213) 2025-11-06 14:38:31 -08:00
Matt Bayley
2a0159cc3d source-postgres: revise field type mapping (#69227) 2025-11-06 12:58:40 -08:00
Jonathan Pearlin
8f93b643c1 chore: refactor additional stat tracking (#69222) 2025-11-06 14:23:38 -05:00
Jonathan Pearlin
f244a50b56 fix: add additional stats to expected destination state message (#69201) 2025-11-05 11:42:17 -05:00
Jonathan Pearlin
dc83e41e77 refactor: separate validation result handling from coercer (#69113) 2025-11-05 09:18:59 -05:00
Wenqi Hu
6b0db42e24 Query table metadata per schema (#69184) 2025-11-04 14:13:38 -08:00
sophiecuiy
c761e11888 Adding table filtering to JDBC (#69094)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-11-04 09:54:43 -08:00
Matt Bayley
4774b7611a Introduce extract-trigger toolkit (#68189) 2025-11-03 16:56:22 -08:00
Edward Gao
93c8bd934f Bulk load CDK: parse non-property-ful schema into UnknownType (#69109) 2025-11-03 08:10:21 -08:00
Subodh Kant Chaturvedi
2c1179dcae fix(dataflow-cdk) : fix bug related to index of state messages (#69099) 2025-10-30 23:52:29 +05:30
Edward Gao
781f01f951 Bulk load CDK: move test-only TableOpClient methods to new interface (#68200) 2025-10-29 10:21:53 -07:00
Edward Gao
136831a8a9 publish bulk cdk for 2bd50bf216 (#68693) 2025-10-28 16:37:15 -07:00
Edward Gao
2bd50bf216 Edgao/component upsert tests/cdk (#68185) 2025-10-28 16:24:47 -07:00
Rodi Reich Zilberman
da65b6483f Merge branch 'master' into source-postgres/bulk-cdk 2025-10-28 13:51:26 -07:00