jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 19:11:14 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

73 Commits

Author SHA1 Message Date
Wenqi Hu
e62b337005 Support multiple ts precision decoding (#69326) 2025-11-13 16:59:54 -08:00
Jonathan Pearlin
dc83e41e77 refactor: separate validation result handling from coercer (#69113) 2025-11-05 09:18:59 -05:00
Edward Gao
dcec4c899c Bulk load CDK: more component test stuff (#68167) 2025-10-28 15:41:50 +00:00
Subodh Kant Chaturvedi
1b48ee9adf feat: improve temporal representation in proto + shared encoder/decoder for source and dest (#67016) 
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
 2025-10-21 22:31:47 +05:30
Rodi Reich Zilberman
a421083ca4 CDK changes only (#67152) 2025-10-07 10:51:43 -07:00
Edward Gao
12837e2833 Bulk CDK: enforce test timeouts better (#66722) 2025-09-29 09:31:05 -07:00
Edward Gao
224459edf3 chore: re-add the bulk CDK version file (#66193) 2025-09-16 17:01:26 +00:00
Edward Gao
5a6690808f move cdk version into its own file (#66175) 2025-09-10 21:44:15 +00:00
Maxime Carbonneau-Leclerc
a0d0e1cdff feat(declarative bulk): spec for low code (#65157) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-09-08 08:52:35 -04:00
Ryan Br...
741893caf8 Set test env for dockerized dests tests (#65141) 2025-08-22 10:18:37 -07:00
Francis Genet
8957930ad2 Allow us to dynamically set the log level via an env variable (#64148) 2025-08-05 17:31:03 +00:00
Rodi Reich Zilberman
045491d8fe Rodi/refactor output consumer (#62862) 2025-07-10 12:59:25 -07:00
Rodi Reich Zilberman
cbf42c3333 Socket mode in bulk extract CDK (#60993) 2025-07-07 12:54:08 -07:00
Jimmy Ma
222fc46431 chore: dlq-toolkit updates rejected records counts (#62502) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-07-03 14:08:46 -07:00
Jimmy Ma
b86ab9ee55 chore: add dead letter queue tests (#61709) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-06-24 10:16:20 -07:00
Jonathan Pearlin
576de2bf26 revert: namespace mapper revert (#61638) 2025-06-16 12:27:44 -04:00
Maxime Carbonneau-Leclerc
7f17e5f32a feat: update schema for discover (#61511) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-06-16 07:51:33 -04:00
Edward Gao
872910f9fe Bulk load CDK: stop requiring global state's stream states to exist in the catalog (#61597) 2025-06-13 22:14:39 +00:00
Jimmy Ma
63aab18316 feat: enable destination discover (#61395) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-06-06 15:21:49 -07:00
Edward Gao
56a8be4e22 bulk load cdk: direct-load orchestration (#58641) 
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
 2025-06-06 09:58:07 -07:00
Johnny Schmidt
17d9874562 [Load-CDK] Speed: Dummy Stats additionalProperties fix, namespace mapping bug fix, broken test fixes (#61406) 
Co-authored-by: subodhchaturvedi <subodh1810@gmail.com>
 2025-06-06 15:57:40 +00:00
Johnny Schmidt
9c1724c693 Load-CDK: Allow source to send probe messages in socket mode (#61330) 2025-06-03 19:14:19 +00:00
Johnny Schmidt
1d18c2c546 [Load-CDK] Speed: Protobuf support for sockets (#61008) 2025-06-03 17:15:16 +00:00
Jonathan Pearlin
1303d3cf93 feat: install flatbuffers compiler for cdk bulk builds (#60856) 
Co-authored-by: Davin Chia <davinchia@gmail.com>
 2025-05-27 08:32:32 -04:00
Edward Gao
8f447197ec Destination bigquery: use new cdk (#56980) 
Co-authored-by: Francis Genet <francis.genet@airbyte.io>
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
 2025-05-15 15:34:06 +00:00
Edward Gao
bc9bcd4d5b bulk load cdk: implement check generically (#59691) 2025-05-08 08:21:51 -07:00
Edward Gao
1547001387 bulk CDK: stop validating configs (#59709) 2025-05-08 08:16:18 -07:00
Rodi Reich Zilberman
e97ed2611e Improve BigDecimal to json conversion to prevent scientific notation (#59223) 2025-05-06 10:35:31 -07:00
Ryan Br...
bb837f39f6 Rbroughan/test files v2 (#58664) 
Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-04-29 09:58:58 -07:00
Yue Li
ad7aa7af4b [cdk, source-postgres, source-mysql, source-mongodb-v2] Fixing vulnerabilities in dependencies (#58132) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-04-24 08:28:30 -07:00
Ryan Br...
abb103d17c Rbroughan/augustin/01 23 destination s3 use the non root base image (#52579) 
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-01-29 12:54:19 -08:00
Edward Gao
7c12755f35 Bulk Load CDK: refactor micronaut property handling (#51600) 2025-01-28 09:21:19 -08:00
Ryan Br...
a333001441 fix: sets emittedAt for trace messages to reflect actual emission time (#51613) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-01-17 15:54:59 -08:00
Marius Posta
1ca7aff541 bulk-cdk: fix ConnectorUncleanExitException message (#50867) 2025-01-03 11:28:53 -05:00
Marius Posta
426cabccd9 bulk-cdk: fix loss of numerical precision when deserializing JSON (#49920) 2024-12-18 15:43:20 -05:00
Johnny Schmidt
6118419c3a Load CDK: S3V2 processes in processRecords, uploads in processBatch (#49819) 2024-12-18 06:15:55 +02:00
Johnny Schmidt
f4cfb4ba98 Bulk Load CDK: Staging refactor + tests; multi-sync ITs correctly wait for ack (#48608) 
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2024-11-25 22:53:52 +02:00
Rodi Reich Zilberman
b78c279fb3 Add depedendency needed for ssh and ssl openssh format (ed25519) keys (#48611) 2024-11-22 09:39:20 -08:00
Ryan Br...
7810e32c90 chore: load CDK clears partial aggregates at cadence (#48551) 2024-11-20 11:29:58 -08:00
Ryan Br...
0061f855cf chore: rbroughan/disk back pressure no deadlock prevention (#48505) 2024-11-15 15:39:06 -08:00
Rodi Reich Zilberman
c589cb5e9e migrate CAT tests to new source-mysql location (#48414) 2024-11-07 19:18:07 -08:00
Benoit Moriceau
4fbbf58b4d feat: add application yaml (#48385) 2024-11-06 23:18:58 +00:00
Edward Gao
32691add91 Bulk load CDK: switch to passing path around in integration tests (#46978) 2024-10-22 18:56:49 +03:00
Marius Posta
a4847dfe49 bulk-cdk: add feature flag environments (#46692) 2024-10-18 05:36:01 +03:00
Edward Gao
871db55443 Bulk load CDK: nondocker runner throws exception if destination fails (#46921) 2024-10-17 15:04:17 -07:00
Edward Gao
55a7522af7 Bulk CDK: ConnectorRunner accepts explicit isTest flag (#46920) 2024-10-17 21:55:11 +00:00
Johnny Schmidt
5ac1110f6c Bulk CDK Core: Escape Dollar Signs in Command Line File Property Sources (#46697) 2024-10-10 08:25:21 -07:00
Edward Gao
39b32b33a6 Bulk CDK: Rename stuff to prevent conflicts (#46650) 2024-10-09 00:12:35 +03:00
Marius Posta
919e45d314 bulk-cdk: fix test-logs location (#46336) 2024-10-03 09:12:04 -07:00
Edward Gao
721392079a Bulk CDK: Enable setting deployment mode in integration tests; update destinations check test appropriately (#45929) 2024-10-01 18:32:46 +03:00