1
0
mirror of synced 2025-12-22 11:31:02 -05:00
Commit Graph

60 Commits

Author SHA1 Message Date
Edward Gao
ce2d87f0a0 Bulk Load CDK: stop testing undeclared fields (#62882) 2025-07-21 22:36:39 +00:00
Edward Gao
a241e30796 Destinations: fix builds (#61534) 2025-06-11 15:02:31 -07:00
Johnny Schmidt
f86428a14f [Dest-DevNull] Noop Connector IPC Options (#60938) 2025-05-28 09:12:34 -07:00
Edward Gao
15b5614d6d bulk load cdk: turn supportsDedup into an object (#60286) 2025-05-16 17:27:13 -04:00
Johnny Schmidt
3586ebda23 Test: Merge connector changes without version bumps works (#59756) 2025-05-09 21:05:22 +00:00
Johnny Schmidt
0543ad60ba Load-CDK: Bugfix: Correct jackson-to-input-string ratio (#59710) 2025-05-07 20:11:38 +00:00
Francis Genet
cd7c0aa802 Update CDK to pass DestinationRecordRaw around (#55737)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
2025-03-13 22:48:01 +02:00
Johnny Schmidt
80db58ff20 Destination DevNull: Use DirectLoader (no spill2disk) (#54179) 2025-02-25 21:25:37 +02:00
Edward Gao
4729319075 Bulk Load CDK: testNamespaces supports destinations with a "default namespace" concept (#53186) 2025-02-06 16:20:20 -08:00
Jimmy Ma
2c3e6a1b11 chore: add destination performance testing built-in (#52641)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-01-30 11:23:38 -08:00
Edward Gao
7c12755f35 Bulk Load CDK: refactor micronaut property handling (#51600) 2025-01-28 09:21:19 -08:00
Johnny Schmidt
5c04f5f34a Load CDK Tests: Generalize Microbatch Fix for State Ack-Dependent Tests (#52076) 2025-01-23 20:14:45 +02:00
Edward Gao
5c90a7e968 Destination S3 Data Lake: Write objects+unions as stringified json (#51042) 2025-01-15 19:41:01 +02:00
Benoit Moriceau
56f6dc38ac Re-enable test (#50961) 2025-01-07 08:50:57 -08:00
Francis Genet
b65ebc271b Allow us to pass a map of environment variables within our BasicFunctionalityIntegrationTest class (#50427)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2024-12-27 09:25:25 -08:00
Benoit Moriceau
671d4de84f Add file support to the bulk CDK (#49931) 2024-12-24 10:36:48 -08:00
Johnny Schmidt
1bd65afe8c Bulk Load CDK: Remove interfaces from InputFlow, migrate tests to mockk (#49974) 2024-12-21 00:00:20 +02:00
Johnny Schmidt
6118419c3a Load CDK: S3V2 processes in processRecords, uploads in processBatch (#49819) 2024-12-18 06:15:55 +02:00
Francis Genet
920aef890d [Iceberg] Integration tests skeleton (#48864)
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
2024-12-13 09:43:05 -08:00
Benoit Moriceau
7ca27fdd40 Add Integration test (#48692) 2024-11-27 11:17:17 -08:00
Catherine Noll
d93f6f7607 feat: update destination dev-null for progressive rollout testing (#48693)
Co-authored-by: Johnny Schmidt <john.schmidt@airbyte.io>
2024-11-26 15:37:41 -05:00
Edward Gao
81ddaed0dc Destination Iceberg v2: basic test scaffolds + related runtime classes (#48544) 2024-11-19 20:47:33 +02:00
Benoit Moriceau
bda07f90ca Bmoric/stream loader (#48468) 2024-11-18 14:02:10 -08:00
Edward Gao
9a51bce6f6 Bulk load CDK: Add test with every single airbyte type (#48370) 2024-11-05 23:16:36 +02:00
Edward Gao
a9f242f959 Bulk load CDK: First test for refreshes behavior (#48107) 2024-11-04 09:02:09 -08:00
Edward Gao
ae31af25b6 Bulk load CDK: add complex type tests (#48018) 2024-11-01 22:13:37 +02:00
Edward Gao
9dcb7e7ac2 Bulk load CDK: Even more tests (#47377) 2024-10-28 15:59:35 -07:00
Edward Gao
1361e05e0e Bulk load CDK: Even more tests (#46976) 2024-10-23 22:16:38 +00:00
Edward Gao
32691add91 Bulk load CDK: switch to passing path around in integration tests (#46978) 2024-10-22 18:56:49 +03:00
Edward Gao
1cc7f2cc0e Bulk load cdk: add checkpointing test (#46749) 2024-10-18 14:52:15 -07:00
Marius Posta
a4847dfe49 bulk-cdk: add feature flag environments (#46692) 2024-10-18 05:36:01 +03:00
Johnny Schmidt
4a2e7c8012 Bulk Load CDK: File format Spec & Streaming Upload, S3V2 Usage (#46957) 2024-10-18 03:32:21 +03:00
Edward Gao
a2ead855ab Bulk load CDK: set up dockerized/non-dockerized integration test tasks (#46691) 2024-10-11 10:38:37 -07:00
Edward Gao
fb4a43f603 Bulk load cdk: Implement the docker-capable DestinationProcess (#46363) 2024-10-10 23:22:05 +03:00
Edward Gao
e8caebe6df Bulk load CDK: remove redundant check test (#46655) 2024-10-09 23:38:13 +03:00
Edward Gao
39b32b33a6 Bulk CDK: Rename stuff to prevent conflicts (#46650) 2024-10-09 00:12:35 +03:00
Edward Gao
4c84f5889c Bulk load cdk: split the destination process stuff into multiple files in their own package (#46362) 2024-10-04 09:50:04 -07:00
Edward Gao
7dc73752cf Bulk load cdk: Update spec test to run against cloud+oss modes (#46300) 2024-10-03 12:48:25 -07:00
Edward Gao
7f0e0fbf2a Destination dev null: reenable legacy DATs (#45930) 2024-10-01 10:56:20 -07:00
Edward Gao
721392079a Bulk CDK: Enable setting deployment mode in integration tests; update destinations check test appropriately (#45929) 2024-10-01 18:32:46 +03:00
Edward Gao
4b3533ad67 Destination dev null: rebase onto master (#46276)
Co-authored-by: Johnny Schmidt <john.schmidt@airbyte.io>
2024-10-01 02:17:20 +03:00
Johnny Schmidt
7cdd998aa5 Load CDK E2ETest Destination w/o tests (#45147) 2024-09-26 14:24:49 -07:00
Stephane Geneix
d4952010c5 destination-dev-null: merge cloud and OSS (#45651) 2024-09-20 15:38:31 -07:00
Stephane Geneix
0fc5bf6881 destination-dev-null: upgrade CDK (#45650) 2024-09-20 14:57:17 -07:00
Stephane Geneix
c6ec55deb1 destination-dev-null: convert test code to kotlin (#45649)
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to this change.
-->

## How
<!--
* Describe how code changes achieve the solution.
-->

## Review guide
<!--
1. `x.py`
2. `y.py`
-->

## User Impact
<!--
* What is the end result perceived by the user?
* If there are negative side effects, please list them. 
-->

## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [ ] YES 💚
- [ ] NO 
2024-09-20 14:38:52 -07:00
Stephane Geneix
2e61b5a946 destination-dev-null: convert production code to kotlin (#45648)
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to this change.
-->

## How
<!--
* Describe how code changes achieve the solution.
-->

## Review guide
<!--
1. `x.py`
2. `y.py`
-->

## User Impact
<!--
* What is the end result perceived by the user?
* If there are negative side effects, please list them. 
-->

## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [ ] YES 💚
- [ ] NO 
2024-09-20 11:06:29 -07:00
Edward Gao
3525225e6e Destination dev null: support dedup (#38118) 2024-05-10 10:28:24 -07:00
Marius Posta
ada1196785 destination-e2e-test,dev-null: use CDK 0.20.6 (#35278) 2024-02-14 09:35:27 -08:00
Aaron ("AJ") Steers
da32fc86bf 🚀 Launch Java CDK v0.1.0 (PR #30383)
- Launch Java CDK `v0.1.0`. 🚀
- Remove `airbyte-docker` gradle plugin from java connectors.
- Add `airbyte-java-connector` gradle plugin.
- Remove `airbyte-commons` from global build.gradle.
- Add `/publish-java-cdk` slash command.
- Initial launch of `/airbyte-ci` slash command to test connectors.
2023-09-27 15:46:02 -07:00
Marius Posta
f5c7c1c0b8 chore: get ./gradlew format to pass for the whole repo (same java style) (#29786) 2023-08-24 05:09:42 -05:00