jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-02-01 13:02:06 -05:00
Code Issues Packages Projects Releases Wiki Activity
14,245 Commits 5,453 Branches 518 Tags
2aa7327a8ecd596c5babca3c3aaa14ca6aaa7c33
Commit Graph

529 Commits

Author SHA1 Message Date
Maxime Carbonneau-Leclerc
c26d355de8 Fix Cursor interface change + FileBased change at the same time (#34653) 2024-01-30 10:03:00 -05:00
Maxime Carbonneau-Leclerc
ca8590e2b4 Have StateBuilder return our actual state object and not simply a dict (#34625) 2024-01-30 08:46:03 -05:00
Maxime Carbonneau-Leclerc
2c8b47b100 Emit state when no partitions are generated for ccdk (#34605) 2024-01-30 08:45:49 -05:00
Catherine Noll
eb31e4d2ba File-based CDK: make full refresh concurrent (#34411) 2024-01-29 19:33:50 -05:00
Maxime Carbonneau-Leclerc
abe985167b Fix broken print in ccdk (#34578) 2024-01-26 16:16:29 -05:00
Maxime Carbonneau-Leclerc
b9c1897cfc Fix concurrent deadlock (#34454) 2024-01-24 12:35:21 -05:00
Catherine Noll
e3e58cc063 Concurrent CDK: fix state message ordering (#34131) 2024-01-18 11:35:40 -05:00
Alexandre Girard
0faa69d899 concurrent cdk: improve resource usage and stop waiting on the main thread (#33669) 
Co-authored-by: Augustin <augustin@airbyte.io>
 2024-01-17 23:54:02 -08:00
midavadim
e2476f2ab3 🐛 CDK HttpRequester should support str http_method which comes from manifest.yaml file (#34011) 2024-01-15 14:31:11 +02:00
Baz
cf7f700bbb 🎉 Airbyte CDK (File-based CDK): Stop the sync if the record could not be parsed (#32589) 2024-01-11 21:26:23 +02:00
Artem Inzhyyants
9c6aea19cd Airbyte CDK: handle private network exception as config error (#33751) 2024-01-10 15:20:40 +01:00
Anton Karpets
8305d05e52 ✨Airbyte CDK: add POST method to HttpMocker (#34001) 
Co-authored-by: maxi297 <maxime@airbyte.io>
 2024-01-10 12:44:58 +02:00
Alexandre Girard
c8ca4b13ff 🐛 fix declarative oauth initialization (#32967) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2024-01-08 17:40:48 -08:00
Maxime Carbonneau-Leclerc
60edbba67f [ISSUE #32871] enable debug logs for integration tests (#33718) 2024-01-04 10:32:54 -05:00
Eugene Kulak
4061f08f3d CDK: Add schema normalization to declarative stream (#32786) 
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Yevhenii Kurochkin <ykurochkin@flyaps.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-12-21 14:51:17 +02:00
Catherine Noll
86321b7945 Concurrent CDK: add state converter for ISO timestamps with milliseco… (#33531) 2023-12-20 11:53:59 -05:00
Eugene Kulak
25bdd30fd5 CDK: add SelectiveAuthenticator (#33526) 
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Yevhenii Kurochkin <ykurochkin@flyaps.com>
 2023-12-20 01:59:50 +02:00
Joe Reuter
9065181e77 Unstructured parser: Support txt (#32929) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-12-15 11:31:45 +01:00
Maxime Carbonneau-Leclerc
66edb4b0f0 Issue 32871/more integration test tooling to test events stream (#33305) 
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
 2023-12-14 09:23:19 -05:00
Yevhenii
0aea0eb560 CDK: Raise error on passing unsupported value formats as query parameters (#33060) 
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-12-13 14:01:34 +00:00
Joe Reuter
55d5345bff Vector DB CDK: Refactor to improve readability (#33255) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-12-13 11:23:39 +00:00
Joe Reuter
c1e428f35c File CDK: Handle 422 errors separately (#33300) 2023-12-13 11:03:36 +00:00
Maxime Carbonneau-Leclerc
0c2d43fdf9 Issue 32871/extract trace message creation (#33227) 2023-12-11 09:20:45 -05:00
Maxime Carbonneau-Leclerc
d3f2aa548a [ISSUE #33202] allow for loose query params validation (#33226) 2023-12-11 08:57:41 -05:00
Augustin
0b33caecda Revert "[skip ci] formatting: add missing license headers (#33250)" (#33289) 2023-12-11 11:38:37 +01:00
Augustin
60c1cc01ad [skip ci] formatting: add missing license headers (#33250) 2023-12-11 10:15:18 +01:00
Yevhenii
be85cac726 🐛CDK: Fix cdk models by adding use_cache param for HttpRequests into the declarative_components_schema.yaml (#33247) 
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-12-08 17:16:18 +00:00
Joe Reuter
aa220fc515 Stop sync on traced exception (#33246) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-12-08 18:07:25 +01:00
Joe Reuter
f5ac5cfd80 File CDK: Add file processing via API to document file type parser (#32781) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-12-08 15:48:37 +01:00
Joe Reuter
7fd92e2a03 File CDK: Parser defined primary key (#33009) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-12-08 15:15:33 +01:00
Yevhenii
32ebd88402 CDK: low-code enable caching for parent streams (#32726) 2023-12-08 13:54:31 +00:00
Joe Reuter
5b682ef74f Unstructured parser: Handle parsing errors better (#32700) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-12-08 11:47:05 +01:00
Joe Reuter
21b3b2f638 Vector DB CDK: Fix special tokens (#33065) 2023-12-08 11:46:46 +01:00
Brian Lai
f8182bc18e airbyte-cdk: failed stream does not end the sync (#33136) 
Co-authored-by: brianjlai <brianjlai@users.noreply.github.com>
 2023-12-07 14:11:39 -05:00
Catherine Noll
7ed47ee7d9 File-based CDK: hide the primary key field from config (#33172) 2023-12-06 11:12:50 -05:00
Maxime Carbonneau-Leclerc
ba83309bb1 [ISSUE #32870] Adding entrypoint wrapper and migrating file based and… (#33103) 2023-12-06 08:46:38 -05:00
Maxime Carbonneau-Leclerc
69cb3a571e [ISSUE #32868] create HttpMocker (#32937) and [ISSUE #32869] response builder (#32983) 
Co-authored-by: octavia-approvington <octavia-approvington@users.noreply.github.com>
 2023-12-05 08:48:45 -05:00
Alexandre Girard
6671bced15 🐛 concurrent-cdk: Do not set the max number of tasks to the number of workers (#32971) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2023-11-30 06:46:49 -08:00
Joe Reuter
28e8692624 Vector DB CDK: Add omit_raw_text flag (#32698) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-11-30 09:49:02 +01:00
Alexandre Girard
a84902e8be ✨ concurrent cdk: Read multiple streams concurrently (#32411) 2023-11-28 15:00:00 -08:00
Alexandre Girard
9d52007c31 🐛 low-code: Fix injection of page token in first request (#32666) 
Co-authored-by: Lake Mossman <lake@airbyte.io>
 2023-11-28 12:49:59 -08:00
Yevhenii
d475beba19 🐛CDK: Fix of generate the error message using _try_get_error based on list of errors (#32545) 2023-11-17 12:22:20 +00:00
Joe Reuter
aa111d2bea Vector DB CDK: Delete cdc records (#32496) 2023-11-16 15:32:15 +00:00
Joe Reuter
509afc9858 File CDK: Improve unstructured parser (#32554) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-11-16 15:23:16 +00:00
Alexandre Girard
c979f70490 pass airbytestream instead of configured stream to as_airbyte_message (#32412) 2023-11-15 11:36:58 -08:00
Alexandre Girard
0f94afe09e 🐛 CDK: Apply log level on the entrypoint's logger (#32410) 2023-11-15 18:20:45 +00:00
Eugene Kulak
203e01e435 CDK: increase maximum_attempts_to_acquire to avoid crashing in acquire_call (#32516) 
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
 2023-11-14 20:04:55 +00:00
Joe Reuter
f8b0b3e99e File CDK: Improve stream config appearance (#32420) 2023-11-14 11:49:19 +01:00
Ella Rohm-Ensing
ac3eb28de2 airbyte-ci: add format commands (#31831) 
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
 2023-11-14 02:17:48 -06:00
Maxime Carbonneau-Leclerc
b3f0e059d5 Fixing futures pruning (#32399) 2023-11-09 17:52:58 -05:00