1
0
mirror of synced 2025-12-26 14:02:10 -05:00
Commit Graph

724 Commits

Author SHA1 Message Date
Anatolii Yatsuk
fb769bd0a0 feat(airbyte-cdk): Add Per Partition with Global fallback Cursor (#45125) 2024-10-28 14:03:41 +02:00
Guen Prawiroatmodjo
89a1283bb0 Fix: MotherDuck destination was not passing MotherDuck API key to SQL processor (#47380) 2024-10-25 13:11:07 -07:00
Lake Mossman
b590a21629 return better structured error logs to connector builder (#46963) 2024-10-23 15:49:50 -07:00
Aaron ("AJ") Steers
8d6a7aa220 Python-CDK: Add CDK sql module for new MotherDuck destination (#47260)
Co-authored-by: Guen Prawiroatmodjo <guen@motherduck.com>
2024-10-22 22:09:08 -07:00
Patrick Nilan
15da7f20dd [airbyte-cdk] - Update HttpClient to call authenticator on backoff retry attempts in HttpClient._send (#47191) 2024-10-22 17:05:53 -07:00
Anatolii Yatsuk
569ed5c45a fix(airbyte-cdk): Fix yielding parent records in SubstreamPartitionRouter (#46918) 2024-10-18 16:19:29 +03:00
Maxime Carbonneau-Leclerc
5fb3fc24f3 Add warning on AsyncRetriever (#46952) 2024-10-16 21:39:33 -04:00
Tomasz Szuba
df80472d5e Improve SubstreamResumableFullRefreshCursor performance (#44428)
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
2024-10-10 19:38:49 -04:00
Chandler Prall
f8ac7f9fd7 fix: typo in XmlDecoder description (#46714) 2024-10-10 09:44:34 -06:00
Anatolii Yatsuk
7ed64be86e feat(airbyte-cdk): Add extra fields to StreamSlice (#46311) 2024-10-10 14:49:52 +03:00
Patrick Nilan
5381fbab8d [airbyte-cdk] - removes class_types_registry and default_implementation_registry (#46693) 2024-10-09 16:40:03 -07:00
Patrick Nilan
9249347736 [airbyte-cdk] - Add XmlDecoder component to low code CDK (#46360) 2024-10-09 11:18:32 -07:00
Brian Lai
c2923bd095 [concurrent low-code] Add concurrency_level to manifest and allow it to be parsed into a runtime object (#45943) 2024-10-08 17:04:11 -04:00
Patrick Nilan
99f94674f6 [airbyte-cdk] - Consolidate decoder selection in low-code CDK (#46313) 2024-10-07 15:16:49 -07:00
Serhii Lazebnyi
dd5adef0d4 feat(concurrent-cdk): add to concurrent per slice tracking of the most recent cursor (#45180) 2024-10-07 23:26:48 +02:00
Artem Inzhyyants
7514e231df feat(Airbyte-cdk): do not raise exception on missing stream by default (#46310)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-10-07 14:23:10 +02:00
Brian Lai
60584a0954 [airbyte-cdk] remove PrintBuffer due to issues when used by concurrent CDK (#46303) 2024-10-03 02:07:07 -04:00
Maxime Carbonneau-Leclerc
b0cac50b9e feat(airbyte-cdk) Async jobs - Limit memory usage (#46286) 2024-10-02 08:32:52 -04:00
Serhii Lazebnyi
25e21bc395 feat(concurrent-cdk): add cursor partition generator (#45712) 2024-10-02 13:19:45 +02:00
Serhii Lazebnyi
1569c0288e feat(concurrent-cdk): replace availability strategy to always available (#46269) 2024-10-01 20:34:11 +02:00
Serhii Lazebnyi
d727af0fa0 fix(concurrent-cdk): follow-up #44946 update state to state_manager state in convert to concurrent stream (#45718) 2024-10-01 18:28:23 +02:00
Maxime Carbonneau-Leclerc
0e7f3bcdff feat(airbyte-cdk) - Async job salesforce (#45673) 2024-10-01 08:48:44 -04:00
Maxime Carbonneau-Leclerc
53af0c2e45 [ONCALL #6327] have headers match during HTTP cache hit (#45926) 2024-09-27 09:23:10 -04:00
Alexandre Girard
f01a43cc4b bug(cdk) Always return a connection status even if an exception was raised (#45205) 2024-09-27 04:26:26 +00:00
Artem Inzhyyants
def91dc99c fix(airbyte-cdk): fix connector builder output serialization (#45891)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-09-25 11:25:09 +02:00
Daryna Ishchenko
b3406937c6 feat(airbyt-cdk): add transform_record() to class DefaultFileBasedStream (#45698) 2024-09-24 17:02:21 +03:00
Serhii Lazebnyi
91c2c750e2 refactor[concurrent-cdk]: add _convert_to_concurrent_stream to ConcurrentSourceAdapter (#44946) 2024-09-19 19:04:24 +02:00
Brian Lai
199a8078f2 [airbyte-cdk] Decouple request_options_provider from datetime_based_cursor + concurrent_cursor features for low-code (#45413) 2024-09-17 14:06:41 -04:00
Maxime Carbonneau-Leclerc
6baf254b5d feat(cdk): add async job components (#45178) 2024-09-10 08:59:12 -04:00
Artem Inzhyyants
e3ce82e476 feat(airbyte-cdk): add global_state => per_partition transformation (#45122)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-09-09 22:29:00 +02:00
Serhii Lazebnyi
41b858514d fix(connector-builder): add flag to disable cache (#45095) 2024-09-09 21:51:56 +02:00
Maxime Carbonneau-Leclerc
f23ae56693 bug(airbyte-cdk) Fix extras not being printed (#45198) 2024-09-06 14:30:36 -04:00
Anatolii Yatsuk
2fa35ab30b feat(airbyte-cdk): Add Global Parent State Cursor (#39593) 2024-09-06 16:44:34 +03:00
Anatolii Yatsuk
03b7e1ad22 feat(airbyte-cdk): Add limitation for number of partitions to PerPartitionCursor (#42406) 2024-09-06 14:55:14 +03:00
Artem Inzhyyants
df34893b63 feat(airbyte-cdk): replace pydantic BaseModel with dataclasses + serpyco-rs in protocol (#44444)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-09-02 17:48:17 +02:00
Artem Inzhyyants
7644dcd2a3 feat(airbyte-cdk): use orjson to speed up parsing (#44829)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-08-29 21:16:23 +02:00
Patrick Nilan
10601618c0 [airbyte-cdk] - Update JSON Error Message Parser to return additional error message fields or default to dict (#44010) 2024-08-28 12:38:26 -07:00
Erick Corona
fc8cd5a554 fix(python-cdk): add user friendly message for encoding errors (#44438)
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
2024-08-28 11:13:10 -06:00
Tomasz Szuba
9e35a88bbc Improve performance of interpolation in decalarative sources (#44027)
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
2024-08-21 17:27:13 -07:00
Erick Corona
a19827384e chore(python-cdk): remove Path not returned mypy warning (#44433)
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
2024-08-20 15:19:13 +00:00
Serhii Lazebnyi
45d5198c06 [airbyte-cdk] refactor error handling in abstract source (#40571) 2024-08-19 23:20:54 +02:00
Baz
7b2e0be012 🎉 CDK (Low-Code): Add RFR for Sub-streams (Low-code) (#42974) 2024-08-19 12:40:02 +03:00
Brian Lai
fca0460030 [airbyte-cdk] tech-debt Remove support for parsing legacy state message format (#43459) 2024-08-16 21:06:37 -04:00
Artem Inzhyyants
1065562e31 Airbyte CDK: move deprecated decorator (#44023)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-08-16 13:10:36 +02:00
Erick Corona
198f83e269 feat(python-sources): add unit integration testing utilities for simplification (#43338) 2024-08-14 12:15:50 -05:00
Serhii Lazebnyi
aaaf12e055 [file-based cdk] add excel file type support (#43346) 2024-08-14 15:05:15 +02:00
Maxime Carbonneau-Leclerc
61c07e8bf6 feat(airbyte-cdk): Have better fallback error message on HTTP error (#43399) 2024-08-12 20:43:23 -04:00
Maxime Carbonneau-Leclerc
f8dfb52af9 fix(python-cdk): Ensure at least one element returned by decoder (#43043) 2024-08-05 10:41:25 -04:00
Brian Lai
a43b44d776 [RFR for API Sources] fix issue where full refresh state is passed by regression tester (#42986) 2024-08-03 02:10:29 -04:00
Artem Inzhyyants
90f7e401c0 perf(airbyte-cdk): performance enhancement:: add PrintBuffer (#42568)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-08-02 14:48:33 +02:00