jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-25 19:02:00 -05:00
Code Issues Packages Projects Releases Wiki Activity
16,121 Commits 5,386 Branches 518 Tags
dfd61c52ff67bf03f371d5b50312370fb215fe16
Commit Graph

489 Commits

Author SHA1 Message Date
Natik Gadzhi
dfd61c52ff [airbyte-cdk] Python 3.11 dataclass compatibility (#38846) 2024-06-03 12:14:36 -07:00
Artem Inzhyyants
b9a421ba15 feat(airbyte-cdk): add client side incremental sync (#38099) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-06-03 17:20:34 +02:00
Bindi Pankhudi
700b1708d7 Fix: Vector-db-based CDK - Updated unstructured file type and removed experimental from file type (#38722) 2024-05-30 10:34:20 -07:00
Anatolii Yatsuk
4863c9fbd6 fix(connector-builder): hide secrets in errors (#38759) 2024-05-30 15:06:28 +03:00
Ignas Vyšniauskas
82a2283a76 🐛 [cdk] Return correct type during 'check' if config does not match schema (#37398) 
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Augustin <augustin@airbyte.io>
 2024-05-24 17:32:37 -07:00
Brian Lai
29d615080a [airbyte-cdk] Fix a bug so that successful Python RFR streams are not synced on subsequent attempts (#38608) 2024-05-24 15:58:18 -04:00
Brian Lai
040f1415e5 [low-code CDK] Rsumable full refresh support for low-code streams (#38300) 2024-05-22 16:23:31 -04:00
Anton Karpets
50f4965324 File-based CDK: avoid error on empty stream when running discover (#38230) 2024-05-21 15:10:34 +03:00
Alexandre Girard
0ceb76920a refactor!(airbyte-cdk): Delete deprecated AirbyteLogger, AirbyteSpec, and Authenticators + move public classes to the top level init file (#37805) 
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
 2024-05-20 07:18:37 -07:00
Patrick Nilan
8396fd2d7f airbyte-cdk: Improve Error Handling in Legacy CDK (#37576) 2024-05-16 19:07:21 -07:00
Alexandre Girard
fb11ca22fe low-code: Yield records from generators instead of keeping them in in-memory lists (#36406) 2024-05-14 18:00:03 -07:00
Aldo Gonzalez
e7508a4572 Airbyte CDK: Add delete method to HttpMocker (#38169) 2024-05-14 08:06:18 -06:00
Brian Lai
8fdd9818ec [airbyte-cdk] Promote low-code types and cursor interface into Python CDK (#38077) 2024-05-13 15:51:50 -04:00
Artem Inzhyyants
5fe60b7fb8 Airbyte CDK: use pytz.utc instead of datetime.utc (#38026) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-05-09 13:01:46 +02:00
Tobias Macey
18c9ebc64d [airbyte-cdk] Increase the maximum parseable field size for CSV files (#36320) 2024-05-07 20:08:01 -03:00
Brian Lai
d74125bf10 [RFR for API Sources] New Python interfaces to support resumable full refresh (#37429) 2024-05-06 18:41:29 -04:00
Anton Karpets
8ec438acf0 File-based CDK: allow to merge schemas with nullable object values (#37773) 2024-05-02 17:43:14 +03:00
Anton Karpets
2cfa6ea2c8 File-based CDK: fix schemas merge for nullable object types (#37619) 2024-05-02 10:40:20 +03:00
Alexandre Girard
86ee91ed5d Connector builder: read input state if it exists (#37495) 2024-04-24 15:53:09 -07:00
Maxime Carbonneau-Leclerc
48af92ad78 Concurrent CDK: if exception is AirbyteTracedException, raise this an… (#37443) 2024-04-19 20:32:46 +00:00
Patrick Nilan
b20cd1bd1d ✨ airbyte-cdk - Adds JwtAuthenticator to low-code (#37005) 2024-04-19 09:17:54 -07:00
Ella Rohm-Ensing
0439cbcd10 Clarify cdk parity test behavior (#37407) 2024-04-19 08:47:02 -07:00
Alexandre Girard
a2e908dc17 connector builder: Set state on stream slices (#37109) 2024-04-18 16:16:02 -07:00
Maxime Carbonneau-Leclerc
b49c5006ea Break Python application with status 1 on exception (#37390) 2024-04-18 16:54:55 -04:00
Maxime Carbonneau-Leclerc
d2c8e63ea5 Fix partitioned state saving issue (#37389) 2024-04-17 22:57:45 -04:00
Natik Gadzhi
33a5cf777b [Python CDK] Delete SingerSource (#37364) 2024-04-17 07:21:22 -07:00
Maxime Carbonneau-Leclerc
a900c7841f Add StreamDescriptor as params of AirbyteTracedException.__init__ (#37108) 2024-04-12 17:11:12 -04:00
Ella Rohm-Ensing
b7819d9f6c python: assert actual == expected ordering (#36980) 2024-04-11 15:16:33 +00:00
Maxime Carbonneau-Leclerc
bbf69aea7f Concurrent CDK: support partitioned states (#36811) 2024-04-09 16:48:12 -04:00
Erick Corona
23c280b651 ✨ Fix empty internal_message empty when ExceptionWithDisplayMessage raised (#36901) 2024-04-09 08:15:15 -06:00
Ella Rohm-Ensing
51d1353593 Move source-declarative-manifest to a standard source, published in step with python cdk (#36501) 2024-04-05 11:42:10 -05:00
Christo Grabowski
e74d936350 CDK: updated error message for missing streams (#36833) 2024-04-04 15:39:40 -04:00
Serhii Lazebnyi
033decc8c2 add backward compatibility for an old close slice logic (#36774) 2024-04-03 03:13:22 +02:00
Alexandre Girard
7676892ca9 low-code: Fix cursor pagination instantiation if the stop_condition is a string (#36760) 2024-04-02 14:03:27 -07:00
Alexandre Girard
4af69fc20d low-code: Add last_page_size and last_record to pagination context (#36408) 2024-04-02 10:43:30 -07:00
Serhii Lazebnyi
604a2dfee8 fix wrong partition key definition after legacy state migration (#36719) 2024-04-01 17:08:03 +02:00
Alexandre Girard
b27ddfe19e connector-builder: return full url-encoded URL instead of separating parameters (#36680) 2024-03-28 18:49:35 -07:00
Serhii Lazebnyi
c3c87ea1a5 follow up to #36294: allow migrate sub stream state with custom partition router (#36590) 2024-03-28 23:39:26 +01:00
Alexandre Girard
634db576dc Python CDK: rename a unit test (#36556) 2024-03-27 17:00:38 -07:00
Brian Lai
624415d111 [airbyte-cdk] emit source recordCount as float instead of integer (#36560) 
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
 2024-03-27 16:02:30 -04:00
Ella Rohm-Ensing
0c367680b0 Fix E721 errors in the CDK (#36490) 2024-03-26 18:05:33 +00:00
Alexandre Girard
118a864ea2 low-code: Add string filter (#36393) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2024-03-25 17:02:31 -07:00
Alexandre Girard
28591c3481 per partition state and custom state migrations (#36294) 2024-03-25 16:05:55 -07:00
Roman Yermilov [GL]
242dd6a425 Airbyte CDK: request options allowed to be an array (#36357) 2024-03-22 07:07:44 +01:00
Brian Lai
728c92cba1 [airbyte-cdk] Stream should not extract state using legacy get_updated_state if no cursor (#36342) 2024-03-20 23:47:23 -04:00
Anatolii Yatsuk
157be91cb1 ✨ File-based CDK: Add skip_wrong_number_of_fields_error parameter for CSV parser (#36237) 
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
 2024-03-20 22:49:49 +02:00
Maxime Carbonneau-Leclerc
2f34f084e4 [ISSUE #6548] make all fields nullable except from pk and cursor field (#36201) 2024-03-20 09:48:38 -04:00
Alex Birdsall
44f784e200 Remove most_recent_record arg from Cursor.close_slice (#36216) 2024-03-18 18:28:50 -07:00
Artem Inzhyyants
240aa0180d Airbyte CDK (low code): add refresh_token_error handler to DeclarativeOauth2Authenticator (#36058) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2024-03-18 18:52:58 +01:00
Alexandre Girard
875e5dfacb low-code: Allow developers to use a custom schema loader (#36040) 2024-03-18 09:42:16 -07:00