1
0
mirror of synced 2026-02-01 13:02:06 -05:00
Commit Graph

614 Commits

Author SHA1 Message Date
Ignas Vyšniauskas
82a2283a76 🐛 [cdk] Return correct type during 'check' if config does not match schema (#37398)
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Augustin <augustin@airbyte.io>
2024-05-24 17:32:37 -07:00
Brian Lai
29d615080a [airbyte-cdk] Fix a bug so that successful Python RFR streams are not synced on subsequent attempts (#38608) 2024-05-24 15:58:18 -04:00
Ella Rohm-Ensing
3ec9b4edad low-code CDK: update desciption of 'version' in manifest file (#38611) 2024-05-23 07:11:07 -07:00
Brian Lai
040f1415e5 [low-code CDK] Rsumable full refresh support for low-code streams (#38300) 2024-05-22 16:23:31 -04:00
Anton Karpets
50f4965324 File-based CDK: avoid error on empty stream when running discover (#38230) 2024-05-21 15:10:34 +03:00
Alexandre Girard
0ceb76920a refactor!(airbyte-cdk): Delete deprecated AirbyteLogger, AirbyteSpec, and Authenticators + move public classes to the top level init file (#37805)
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
2024-05-20 07:18:37 -07:00
Patrick Nilan
8396fd2d7f airbyte-cdk: Improve Error Handling in Legacy CDK (#37576) 2024-05-16 19:07:21 -07:00
Alexandre Girard
fb11ca22fe low-code: Yield records from generators instead of keeping them in in-memory lists (#36406) 2024-05-14 18:00:03 -07:00
Aldo Gonzalez
e7508a4572 Airbyte CDK: Add delete method to HttpMocker (#38169) 2024-05-14 08:06:18 -06:00
Brian Lai
8fdd9818ec [airbyte-cdk] Promote low-code types and cursor interface into Python CDK (#38077) 2024-05-13 15:51:50 -04:00
Artem Inzhyyants
5fe60b7fb8 Airbyte CDK: use pytz.utc instead of datetime.utc (#38026)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-05-09 13:01:46 +02:00
Natik Gadzhi
7309360af6 [airbyte-ci] Format using a poe task (#38043) 2024-05-08 08:41:41 -07:00
Tobias Macey
18c9ebc64d [airbyte-cdk] Increase the maximum parseable field size for CSV files (#36320) 2024-05-07 20:08:01 -03:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Brian Lai
d74125bf10 [RFR for API Sources] New Python interfaces to support resumable full refresh (#37429) 2024-05-06 18:41:29 -04:00
Anton Karpets
8ec438acf0 File-based CDK: allow to merge schemas with nullable object values (#37773) 2024-05-02 17:43:14 +03:00
Anton Karpets
2cfa6ea2c8 File-based CDK: fix schemas merge for nullable object types (#37619) 2024-05-02 10:40:20 +03:00
Alexandre Girard
102d09cc9d Expose cdk version as airbyte_cdk.__version__ (#37680) 2024-04-30 10:18:00 -07:00
Alexandre Girard
86ee91ed5d Connector builder: read input state if it exists (#37495) 2024-04-24 15:53:09 -07:00
Ella Rohm-Ensing
e766ba3a9e Python CDK: remove "deprecated" package (#37497) 2024-04-23 13:23:05 -05:00
Maxime Carbonneau-Leclerc
48af92ad78 Concurrent CDK: if exception is AirbyteTracedException, raise this an… (#37443) 2024-04-19 20:32:46 +00:00
Patrick Nilan
b20cd1bd1d airbyte-cdk - Adds JwtAuthenticator to low-code (#37005) 2024-04-19 09:17:54 -07:00
Alexandre Girard
a2e908dc17 connector builder: Set state on stream slices (#37109) 2024-04-18 16:16:02 -07:00
Maxime Carbonneau-Leclerc
b49c5006ea Break Python application with status 1 on exception (#37390) 2024-04-18 16:54:55 -04:00
Maxime Carbonneau-Leclerc
d2c8e63ea5 Fix partitioned state saving issue (#37389) 2024-04-17 22:57:45 -04:00
Natik Gadzhi
33a5cf777b [Python CDK] Delete SingerSource (#37364) 2024-04-17 07:21:22 -07:00
Natik Gadzhi
e4c942e526 [python-cdk] README cleanup (#37306) 2024-04-16 14:57:11 -07:00
Bindi Pankhudi
63d4d5e3f6 Python CDK : Update LangChain version (#37327) 2024-04-15 12:43:51 -07:00
Maxime Carbonneau-Leclerc
a900c7841f Add StreamDescriptor as params of AirbyteTracedException.__init__ (#37108) 2024-04-12 17:11:12 -04:00
Brian Lai
822d76c725 [airbyte-cdk] add print parameter to flush the print buffer after each invocation (#37000) 2024-04-11 15:11:23 -04:00
Maxime Carbonneau-Leclerc
ab52ce5182 Concurrent CDK: add logging on exception (#36976) 2024-04-10 21:36:44 -04:00
Maxime Carbonneau-Leclerc
bbf69aea7f Concurrent CDK: support partitioned states (#36811) 2024-04-09 16:48:12 -04:00
Erick Corona
23c280b651 Fix empty internal_message empty when ExceptionWithDisplayMessage raised (#36901) 2024-04-09 08:15:15 -06:00
Christo Grabowski
e74d936350 CDK: updated error message for missing streams (#36833) 2024-04-04 15:39:40 -04:00
Serhii Lazebnyi
033decc8c2 add backward compatibility for an old close slice logic (#36774) 2024-04-03 03:13:22 +02:00
Alexandre Girard
7676892ca9 low-code: Fix cursor pagination instantiation if the stop_condition is a string (#36760) 2024-04-02 14:03:27 -07:00
Alexandre Girard
4af69fc20d low-code: Add last_page_size and last_record to pagination context (#36408) 2024-04-02 10:43:30 -07:00
Serhii Lazebnyi
604a2dfee8 fix wrong partition key definition after legacy state migration (#36719) 2024-04-01 17:08:03 +02:00
Alexandre Girard
b27ddfe19e connector-builder: return full url-encoded URL instead of separating parameters (#36680) 2024-03-28 18:49:35 -07:00
Serhii Lazebnyi
c3c87ea1a5 follow up to #36294: allow migrate sub stream state with custom partition router (#36590) 2024-03-28 23:39:26 +01:00
Brian Lai
624415d111 [airbyte-cdk] emit source recordCount as float instead of integer (#36560)
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
2024-03-27 16:02:30 -04:00
Ella Rohm-Ensing
3f91b64d53 check cdk: don't use connector test runenr (#36564) 2024-03-27 19:13:17 +00:00
Ella Rohm-Ensing
0c367680b0 Fix E721 errors in the CDK (#36490) 2024-03-26 18:05:33 +00:00
Alexandre Girard
118a864ea2 low-code: Add string filter (#36393)
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2024-03-25 17:02:31 -07:00
Ella Rohm-Ensing
195408eb15 Airbyte CDK: move from gradle to poetry (#36250) 2024-03-25 18:46:57 -05:00
Alexandre Girard
28591c3481 per partition state and custom state migrations (#36294) 2024-03-25 16:05:55 -07:00
Roman Yermilov [GL]
242dd6a425 Airbyte CDK: request options allowed to be an array (#36357) 2024-03-22 07:07:44 +01:00
Brian Lai
728c92cba1 [airbyte-cdk] Stream should not extract state using legacy get_updated_state if no cursor (#36342) 2024-03-20 23:47:23 -04:00
Anatolii Yatsuk
157be91cb1 File-based CDK: Add skip_wrong_number_of_fields_error parameter for CSV parser (#36237)
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
2024-03-20 22:49:49 +02:00
Maxime Carbonneau-Leclerc
2f34f084e4 [ISSUE #6548] make all fields nullable except from pk and cursor field (#36201) 2024-03-20 09:48:38 -04:00