jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-27 07:02:03 -05:00
Code Issues Packages Projects Releases Wiki Activity
15,541 Commits 5,392 Branches 518 Tags
b60bbc72fdfd195b700236b58490f5c71857edcd
Commit Graph

205 Commits

Author SHA1 Message Date
Patrick Nilan
b20cd1bd1d ✨ airbyte-cdk - Adds JwtAuthenticator to low-code (#37005) 2024-04-19 09:17:54 -07:00
Ella Rohm-Ensing
b7819d9f6c python: assert actual == expected ordering (#36980) 2024-04-11 15:16:33 +00:00
Serhii Lazebnyi
033decc8c2 add backward compatibility for an old close slice logic (#36774) 2024-04-03 03:13:22 +02:00
Alexandre Girard
7676892ca9 low-code: Fix cursor pagination instantiation if the stop_condition is a string (#36760) 2024-04-02 14:03:27 -07:00
Alexandre Girard
4af69fc20d low-code: Add last_page_size and last_record to pagination context (#36408) 2024-04-02 10:43:30 -07:00
Serhii Lazebnyi
604a2dfee8 fix wrong partition key definition after legacy state migration (#36719) 2024-04-01 17:08:03 +02:00
Serhii Lazebnyi
c3c87ea1a5 follow up to #36294: allow migrate sub stream state with custom partition router (#36590) 2024-03-28 23:39:26 +01:00
Alexandre Girard
634db576dc Python CDK: rename a unit test (#36556) 2024-03-27 17:00:38 -07:00
Ella Rohm-Ensing
0c367680b0 Fix E721 errors in the CDK (#36490) 2024-03-26 18:05:33 +00:00
Alexandre Girard
118a864ea2 low-code: Add string filter (#36393) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2024-03-25 17:02:31 -07:00
Alexandre Girard
28591c3481 per partition state and custom state migrations (#36294) 2024-03-25 16:05:55 -07:00
Roman Yermilov [GL]
242dd6a425 Airbyte CDK: request options allowed to be an array (#36357) 2024-03-22 07:07:44 +01:00
Alex Birdsall
44f784e200 Remove most_recent_record arg from Cursor.close_slice (#36216) 2024-03-18 18:28:50 -07:00
Artem Inzhyyants
240aa0180d Airbyte CDK (low code): add refresh_token_error handler to DeclarativeOauth2Authenticator (#36058) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2024-03-18 18:52:58 +01:00
Alexandre Girard
875e5dfacb low-code: Allow developers to use a custom schema loader (#36040) 2024-03-18 09:42:16 -07:00
Alex Birdsall
a6a1b3c0c3 Base datetime cursor state off latest observed record (#35843) 2024-03-15 15:06:43 -07:00
Alexandre Girard
15b954546f raise exception with the full class name if a class for a custom comp… (#35868) 2024-03-12 12:18:38 -07:00
Alexandre Girard
4a808ee178 🐛 follow up to #35471: update the cartesian stream slicer (#35865) 2024-03-07 08:20:02 -08:00
Alexandre Girard
f55abc1fdc 🐛 low-code: Fix incremental substreams (#35471) 2024-03-05 18:50:42 -08:00
Alexandre Girard
5f48da9a67 [low-code] allow page size to be defined with string interpolation (#35735) 
Co-authored-by: Dan Lecocq <dlecocq@sofi.org>
 2024-03-05 16:03:16 -08:00
Artem Inzhyyants
0954ad3d3a Airbyte CDK: add interpolation for request options (#35485) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2024-02-22 19:40:44 +01:00
Alexandre Girard
5724ca0cf0 Add ignore_stream_slicer_parameters_on_paginated_requests flag (#35462) 2024-02-21 14:14:37 -08:00
Artem Inzhyyants
3355c5c432 Airbyte CDK: add filter to RemoveFields (#35326) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-02-21 13:49:10 +01:00
Alexandre Girard
fc87183905 🐛 python cdk: mask oauth access key (#34931) 2024-02-14 22:25:18 -08:00
Maxime Carbonneau-Leclerc
3d9f70f9b0 [ISSUE #34755] do not propagate parameters on InlineSchemaLoader (#34853) 2024-02-07 15:41:03 -05:00
Alexandre Girard
c8ca4b13ff 🐛 fix declarative oauth initialization (#32967) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2024-01-08 17:40:48 -08:00
Eugene Kulak
4061f08f3d CDK: Add schema normalization to declarative stream (#32786) 
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Yevhenii Kurochkin <ykurochkin@flyaps.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-12-21 14:51:17 +02:00
Eugene Kulak
25bdd30fd5 CDK: add SelectiveAuthenticator (#33526) 
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Yevhenii Kurochkin <ykurochkin@flyaps.com>
 2023-12-20 01:59:50 +02:00
Yevhenii
0aea0eb560 CDK: Raise error on passing unsupported value formats as query parameters (#33060) 
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-12-13 14:01:34 +00:00
Augustin
0b33caecda Revert "[skip ci] formatting: add missing license headers (#33250)" (#33289) 2023-12-11 11:38:37 +01:00
Augustin
60c1cc01ad [skip ci] formatting: add missing license headers (#33250) 2023-12-11 10:15:18 +01:00
Yevhenii
32ebd88402 CDK: low-code enable caching for parent streams (#32726) 2023-12-08 13:54:31 +00:00
Alexandre Girard
9d52007c31 🐛 low-code: Fix injection of page token in first request (#32666) 
Co-authored-by: Lake Mossman <lake@airbyte.io>
 2023-11-28 12:49:59 -08:00
Yevhenii
d475beba19 🐛CDK: Fix of generate the error message using _try_get_error based on list of errors (#32545) 2023-11-17 12:22:20 +00:00
Maxime Carbonneau-Leclerc
d0fd57ebf8 [ISSUE-32072] increase connection pool size (#32246) 2023-11-08 09:38:41 -05:00
Alexandre Girard
139deeb081 Implement max_time on error handler (#32272) 2023-11-08 00:46:26 +00:00
Alexandre Girard
7a764f8bbc ✨ low-code CDK: Allow connector developers to specify the type of an added field (#31638) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
Co-authored-by: erohmensing <erohmensing@gmail.com>
 2023-10-23 14:12:59 -07:00
Yevhenii
b951898c20 CDK: Support base64 encode and decode in Jinja Interpolation (#31387) 2023-10-19 13:55:45 +03:00
Catherine Noll
8536725944 CDK: URL-encode query parameters and request body (#30407) 2023-10-12 09:56:55 -04:00
Yevhenii
17136a0c8a CDK: Fix initialize of token_expiry_is_time_of_expiration field (#31279) 2023-10-11 16:35:56 +00:00
Yevhenii
c17fae5855 CDK: create new method for parsing refresh token lifespan (#30698) 
Co-authored-by: yevhenii-ldv <yevhenii-ldv@users.noreply.github.com>
 2023-10-10 17:08:41 +03:00
Yevhenii
00452c9bd3 CDK: Enable Page Number/Offset to be set on the first request (#30978) 
Co-authored-by: yevhenii-ldv <yevhenii-ldv@users.noreply.github.com>
 2023-10-05 15:31:30 +03:00
Marius Posta
7ae97175a6 gradle: fix repo wide behaviour (#30607) 2023-09-28 05:01:13 -07:00
Alexandre Girard
b4ce532762 low-code: Allow formatting datetimes as milliseconds since unix epoch (#29504) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2023-08-17 18:49:28 -07:00
Joe Reuter
df3b1d9c8d 🚨🚨 Low code CDK: Decouple SimpleRetriever and HttpStream (#28657) 
* fix tests

* format

* review comments

* Automated Commit - Formatting Changes

* review comments

* review comments

* review comments

* log all messages

* log all message

* review comments

* review comments

* Automated Commit - Formatting Changes

* add comment

---------

Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-08-03 12:30:59 +02:00
Maxime Carbonneau-Leclerc
e158bec4b2 [ISSUE #28782] support multiple cursor field datetime formats (#28936) 
* [ISSUE #28782] support multiple cursor field datetime formats

* Making sure we use the proper format for creating slices

* Code review
 2023-08-01 17:59:17 -04:00
Alexandre Girard
df01616951 [Issue #23497] Deduplicate query parameters for declarative connectors (#28550) 
* remove duplicate param

* remove duplicate params

* fix some of the typing issues

* fix typing issues

* newline

* format

* Enable by default

* Add missing file

* refactor and remove flag

* none check

* move line of code

* fix typing in rate_limiting

* comment

* use typedef

* else branch

* format

* gate the feature

* rename test

* fix the test

* only dedupe if the values are the same

* Add some tests

* convert values to strings

* Document the change

* implement in requester too
 2023-07-25 14:22:25 -07:00
Joe Reuter
58cc540c6b 🚨 Low code CDK: Add session token authenticator (#28050) 
This PR adds a new authenticator: The SessionTokenAuthenticator. The existing authenticator under the same name is renamed to LegacySessionTokenAuthenticator.
 2023-07-19 17:10:24 +02:00
Joe Reuter
78728410f4 Low code CDK: Fix mypy errors (#28386) 
* ingore unit tests in mypy check

* Update airbyte-cdk/python/bin/run-mypy-on-modified-files.sh

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>

* work through mypy errors

* fix a bunch of stuff

* fix more type hints

* fix model_to_component_factory types

* format

* ignore list instead of allow list

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2023-07-19 15:08:35 +02:00
Alexandre Girard
dcf35701f4 Fix cdk unit test (#28447) 
* Update spec

* fix test_create_custom_components

* ignore errors
 2023-07-18 18:40:32 -07:00