jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-07 00:05:48 -05:00
Code Issues Packages Projects Releases Wiki Activity
23,725 Commits 5,180 Branches 518 Tags
dfdfbb0ebbdd94d84cbbbb20d5cbc39f4e7edb0b
Commit Graph

326 Commits

Author SHA1 Message Date
Aaron ("AJ") Steers
0727e4435a docs: fix refs to Python CDK manifest yaml (#48576) 2024-11-20 18:53:15 +00:00
Aaron ("AJ") Steers
c6d49bdc60 Python-CDK: Remove CDK (replaced by new repo) (#48470) 2024-11-18 17:45:18 -08:00
Maxime Carbonneau-Leclerc
de137f28f1 bugfix: Ensure that streams with partition router are not executed concurrently (#48432) 2024-11-08 17:40:13 -05:00
Anatolii Yatsuk
dd52899a6c fix(airbyte-cdk): Add state workaround for legacy substreams (#48387) 2024-11-08 16:24:48 +02:00
Artem Inzhyyants
0c73a65c07 feat(airbyte-cdk): add jinja macros today_with_timezone (#48400) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-11-08 11:15:33 +01:00
Maxime Carbonneau-Leclerc
2266c3ae7e bugfix: Move to CustomFormatConcurrentStreamStateConverter on epoch as well a… (#48389) 2024-11-07 12:37:23 -05:00
Maxime Carbonneau-Leclerc
e99938a989 Concurrent cursor support multiple formats (#48361) 2024-11-05 15:18:07 -05:00
Artem Inzhyyants
ca767a35b7 Airbyte CDK: fix streams discover (#48110) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-11-04 19:40:02 +01:00
Brian Lai
6e2cbb4bb0 [Concurrent Low-Code] ConcurrentDeclarativeSource class that low-code connectors can inherit from to uptake Concurrent CDK (#46662) 
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
 2024-10-29 18:09:08 -07:00
Anatolii Yatsuk
fb769bd0a0 feat(airbyte-cdk): Add Per Partition with Global fallback Cursor (#45125) 2024-10-28 14:03:41 +02:00
Anatolii Yatsuk
569ed5c45a fix(airbyte-cdk): Fix yielding parent records in SubstreamPartitionRouter (#46918) 2024-10-18 16:19:29 +03:00
Maxime Carbonneau-Leclerc
5fb3fc24f3 Add warning on AsyncRetriever (#46952) 2024-10-16 21:39:33 -04:00
Chandler Prall
f8ac7f9fd7 fix: typo in XmlDecoder description (#46714) 2024-10-10 09:44:34 -06:00
Anatolii Yatsuk
7ed64be86e feat(airbyte-cdk): Add extra fields to StreamSlice (#46311) 2024-10-10 14:49:52 +03:00
Patrick Nilan
5381fbab8d [airbyte-cdk] - removes class_types_registry and default_implementation_registry (#46693) 2024-10-09 16:40:03 -07:00
Patrick Nilan
9249347736 [airbyte-cdk] - Add XmlDecoder component to low code CDK (#46360) 2024-10-09 11:18:32 -07:00
Brian Lai
c2923bd095 [concurrent low-code] Add concurrency_level to manifest and allow it to be parsed into a runtime object (#45943) 2024-10-08 17:04:11 -04:00
Patrick Nilan
99f94674f6 [airbyte-cdk] - Consolidate decoder selection in low-code CDK (#46313) 2024-10-07 15:16:49 -07:00
Maxime Carbonneau-Leclerc
b0cac50b9e feat(airbyte-cdk) Async jobs - Limit memory usage (#46286) 2024-10-02 08:32:52 -04:00
Maxime Carbonneau-Leclerc
0e7f3bcdff feat(airbyte-cdk) - Async job salesforce (#45673) 2024-10-01 08:48:44 -04:00
Brian Lai
199a8078f2 [airbyte-cdk] Decouple request_options_provider from datetime_based_cursor + concurrent_cursor features for low-code (#45413) 2024-09-17 14:06:41 -04:00
Maxime Carbonneau-Leclerc
6baf254b5d feat(cdk): add async job components (#45178) 2024-09-10 08:59:12 -04:00
Artem Inzhyyants
e3ce82e476 feat(airbyte-cdk): add global_state => per_partition transformation (#45122) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-09-09 22:29:00 +02:00
Serhii Lazebnyi
41b858514d fix(connector-builder): add flag to disable cache (#45095) 2024-09-09 21:51:56 +02:00
Anatolii Yatsuk
2fa35ab30b feat(airbyte-cdk): Add Global Parent State Cursor (#39593) 2024-09-06 16:44:34 +03:00
Anatolii Yatsuk
03b7e1ad22 feat(airbyte-cdk): Add limitation for number of partitions to PerPartitionCursor (#42406) 2024-09-06 14:55:14 +03:00
Artem Inzhyyants
df34893b63 feat(airbyte-cdk): replace pydantic BaseModel with dataclasses + serpyco-rs in protocol (#44444) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-09-02 17:48:17 +02:00
Artem Inzhyyants
7644dcd2a3 feat(airbyte-cdk): use orjson to speed up parsing (#44829) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-08-29 21:16:23 +02:00
Tomasz Szuba
9e35a88bbc Improve performance of interpolation in decalarative sources (#44027) 
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
 2024-08-21 17:27:13 -07:00
Baz
7b2e0be012 🎉 CDK (Low-Code): Add RFR for Sub-streams (Low-code) (#42974) 2024-08-19 12:40:02 +03:00
Maxime Carbonneau-Leclerc
61c07e8bf6 feat(airbyte-cdk): Have better fallback error message on HTTP error (#43399) 2024-08-12 20:43:23 -04:00
Maxime Carbonneau-Leclerc
f8dfb52af9 fix(python-cdk): Ensure at least one element returned by decoder (#43043) 2024-08-05 10:41:25 -04:00
Brian Lai
197cb810b0 [RFR for API Sources] Add SubstreamResumableFullRefreshCursor to the Python CDK (#42429) 2024-08-01 16:39:14 -04:00
Maxime Carbonneau-Leclerc
36a6f35a61 feat(airbyte-cdk) Align BackoffStrategy interfaces to take attempt_count as a full-fled… (#42889) 2024-07-31 11:41:15 -04:00
Maxime Carbonneau-Leclerc
9a1520bd58 feat(airbyte-cdk) Add ability to stop stream when retry-after is greater than a duration (#42865) 2024-07-30 09:15:11 -04:00
Artem Inzhyyants
328be4b565 fix(airbyte-cdk): fix declarative schema refs (#42844) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-07-29 12:36:32 +02:00
Natik Gadzhi
813ad995f6 feat(python-cdk): add description to declarative source schema (#42392) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2024-07-25 14:26:35 -07:00
Serhii Lazebnyi
a066968ff5 fix[low-code] follow up #38829 (#42475) 2024-07-24 13:47:41 +02:00
Artem Inzhyyants
f5e5a9768b fix(airbyte-cdk): fix OOM on predicate for streamable responses (#42448) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-07-23 21:41:03 +02:00
Artem Inzhyyants
5056e67826 refactor!(airbyte-cdk): deprecate availability strategy (#42039) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-07-23 10:22:11 +02:00
Artem Inzhyyants
3cfe199b6b feat(airbyte-cdk): add new Decoders: JsonlDecoder and IterableDecoder (#38829) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
 2024-07-19 13:45:12 +02:00
Serhii Lazebnyi
da51b20a88 [low-code cdk]: fix overwrite for default backoff strategy (#42048) 2024-07-18 19:21:28 +02:00
Brian Lai
b2d53f552d [RFR for Python Sources] Make it easier for Python sources to automatically use RFR for eligible streams (#39450) 2024-07-18 01:17:14 -04:00
Serhii Lazebnyi
39b8e3da19 [airbyte-cdk] not exiting when rate limited (#41333) 2024-07-17 00:56:59 +02:00
Daryna Ishchenko
a49e779c59 feat(airbyte-cdk): add failure_type to HttpResponseFilter (raise config error in low-code) (#40676) 2024-07-16 16:50:29 +03:00
Brian Lai
9e23b3f89b 🐛 [airbyte-cdk] Fix bug where substreams depending on an RFR parent stream don't paginate or use existing state (#40671) 2024-07-11 02:53:20 -04:00
Artem Inzhyyants
02c5f59ccf ref(airbyte-cdk): use http_client inside HttpStream (#39811) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-07-09 12:01:03 +02:00
Cristina Mariscal
c4b8212ba7 CDK: Add support for input format parsing at jinja macro format_datetime (#40759) 
Co-authored-by: cristina.mariscal <cristina.mariscal@cristina.mariscal--MacBook-Pro---DFJ27FJFXX>
 2024-07-08 08:42:09 +00:00
Cristina Mariscal
a8e985b7a0 Revert "CDK: Add jinja macro format_datetime_string" (#40747) 2024-07-05 15:04:32 +00:00
Cristina Mariscal
b9c213a473 CDK: Add jinja macro format_datetime_string (#40744) 2024-07-05 13:19:43 +00:00