mirror of synced 2025-12-25 11:06:55 -05:00

Files

Arthur Galuza 9aa5a5a52d 🎉 CDK: Added support for efficient parent/child streams using cache (#6057 )

* Add caching

* Upd cache file handling

* Upd slices, sync mode, docs

* Bump version

* Use SyncMode.full_refresh for parent stream_slices

* Refactor

2021-09-22 20:23:27 +03:00

basic-concepts.md

CDK: Update conceptual docs. Update template docs. (#3352 )

2021-05-11 11:02:51 +08:00

full-refresh-stream.md

Rewrite and break out CDK Python overview to be more concise and digestible (#3291 )

2021-05-07 20:30:21 -07:00

http-streams.md

🎉 CDK: Added support for efficient parent/child streams using cache (#6057 )

2021-09-22 20:23:27 +03:00

incremental-stream.md

Rewrite and break out CDK Python overview to be more concise and digestible (#3291 )

2021-05-07 20:30:21 -07:00

python-concepts.md

Rewrite and break out CDK Python overview to be more concise and digestible (#3291 )

2021-05-07 20:30:21 -07:00

README.md

Remove outdated note about CDK not supporting destinations (#4995 )

2021-07-26 13:52:42 -07:00

schemas.md

📚 add doc to describe how CDK handles schemas (#4537 )

2021-07-06 15:58:27 -07:00

stream_slices.md

Rewrite and break out CDK Python overview to be more concise and digestible (#3291 )

2021-05-07 20:30:21 -07:00

README.md

Connector Development Kit Concepts

This concepts section serves as a general introduction to the Python CDK. Readers will certainly benefit from a deeper understanding of the Airbyte Specification before proceeding, but we do a quick overview of it in our basic concepts guide below.

Basic Concepts

If you want to learn more about the classes required to implement an Airbyte Source, head to our basic concepts doc.

Full Refresh Streams

If you have questions or are running into issues creating your first full refresh stream, head over to our full refresh stream doc. If you have questions about implementing a path or parse_response function, this doc is for you.

Incremental Streams

Having trouble figuring out how to write a stream_slices function or aren't sure what a cursor_field is? Head to our incremental stream doc.

Practical Tips

Airbyte recommends using the CDK template generator to develop with the CDK. The template generates created all the required scaffolding, with convenient TODOs, allowing developers to truly focus on implementing the API.

For tips on useful Python knowledge, see the Python Concepts page.

You can find a complete tutorial for implementing an HTTP source connector in this tutorial

Examples

Those interested in getting their hands dirty can check out implemented APIs:

Exchange Rates API (Incremental)
Stripe API (Incremental and Full-Refresh)
Slack API (Incremental and Full-Refresh)