1
0
mirror of synced 2025-12-22 11:31:02 -05:00

🎉 Python CDK: Allow to ignore http status errors and override retry parameters (#5363)

added auto_fail_on_errors, max_retries, retry_factor properties to python cdk
This commit is contained in:
Yaroslav Dudar
2021-08-25 10:31:24 +03:00
committed by GitHub
parent 3b9d7026f3
commit 8ddce6f355
8 changed files with 131 additions and 9 deletions

View File

@@ -20,6 +20,13 @@ Optionally, we can provide additional inputs to customize requests:
* request parameters and headers
* how to recognize rate limit errors, and how long to wait \(by default it retries 429 and 5XX errors using exponential backoff\)
* HTTP method and request body if applicable
* configure exponential backoff policy
Backoff policy options:
- `retry_factor` Specifies factor for exponential backoff policy (by default is 5)
- `max_retries` Specifies maximum amount of retries for backoff policy (by default is 5)
- `raise_on_http_errors` If set to False, allows opting-out of raising HTTP code exception (by default is True)
There are many other customizable options - you can find them in the [`airbyte_cdk.sources.streams.http.HttpStream`](https://github.com/airbytehq/airbyte/blob/master/airbyte-cdk/python/airbyte_cdk/sources/streams/http/http.py) class.