jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-06 06:04:16 -05:00
Code Issues Packages Projects Releases Wiki Activity

✨ CDK: availability check - handle HttpErrors which happen during slice extraction (#26630)

Browse Source 
* for availability check - handle  HttError happens during slice extraction (reading of parent stream),
updated reason messages,
moved check availability call under common try/except which handles errors during usual stream read,
moved log messages which indicate start of the stream sync before availability check in to make to understand which stream is the source of errors

* why do we return here and not try next stream?

* fixed bug in CheckStream, now we try to check availability for all streams
This commit is contained in:
midavadim
2023-06-23 20:15:25 +03:00
committed by GitHub
parent 14c57d79d3
commit c44c3eae48
5 changed files with 119 additions and 27 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
airbyte-cdk/python/unit_tests/sources/declarative/checks/test_check_stream.py
View File

@@ -96,7 +96,7 @@ def test_check_stream_with_no_stream_slices_aborts():
403,
False,
[
"The endpoint to access stream 'mock_http_stream' returned 403: Forbidden.",
"Unable to read mock_http_stream stream",
"This is most likely due to insufficient permissions on the credentials in use.",
],
),