1
0
mirror of synced 2025-12-31 06:05:12 -05:00
Commit Graph

21 Commits

Author SHA1 Message Date
Artjoms Iskovs
f790fee57c Populate the PK from the Singer discovery run (#2713) (#4789)
When running Singer discovery, use the `key_properties` field to populate the `source_defined_primary_key` stream meta.
2021-08-09 20:11:22 +03:00
Maksym Pavlenok
106c3cd641 🎉 CDK: Allow setting request non-JSON data (#5161)
* add the function request_body_data

* gradlew format

* Update airbyte-cdk/python/airbyte_cdk/sources/streams/http/http.py

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update airbyte-cdk/python/airbyte_cdk/sources/streams/http/exceptions.py

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* add test for application/x-www-form-urlencoded

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-08-06 15:32:25 +03:00
Sherif A. Nada
cb4fe7254c CDK: Add initial Destination abstraction and tests (#4719)
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
2021-07-13 16:18:08 -07:00
Sherif A. Nada
3aebe55cd5 🎉 Python CDK: Allow setting network adapter args on outgoing HTTP requests (#4493) 2021-07-07 15:17:58 -07:00
Davin Chia
9460cb4422 Update all of Pydantic to 1.6.2 per Dependabot. (#3408)
* Update all to 1.6.2.

* Publish new airbyte-cdk version.

* Use repr instead of str for exceptions.

* Use rc.

* Edit test.

* Bump for SAT.

* Format.
2021-05-14 16:44:49 +08:00
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Charles
a2f29f6024 fix formatting (#3370) 2021-05-11 15:46:59 -07:00
Sherif A. Nada
eb812eaecd Bump CDK consumers (#3368) 2021-05-11 15:27:44 -07:00
Sherif A. Nada
535d83e0af bugfix infinite pagination in CDK (#3366) 2021-05-11 14:45:27 -07:00
Davin Chia
1d8e6da511 Various CDK build fixes/clean up. (#3312)
* Better MyPy command to not type check singer. Export UserDefinedException as that is used in tests.
2021-05-10 10:02:04 +08:00
Sherif A. Nada
184dab77eb CDK: overhaul directory structure (#3295) 2021-05-09 15:27:38 -07:00
Davin Chia
ca4c1b8821 CDK: Test Http.py (#3279) 2021-05-09 19:29:19 +08:00
Sherif A. Nada
f5a76e8448 Test AbstractSource read behavior (#3276) 2021-05-07 14:55:41 -07:00
Sherif A. Nada
efd429d58f CDK: Test AbstractSource: Check and Discover (#3272) 2021-05-07 13:11:57 -07:00
Sherif A. Nada
715dfc5e34 Test AirbyteEntrypoint.run (#3261) 2021-05-07 22:13:03 +08:00
Sherif A. Nada
1fb6b9f911 CDK: test catalog helpers (#3271)
* test catalog helpers

* Format.

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-05-07 22:12:52 +08:00
Sherif A. Nada
f88e5de903 Test Source Entrypoint Arg Parsing (#3259) 2021-05-06 15:34:55 -07:00
Sherif A. Nada
e856502455 CDK: Test integration.py (#3243)
* integration.py tests

* refactor integration.py

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-05-06 18:25:10 +08:00
Davin Chia
b5c2329748 CDK: Add OAuth and Streams/Core tests. (#3228)
Completely test the OAuth module and streams/core.py file.

Add pytest-mock as well as a convenience wrapper to run the type checker and the test together when developing.

Also configure pytest to pick up loggers at the INFO level and above, and pick up standard out for easier debugging.

Some of the script bits are unpolished - will improve them as we go along.
2021-05-06 15:52:23 +08:00
Sherif A. Nada
c3356684dd Test JSONSchema resolver (#3223)
closes #2722

I don't love the current structure. There is a number of improvements that can be made:

JsonSchemaResolver can be refactored to have the following signature:

def __init__(schemas: Mapping[str, any], refs: Mapping[str, any])
  # schemas are all json files in `schemas/`, refs are all json files in `schemas/shared/`
Then we can thoroughly test the resolving behavior in JsonSchemaResolver independently from the logic for where we actually load schemas from.

I was tempted to make this refactor now but I'd rather cover more ground with tests then revisit. I created an issue to track this: #3222
2021-05-05 09:51:24 +08:00
Davin Chia
fa33c9c126 Initial CDK Test set up and one test file. (#3207)
Co-authored-by: Sherif Nada <snadalive@gmail.com>
2021-05-04 14:27:58 -07:00