1
0
mirror of synced 2025-12-20 02:23:30 -05:00
Commit Graph

1266 Commits

Author SHA1 Message Date
Abhi Vaidyanatha
05bdb368a0 Reorganize CDK documentation directory structure to be less nested (#3270)
* Move CDK docs down a level, consolidate directories.

* Change name of tutorial

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-05-07 12:50:33 -07:00
Sherif A. Nada
715dfc5e34 Test AirbyteEntrypoint.run (#3261) 2021-05-07 22:13:03 +08:00
Sherif A. Nada
1fb6b9f911 CDK: test catalog helpers (#3271)
* test catalog helpers

* Format.

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-05-07 22:12:52 +08:00
Sherif A. Nada
f88e5de903 Test Source Entrypoint Arg Parsing (#3259) 2021-05-06 15:34:55 -07:00
Abhi Vaidyanatha
e2d5bfa3ea Add primary_key noop to docs and PokeAPI connector. (#3245)
* Add primary_key noop to docs and PokeAPI connector.

* Small grammar fix in FAQ.

* Change empty string to None for noop.

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-05-06 10:54:42 -07:00
Sherif A. Nada
e856502455 CDK: Test integration.py (#3243)
* integration.py tests

* refactor integration.py

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-05-06 18:25:10 +08:00
Davin Chia
b5c2329748 CDK: Add OAuth and Streams/Core tests. (#3228)
Completely test the OAuth module and streams/core.py file.

Add pytest-mock as well as a convenience wrapper to run the type checker and the test together when developing.

Also configure pytest to pick up loggers at the INFO level and above, and pick up standard out for easier debugging.

Some of the script bits are unpolished - will improve them as we go along.
2021-05-06 15:52:23 +08:00
Sherif A. Nada
c3356684dd Test JSONSchema resolver (#3223)
closes #2722

I don't love the current structure. There is a number of improvements that can be made:

JsonSchemaResolver can be refactored to have the following signature:

def __init__(schemas: Mapping[str, any], refs: Mapping[str, any])
  # schemas are all json files in `schemas/`, refs are all json files in `schemas/shared/`
Then we can thoroughly test the resolving behavior in JsonSchemaResolver independently from the logic for where we actually load schemas from.

I was tempted to make this refactor now but I'd rather cover more ground with tests then revisit. I created an issue to track this: #3222
2021-05-05 09:51:24 +08:00
Abhi Vaidyanatha
4710e5836f Adding concepts docs, structure for CDK documentation (#3220)
* Adding concepts docs, structure for CDK documentation

* Add more context to the CDK README

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-05-04 17:09:29 -07:00
Davin Chia
fa33c9c126 Initial CDK Test set up and one test file. (#3207)
Co-authored-by: Sherif Nada <snadalive@gmail.com>
2021-05-04 14:27:58 -07:00
Davin Chia
72e7fe35a3 Run MyPy on CDK/base-python and fix issues. (#3175) 2021-05-04 11:02:53 +08:00
Sherif A. Nada
dd45537239 use extras for CDK development and remove python 3.10 support (#3200) 2021-05-03 18:34:18 -07:00
Davin Chia
ced243881b Add CDK publishing setup. (#3156)
Allow us to publish CDK versions on PyPi via Github workflows.

This lets us:
- Version CDK moving forward
- Publish via Github actions to both PyPi and test PyPi for test releases.

Note, this will not work on this branch as Github only detects new workflows after they are checked into master, so I was forced to develop and test this from a fork. Browse this PR or this PR to see this command in action.

Added publishing instructions to the Release Document.
2021-05-03 08:38:47 +08:00
Christophe Duong
8dff1586ab Fix spotlessApply conflict with black (#3152)
* Fix spotlessApply conflict with black
2021-04-30 21:09:42 +02:00
Sherif A. Nada
e9287e7964 Naively merge all Python modules into one. (#3148)
* naively merge all python base modules into one

* Formatting changes.

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-04-30 15:17:55 +08:00
Sherif A. Nada
0e520df330 Add Airbyte CDK module scaffolding (#3126) 2021-04-29 13:24:44 -07:00