Allow us to publish CDK versions on PyPi via Github workflows.
This lets us:
- Version CDK moving forward
- Publish via Github actions to both PyPi and test PyPi for test releases.
Note, this will not work on this branch as Github only detects new workflows after they are checked into master, so I was forced to develop and test this from a fork. Browse this PR or this PR to see this command in action.
Added publishing instructions to the Release Document.
Upgrade to Pip 21.1 in preparation to upgrade DBT 19.
The latest Pip has
- a stricter resolver
- access to more up to date Python wheels (e.g. #2267 is solved since as any version after Pip 21 has access to ready-compiled Python wheels, see https://issues.apache.org/jira/browse/ARROW-11835).
- in theory faster pip installs (https://github.com/pypa/pip/issues/9187#issuecomment-826037738 makes me think the current Pip version is stable enough be consumed)
Also relax the constraint for `requests` and `backoff` since both were actually specifying incompatible versions that the old Pip resolver was silently swallowing.
Test this locally first by running git clean -dfx to remove all the existing venv files. The two different Pip versions do not work well.
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.
General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.
Checked in and added tests for the generated modules.
* fix connector base versioning
* only run integration tests in non-bases directories
* upgrade datamodel-code-generator which coincidentally has already fixed this issue with generating List of Lists
* bump forgotten hubspot version
* fix build
* fix python install order
* fix base install reqs dependencies
* don't clobber dependencies
* remove cacheIf forcing
* it wasn't clobbering actually
* fix pip version
* loosen pyyaml version
* Revert "loosen pyyaml version"
This reverts commit 5a4eb3bc08.
* move tap-adwords dependency
* downgrade shopify api version used to match
* run seed init
* add test curl
* Revert "add test curl"
This reverts commit caee9ee9ee.
* revert to simpler docker times
* rename task function so it doesn't match the task name
* turn off buildkit
* fix redshift dir for credentials
* add twilio and freshdesk to seed yaml
* fix typo
* get shopify passing similar to the adwords fix
* support cached builds for base -> base-java -> snowflake
* use plugin for image building
* fix matching on COPY from
* remove docker.gradle
* tmp commit
* update connectors
* finish rest of build files
* fix ide errors
* more build fixes
* clean up
* clean up for new soruces
* fix spotless
* fix flake problems
* add recommended empty file
* python caching
* fixes upon review
* clean up docker and build test files
* clean up python
* clean up
* fix integration test dependencies
* fix standard tests
* fix
* remove symlink
* re-add requirements to fix normalizatioon build
* fix symlink
* fix dumbest build problem of all
* add missing integration test def
* fix missing dep
* remove class exclusion
* move trim so null source versions are allowed
* rename map
* fix hardcoded value
* remove unnecessary dep
* use dashes for salesforce package name
* fix typo
* DRY and fix test image name
* Fix edit
* assert string is not empty
* build integration test image only for integrationTest
* move code generator to tools and rename docker build tasks
* make source test depend on integration test build, not the other way
* remove guard because the docker build should exist before the integrationtest is applied
* remove comment
* DRY up airbyte-source-test
* fix plugin compilation
* add missing dependency
* rename getTaggedImage to getDevTaggedImage
* fix test vs main docker build bug
