* init
* bad copy/paste
* move to top level
* Revert "move to top level"
This reverts commit aca3534d38.
* attempt to wire up connector builder frontend to server
* copy from octaviacli
* fix connection to builder server
* update
* delete
* Update
* delete python-version
* Revert "delete python-version"
This reverts commit f9258a7755.
* setup python
* install python
* rename
* kube stuff
* Install python
* missing kube file
* rename
* Update files
* Update bumpversion
* install python
* try with different entrypoint
* rename container
* point to docker-compose.yaml file
* derp
* copy acceptance_test.sh
* copy from acceptance tests
* delete cruft
* update
* remove application env
* reset
* reset to master
* update
* skip comprehensive incremental tests
* Revert "skip comprehensive incremental tests"
This reverts commit 9cee657596.
* reset to master
* remove cruft
* readme
* readme
* save
* buncha stuff
* it works
* improvements
* comment
* codesnippet
* delete superfluous steps
* update port to 8003
* reset to master
* Update publish docker
* move openapi spec to airbyte-connector-builder
* point to openapi spec
* dont expose the connector builder to localhost
* reset FE components to master
* Don't deploy the connector-builder
* Revert "Don't deploy the connector-builder"
This reverts commit 3d157494cf.
* Revert "Revert "Don't deploy the connector-builder""
This reverts commit beac3d48f0.
* comment out more things related to connector builder server
* more attempts at removing the connector builder
* comment out more things
* Update airbyte-connector-builder/README.md
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
* fixes
* rename gradle task
* save
* copyright header
* Apply suggestions from code review
Co-authored-by: Lake Mossman <lake@airbyte.io>
* Update airbyte-webapp/src/config/configProviders.ts
Co-authored-by: Lake Mossman <lake@airbyte.io>
* update
* rename
* indent
* Revert "move openapi spec to airbyte-connector-builder"
This reverts commit 57dda04723.
* Revert "rename"
This reverts commit b2d802b8fa.
* Revert "Revert "rename""
This reverts commit 91db24fd4a.
* point to wrong file in case it fixes the build
* point to right openapi file
* Revert "Revert "move openapi spec to airbyte-connector-builder""
This reverts commit e46a837454.
* point to moved file
* fix path
* Update from master
* newline
* Add failing test
* Revert "Add failing test"
This reverts commit ed9fea09b5.
* comment
* update commented requires
* Add a comment
* comments
* save
* formatting is for losers anyways
* pyproject
* toml
* toml
* saved
* nice
* anothaone
* fmt
* fixmypy
* fix autogen notice header location
* improvecomment
* save working branch
* fmt
* delete license and disable caching
* removeyaml
* fix merge and uncomment flakeCheck
* undo css change
* fix typo
* format
* enable CORS
* move template to backend server
* try adding connector builder server to 'generate-docker' task to see if it fixes CI
* try adding buildDockerImage task
* try adding gradle.properties
* Revert "try adding buildDockerImage task"
This reverts commit 2102009ddb.
* Revert "try adding connector builder server to 'generate-docker' task to see if it fixes CI"
This reverts commit 40b5ae0fcd.
* process detail in apiOverride
* fix gradle
* fix scrollbars
* Run connector builder server tests and static analysis from a docker container (#19495)
* Revert "try adding buildDockerImage task"
This reverts commit 2102009ddb.
* Revert "try adding connector builder server to 'generate-docker' task to see if it fixes CI"
This reverts commit 40b5ae0fcd.
* missing file
* build airbyte-connector-builder-server image
* Add .
* comment
* build connector builder server as part of octavia_cli
* build connector builder too
* patch
* missing file
* comment
* comment
* run unit tests in a container
* Run integration tests
* run
* move to platform build
* format
* rootdir
* get the path from the project
* Update
* pyproject
* delete a bunch of code
* parameterize
* run tests
* update
* rename
* comment
* reset
* uncomment
* dont format
* run everything except isort
* delete dead code
* Revert "delete dead code"
This reverts commit b11df716a0.
* comment
* Update module
* reset to master
* mount in home
* commit formatted files
* try running format
* Better comment
* reset
* Revert "reset"
This reverts commit 20808f8262.
* Update buildSrc/src/main/groovy/airbyte-python-docker.gradle
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* comment
* Add everything except build and hidden directories
* symlink
* Update airbyte-connector-builder-server/run_format.sh
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Update airbyte-connector-builder-server/run_tests.sh
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: sherifnada <snadalive@gmail.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
The integration testing logs are extremely noisy today. The logs contain the entire test STDOUT and are a pain to read.
This PR contains a better test setup config to reduce logging output.
The main change is to comment out ShowStandardStreams in the integration tests plugin.
Then we add the started event so Gradle shows us when a test is started. Some tests take a longer time. It is useful to know they have begun so it's clear if the job is stuck or not.
Standardise the above setting across all of our custom test tasks.
* Dockerfile to 3.9
* Python version
* More python updates
* 3.9 on GitHub actions and lint updates
* Test out 3.9.11 on GitHub actions
* install python with an action
* formatting: newline
* Also has python code
* only check first level for changed modules
Previous example (source-google-search-console/credentials)
* Test failure: there is no logger.trace
* Added RDS base performance tests for source-postgres, source-mssql and source-mysql
* updated perfomance test with cpu and memory limit
Co-authored-by: andriikorotkov <andrii.h.korotkov@globallogic.com>
* upgrade to gradle 7.2
* get build working with gradle 7.2
* fix build
* fix connector build?
* EXCLUDE distTar and switch includes to excludes
* switch back to includes
* temporarily try to adjust properties
* don't know why this was modified
* revert spotless upgrade
* upgrade gradle node (better arm support it says)
* add back in Xss since we are getting StackOverflowError without it
* revert bad spotless fmt
* fix acceptance tests duplicates strategy
* add zip for jdbc includes
* check if this helps for java connectors
* remove accidental commit
* remove redundant
* fix warning explosion
* oops
* override gradle.properties
* remove set-env
This is what the plugin's maintainer suggested: xvik/gradle-use-python-plugin#19.
I ran the build 10 times in a row without any checkPython error so this does seem to have fixed it.
* working except for too much logging and bad success case
* succeeds on passing case
* completes successfully
* just doesn't kill the main
* working zombie killing
* cleanup
* more cleanup
* use correct path
* fmt
* cleanups, bugfixes, integration tests
* run worker integration tests as part of ci
* delete tester class
* fix hanging checkpoint container problem
* fix name of command
* replace todo with clarifying comment
Completely test the OAuth module and streams/core.py file.
Add pytest-mock as well as a convenience wrapper to run the type checker and the test together when developing.
Also configure pytest to pick up loggers at the INFO level and above, and pick up standard out for easier debugging.
Some of the script bits are unpolished - will improve them as we go along.
Upgrade to Pip 21.1 in preparation to upgrade DBT 19.
The latest Pip has
- a stricter resolver
- access to more up to date Python wheels (e.g. #2267 is solved since as any version after Pip 21 has access to ready-compiled Python wheels, see https://issues.apache.org/jira/browse/ARROW-11835).
- in theory faster pip installs (https://github.com/pypa/pip/issues/9187#issuecomment-826037738 makes me think the current Pip version is stable enough be consumed)
Also relax the constraint for `requests` and `backoff` since both were actually specifying incompatible versions that the old Pip resolver was silently swallowing.
Test this locally first by running git clean -dfx to remove all the existing venv files. The two different Pip versions do not work well.
