1
0
mirror of synced 2026-01-21 15:06:13 -05:00
Commit Graph

39 Commits

Author SHA1 Message Date
Maxime Carbonneau-Leclerc
ca8cdc40aa [ISSUE #20771] limiting the number of requests performed to the backe… (#21525)
* [ISSUE #20771] limiting the number of requests performed to the backend without flag

* [ISSUE #20771] code reviewing my own code

* [ISSUE #20771] adding ABC to paginator

* [ISSUE #20771] format code

* [ISSUE #20771] adding slices to connector builder read request (#21605)

* [ISSUE #20771] adding slices to connector builder read request

* [ISSUE #20771] formatting

* [ISSUE #20771] set flag when limit requests reached (#21619)

* [ISSUE #20771] set flag when limit requests reached

* [ISSUE #20771] assert proper value on test read objects __init__

* [ISSUE #20771] code review and fix edge case

* [ISSUE #20771] fix flake8 error

* [ISSUE #20771] code review

* 🤖 Bump minor version of Airbyte CDK

* to run the CI
2023-01-24 15:19:19 +00:00
Octavia Squidington III
b9de100058 Bump Airbyte version from 0.40.28 to 0.40.29 (#21767)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2023-01-23 23:22:45 -08:00
Catherine Noll
eb2d980d7a [Connector Builder Server] add endpoint to resolve $refs and $options (#21565) 2023-01-23 15:12:16 -05:00
Joe Reuter
e844d73b28 pin cdk version (#21708) 2023-01-23 18:29:10 +00:00
Alexandre Girard
e93c8f78a9 Fail airbytePythonDockerApply if any steps fails (#20217)
* Fail if any steps fails

* Update other script too
2023-01-17 16:00:54 +00:00
Alexandre Girard
7f43da3dd0 Don't return stacktrace as part of the response (#21443)
* Don't return stacktrace as part of the response

* format
2023-01-14 11:27:04 -08:00
Octavia Squidington III
02e0258948 Bump Airbyte version from 0.40.27 to 0.40.28 (#21359)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2023-01-12 16:47:07 -08:00
Joe Reuter
5b46c65cf2 Connector builder server: Fail on failing tests (#21198)
* fail on failing command

* fix test
2023-01-12 12:48:38 +00:00
Catherine Noll
8ef287286d [Connector-builder server] Allow client to specify record limit and enforce max of 1000 (#20575) 2023-01-11 10:22:11 -05:00
Joe Reuter
d853b855ce Connector builder server: Fix unit tests (#21107)
* fix stuff

* add inferred schema to API

* fix yaml changes

* fix yaml formatting

* add whitespace back

* fix tests

* reformat

* add unit tests
2023-01-10 16:21:08 +01:00
Joe Reuter
45006a750b Connector builder server: Add inferred schema to read API response (#20942)
* fix stuff

* add inferred schema to API

* fix yaml changes

* fix yaml formatting

* add whitespace back

* reorder imports
2023-01-09 18:08:23 +00:00
Joe Reuter
c92fbee857 adjust readme (#20945) 2023-01-09 10:09:22 +01:00
Octavia Squidington III
00fb4bba09 Bump Airbyte version from 0.40.26 to 0.40.27 (#21135)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2023-01-06 14:27:01 -08:00
Alexandre Girard
2f2e530f40 [low-code] convert request.body to a dict when converting to AirbyteLogMessage (#20557)
* convert request body

* fix tests

* test body data

* more tests

* more tests

* _

* return stacktrace

* pretty print

* Revert "pretty print"

This reverts commit 091253803c.

* Revert "Revert "pretty print""

This reverts commit b6f62d645b.

* replace \n

* missing type hint
2023-01-03 01:45:36 -08:00
Octavia Squidington III
27bd807fd1 Bump Airbyte version from 0.40.25 to 0.40.26 (#20630)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2022-12-18 15:54:55 -08:00
Octavia Squidington III
f5e15dee77 Bump Airbyte version from 0.40.24 to 0.40.25 (#20279)
Co-authored-by: girarda <girarda@users.noreply.github.com>
2022-12-08 17:30:50 -08:00
Alexandre Girard
f8beda08da Don't import the connector manifest schema (#20218)
* Don't import the connector manifest schema

* Revert "Don't import the connector manifest schema"

This reverts commit 84589dcf07.

* revert

* revert

* reset
2022-12-08 13:56:52 -08:00
Octavia Squidington III
1581821930 Bump Airbyte version from 0.40.23 to 0.40.24 (#20206)
Co-authored-by: girarda <girarda@users.noreply.github.com>
2022-12-07 15:44:56 -08:00
Lake Mossman
e55757bcc9 [Connector Builder] upgrade orval and use connector manifest schema directly (#20166)
* upgrade orval and use connector manifest schema directly

* remove airbyte protocol from connector builder api spec

* generate python models from openapi change
2022-12-06 17:29:45 -08:00
Catherine Noll
4429968f42 Show http method in the connector builder test panel request tab (#20109)
Show http method in the connector builder test panel request tab
2022-12-06 15:27:59 -05:00
Alexandre Girard
ab5f37805d connector-builder server returns the request, response, and the error message if the read operation failed (#20027)
* return the request, response, and the error message

* format

* format

* remove debug log

* Undo unwanted changes

* reset to master

* comment

* remove unused logger

* unit tests

* level=error

* refactor

* format

* default to response tab in the case of error status code

Co-authored-by: lmossman <lake@airbyte.io>
2022-12-03 09:49:19 -08:00
Brian Lai
6dee38239d make our unit tests less brittle and not compare against messages out of our control (#20009)
* make our unit tests less brittle and not compare against messages out of our control

* testing text no more!
2022-12-01 19:55:08 -05:00
Octavia Squidington III
77112b02bf Bump Airbyte version from 0.40.22 to 0.40.23 (#19941)
Co-authored-by: davinchia <davinchia@users.noreply.github.com>
2022-11-30 20:02:24 +00:00
Julian
208f2ec931 ClickHouse destination doesn't have a logo #19283 (#19715) 2022-11-29 17:48:23 -03:00
Alexandre Girard
925b1139cf Exclude pyc files (#19835) 2022-11-28 17:44:04 -08:00
Octavia Squidington III
4c5d6ead94 Bump Airbyte version from 0.40.21 to 0.40.22 (#19687)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: lmossman <lake@airbyte.io>
2022-11-21 17:43:32 -08:00
Octavia Squidington III
8341076cb3 Bump Airbyte version from 0.40.20 to 0.40.21 (#19634)
Co-authored-by: krishnaglick <krishnaglick@users.noreply.github.com>
2022-11-18 20:39:06 -05:00
Octavia Squidington III
ed4ec64712 Bump Airbyte version from 0.40.19 to 0.40.20 (#19614)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2022-11-18 11:53:57 -08:00
Lake Mossman
d0860d4fd0 go back to concise connector builder server error messages (#19609) 2022-11-18 10:12:27 -08:00
Octavia Squidington III
061bce197a Bump Airbyte version from 0.40.18 to 0.40.19 (#19579)
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2022-11-18 00:26:01 -08:00
Lake Mossman
b0818b5184 Fix bumpversion for airbyte-connector-builder-server (#19577)
* fix bumpversion for airbyte-connector-builder-server

* add back newline
2022-11-17 23:01:01 -08:00
Lake Mossman
684fbff12f Enable the Connector Builder server in the platform (#19269)
* init

* bad copy/paste

* move to top level

* Revert "move to top level"

This reverts commit aca3534d38.

* attempt to wire up connector builder frontend to server

* copy from octaviacli

* fix connection to builder server

* update

* delete

* Update

* delete python-version

* Revert "delete python-version"

This reverts commit f9258a7755.

* setup python

* install python

* rename

* kube stuff

* Install python

* missing kube file

* rename

* Update files

* Update bumpversion

* install python

* try with different entrypoint

* rename container

* point to docker-compose.yaml file

* derp

* copy acceptance_test.sh

* copy from acceptance tests

* delete cruft

* update

* remove application env

* reset

* reset to master

* update

* skip comprehensive incremental tests

* Revert "skip comprehensive incremental tests"

This reverts commit 9cee657596.

* reset to master

* remove cruft

* readme

* readme

* save

* buncha stuff

* it works

* improvements

* comment

* codesnippet

* delete superfluous steps

* update port to 8003

* reset to master

* Update publish docker

* move openapi spec to airbyte-connector-builder

* point to openapi spec

* dont expose the connector builder to localhost

* reset FE components to master

* Don't deploy the connector-builder

* Revert "Don't deploy the connector-builder"

This reverts commit 3d157494cf.

* Revert "Revert "Don't deploy the connector-builder""

This reverts commit beac3d48f0.

* comment out more things related to connector builder server

* more attempts at removing the connector builder

* comment out more things

* Update airbyte-connector-builder/README.md

Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>

* fixes

* rename gradle task

* save

* copyright header

* Apply suggestions from code review

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Update airbyte-webapp/src/config/configProviders.ts

Co-authored-by: Lake Mossman <lake@airbyte.io>

* update

* rename

* indent

* Revert "move openapi spec to airbyte-connector-builder"

This reverts commit 57dda04723.

* Revert "rename"

This reverts commit b2d802b8fa.

* Revert "Revert "rename""

This reverts commit 91db24fd4a.

* point to wrong file in case it fixes the build

* point to right openapi file

* Revert "Revert "move openapi spec to airbyte-connector-builder""

This reverts commit e46a837454.

* point to moved file

* fix path

* Update from master

* newline

* Add failing test

* Revert "Add failing test"

This reverts commit ed9fea09b5.

* comment

* update commented requires

* Add a comment

* comments

* save

* formatting is for losers anyways

* pyproject

* toml

* toml

* saved

* nice

* anothaone

* fmt

* fixmypy

* fix autogen notice header location

* improvecomment

* save working branch

* fmt

* delete license and disable caching

* removeyaml

* fix merge and uncomment flakeCheck

* undo css change

* fix typo

* format

* enable CORS

* move template to backend server

* try adding connector builder server to 'generate-docker' task to see if it fixes CI

* try adding buildDockerImage task

* try adding gradle.properties

* Revert "try adding buildDockerImage task"

This reverts commit 2102009ddb.

* Revert "try adding connector builder server to 'generate-docker' task to see if it fixes CI"

This reverts commit 40b5ae0fcd.

* process detail in apiOverride

* fix gradle

* fix scrollbars

* Run connector builder server tests and static analysis from a docker container (#19495)

* Revert "try adding buildDockerImage task"

This reverts commit 2102009ddb.

* Revert "try adding connector builder server to 'generate-docker' task to see if it fixes CI"

This reverts commit 40b5ae0fcd.

* missing file

* build airbyte-connector-builder-server image

* Add .

* comment

* build connector builder server as part of octavia_cli

* build connector builder too

* patch

* missing file

* comment

* comment

* run unit tests in a container

* Run integration tests

* run

* move to platform build

* format

* rootdir

* get the path from the project

* Update

* pyproject

* delete a bunch of code

* parameterize

* run tests

* update

* rename

* comment

* reset

* uncomment

* dont format

* run everything except isort

* delete dead code

* Revert "delete dead code"

This reverts commit b11df716a0.

* comment

* Update module

* reset to master

* mount in home

* commit formatted files

* try running format

* Better comment

* reset

* Revert "reset"

This reverts commit 20808f8262.

* Update buildSrc/src/main/groovy/airbyte-python-docker.gradle

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* comment

* Add everything except build and hidden directories

* symlink

* Update airbyte-connector-builder-server/run_format.sh

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update airbyte-connector-builder-server/run_tests.sh

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: sherifnada <snadalive@gmail.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
2022-11-17 19:44:45 -08:00
Brian Lai
86eb221cab add some tests for manifests with references and some additional invalid test cases and error handling refinement (#19528)
* add some tests for manifests with references and some additional invalid test cases and error handling refinement

* pr feedback to use str

* remove print
2022-11-17 16:47:10 -05:00
Lake Mossman
25edce4a04 fix indentation of manifest template (#19523) 2022-11-16 17:26:34 -08:00
Brian Lai
23679f5b41 instantiate a declarative connector and allow for reads to be invoked from the connector builder server (#19333)
* instantiate a declarative connector and allow for reads to be invoked from the connector builder server

* various pr feedback and cleaning up the code a bit

* refactor grouping logic into a separate function to illustrate how groups are being emitted

* fix the webapp to also pass config to the stream list endpoint

* fix dereference field

* replace error message handling with default FastAPI HTTPException

* pr feedback: more error messaging and some code reuse

* formatting

* regenerate open api spec
2022-11-15 12:15:58 -05:00
Brian Lai
b52caa0d81 Add the /manifest_template endpoint to return a string representation of the manifest template (#19367)
* return a string representation of the manifest template

* get rid of extra template

* add a comment
2022-11-14 18:40:50 -05:00
Sherif A. Nada
3421c7ee56 Fix clobbered connector-builder-server directories (#19273) 2022-11-09 21:23:28 -08:00
Sherif A. Nada
125f35f8df Generate spec-first FastAPI Server (#18886) 2022-11-09 18:14:38 -08:00
Alexandre Girard
64b50adfdd Connector-builder server stub (#18410)
* init

* bad copy/paste

* move to top level

* Revert "move to top level"

This reverts commit aca3534d38.

* attempt to wire up connector builder frontend to server

* copy from octaviacli

* fix connection to builder server

* update

* delete

* Update

* delete python-version

* Revert "delete python-version"

This reverts commit f9258a7755.

* setup python

* install python

* rename

* kube stuff

* Install python

* missing kube file

* rename

* Update files

* Update bumpversion

* install python

* try with different entrypoint

* rename container

* point to docker-compose.yaml file

* derp

* copy acceptance_test.sh

* copy from acceptance tests

* delete cruft

* update

* remove application env

* reset

* reset to master

* update

* skip comprehensive incremental tests

* Revert "skip comprehensive incremental tests"

This reverts commit 9cee657596.

* reset to master

* remove cruft

* delete superfluous steps

* update port to 8003

* reset to master

* Update publish docker

* move openapi spec to airbyte-connector-builder

* point to openapi spec

* dont expose the connector builder to localhost

* reset FE components to master

* Don't deploy the connector-builder

* Revert "Don't deploy the connector-builder"

This reverts commit 3d157494cf.

* Revert "Revert "Don't deploy the connector-builder""

This reverts commit beac3d48f0.

* comment out more things related to connector builder server

* more attempts at removing the connector builder

* comment out more things

* Apply suggestions from code review

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Update airbyte-webapp/src/config/configProviders.ts

Co-authored-by: Lake Mossman <lake@airbyte.io>

* update

* rename

* indent

* Revert "move openapi spec to airbyte-connector-builder"

This reverts commit 57dda04723.

* Revert "rename"

This reverts commit b2d802b8fa.

* Revert "Revert "rename""

This reverts commit 91db24fd4a.

* point to wrong file in case it fixes the build

* point to right openapi file

* Revert "Revert "move openapi spec to airbyte-connector-builder""

This reverts commit e46a837454.

* point to moved file

* fix path

* Update from master

* newline

* Add failing test

* Revert "Add failing test"

This reverts commit ed9fea09b5.

* comment

* update commented requires

* Add a comment

* 2022

* rename to connector-builder-server

* typo

Co-authored-by: lmossman <lake@airbyte.io>
2022-11-09 13:07:26 -08:00