jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-22 19:01:47 -05:00
Code Issues Packages Projects Releases Wiki Activity
9,635 Commits 5,372 Branches 518 Tags
e414595e412d69645f01d577c7b666e0c61686b7
Commit Graph

418 Commits

Author SHA1 Message Date
Anne
e7cc086394 Turn on auto-detect schema env variable (#21814) 
* Turn on auto-detect schema env variable
Co-authored-by: Edmundo Ruiz Ghanem <168664+edmundito@users.noreply.github.com>
 2023-01-25 13:39:15 -08:00
Davin Chia
053ea74b28 Use the right label. (#21829) 
Part of 54c0ef1 switched the job labels from worker-pod to job-pod.

This PR also updates the pod-sweeper to use these labels. With the wrong label, the pod sweeper was not sweeping the right pods.
 2023-01-25 09:54:36 +08:00
Octavia Squidington III
b9de100058 Bump Airbyte version from 0.40.28 to 0.40.29 (#21767) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2023-01-23 23:22:45 -08:00
Octavia Squidington III
02e0258948 Bump Airbyte version from 0.40.27 to 0.40.28 (#21359) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2023-01-12 16:47:07 -08:00
Benoit Moriceau
9adb63cc0b Revert "Revert Convert the server to micronaut" (#21133) 
* Revert "Revert "Convert the server to micronaut (#19194)" (#21132)"

This reverts commit 31c65f8eea.

* Fix the cors

* Fix cloud
 2023-01-09 10:52:19 -08:00
Octavia Squidington III
00fb4bba09 Bump Airbyte version from 0.40.26 to 0.40.27 (#21135) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2023-01-06 14:27:01 -08:00
Benoit Moriceau
31c65f8eea Revert "Convert the server to micronaut (#19194)" (#21132) 
This reverts commit 0b153d11f9.
 2023-01-06 15:08:22 -06:00
Benoit Moriceau
0b153d11f9 Convert the server to micronaut (#19194) 
* Extract Operation API

* Extract scheduler API

* Format

* extract source api

* Extract source definition api

* Add path

* Extract State API

* extract webbackend api

* extract webbackend api

* extract workspace api

* Extract source definition specification api

* Remove configuration API

* tmp

* Checkstyle

* tmp

* tmp

* Inject but don't resolve Bean

* tmp

* Tmp

* fix build

* TMP

* Tmp

* Clean up

* better thread pool

* Change port to 8080

* Fix port

* Rm unused

* Cors filter

* Format

* rename

* Tmp

* Config based

* Rm health controller ref

* tmp

* Pool size

* Mock healthcheck

* Revert "Mock healthcheck"

This reverts commit 466677636b.

* Revert "Revert "Mock healthcheck""

This reverts commit 267094ae14.

* Restore health check

* Tmp

* format

* Rm deprecated

* Fix PMD

* Tmp

* Fix proxy test

* Remove useless annotation

* set auto commit as false

* Clean up and PR comments

* Bmoric/convert attempt micronaut (#19847)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* Comments and banner

* Non related files

* rm tmp

* Fix build

* Format

* Hit the micronaut server directly

* micronaut OperationApiController (#20270)

* micronaut OperationApiController

* pass micronaut client to OperationApi

* Bmoric/convert connection micronaut (#20211)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* tmp

* Convert Connection Api Controller

* PR Comments

* convert openapiapicontroller to micronaut (#20258)

* convert openapiapicontroller to micronaut

* merge health/openapi locations into one entry

* Fix build

* Format

* Remove media type

* Format

Co-authored-by: Cole Snodgrass <cole@airbyte.io>

* Bmoric/convert destination controller micronaut (#20269)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* tmp

* Convert Connection Api Controller

* Tmp

* PR Comments

* convert openapiapicontroller to micronaut (#20258)

* convert openapiapicontroller to micronaut

* merge health/openapi locations into one entry

* Fix bean

* Add JsonSchemaValidator as a Bean

* Fix build

* Format

* Format

* Test fix

* Pr comments

* Remove media type

* Format

* Remove media type

* Format

* format

* Add missing airbyte api client

Co-authored-by: Cole Snodgrass <cole@airbyte.io>

* Bmoric/convert destination definition controller micronaut (#20277)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* tmp

* Convert Connection Api Controller

* Tmp

* PR Comments

* convert openapiapicontroller to micronaut (#20258)

* convert openapiapicontroller to micronaut

* merge health/openapi locations into one entry

* Fix bean

* Add JsonSchemaValidator as a Bean

* Fix build

* Format

* Format

* Test fix

* Pr comments

* Remove media type

* Format

* Remove media type

* Format

* Remove media type

* Format

* api client

* missing annotation

* format

Co-authored-by: Cole Snodgrass <cole@airbyte.io>

* convert StateApiController to Micronaut (#20329)

* convert to micronaut

* nginx updates

* format

* Move dest oauth to micronaut (#20318)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* tmp

* Convert Connection Api Controller

* PR Comments

* convert openapiapicontroller to micronaut (#20258)

* convert openapiapicontroller to micronaut

* merge health/openapi locations into one entry

* Fix build

* Format

* Remove media type

* Format

* Move dest oauth to micronaut

* Pr comments

* format

Co-authored-by: Cole Snodgrass <cole@airbyte.io>

* Bmoric/convert source micronaut (#20334)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* tmp

* Convert Connection Api Controller

* PR Comments

* convert openapiapicontroller to micronaut (#20258)

* convert openapiapicontroller to micronaut

* merge health/openapi locations into one entry

* Fix build

* Format

* Remove media type

* Format

* Tmp

* tmp

* Build

* missing bean

* format

Co-authored-by: Cole Snodgrass <cole@airbyte.io>

* Migrate to micronaut (#20339)

* Migrate source to micronaut

* convert SchedulerApiController to Micronaut (#20337)

* wip; SchedulerApiController

* remove @Named

* remove @Singleton

* add back todo message

* Bmoric/convert source definition micronaut (#20338)

* tmp

* Fix build

* tmp

* Tmp

* tmp

* tmp

* Tmp

* tmp

* tmp

* Clean up

* tmp

* Convert Connection Api Controller

* PR Comments

* convert openapiapicontroller to micronaut (#20258)

* convert openapiapicontroller to micronaut

* merge health/openapi locations into one entry

* Fix build

* Format

* Remove media type

* Format

* Tmp

* tmp

* Build

* missing bean

* Tmp

* Add Beans

* fix Bean

* Add passthrough

* Clean up

* Missing path

* FIx typo

* Fix conflicts

* for mat

Co-authored-by: Cole Snodgrass <cole@airbyte.io>

* update SourceOauthApiController to Micronaut (#20386)

* convert SourceOauthApiController to Micronaut

* remove SourceOauthApi reference

* convert WorkspaceApiController to micronaut (#20214)

* wip; broken

* convert WorkspaceApiController to micronaut

* remove test controller

* format

* format

* add @Body to SourceOauthApiController

* consolidate nginx settings

* remove unnecessary factories

* Bmoric/convert jobs micronaut (#20382)

* Convert jobs to micronaut

* Nit

* Format

* Bmoric/convert source definition specification micronaut (#20379)

* Migrate source definition specifications to micronaut

* Format

* Format

* convert database assert call to Micronaut (#20406)

* remove dupe config section; add DatabaseEventListener

* move eventlistner to correct package; update implementation

* convert NotificationsApiController to Micronaut (#20396)

* convert NotificationsApiController to Micronaut

* format

* Migrate logs to micronaut (#20400)

* Bmoric/convert webbackend micronaut (#20403)

* Convert jobs to micronaut

* Nit

* Format

* Migrate the webbackend to micronaut

* Add missing Bean

* Cleanup (#20459)

* Cleanup

* More cleanup

* Disable in order to test cloud

* Restore missing files

* Fix test

* Format and fix pmd

* Add transactional

* Fix version

* Tentative

* Cleanup the cleanup

* Rm reference to the micronaut server

* format

* pmd

* more pmd

* fix build

* Delete logs API

* Revert "Delete logs API"

This reverts commit fcb271dcdf.

* Rm flaky test

* Format

* Try to fix test

* Format

* Remove optional

* Rm import

* Test sleep

* Simplify injection

* update import

* Remove sleep

* More injection

* Remove more requirement

* imports

* Remove more requirement

* Fix yaml

* Remove unused conf

* Add role

* Test acceptance test

* Update env

* Revert "Update to Micronaut 3.8.0 (#20716)"

This reverts commit a28f93747f.

* Update helm chart

* Fix helm chart

* Convert Application Listener

* Format

* Add explicit deployment mode

* Change check port

* Update version and bump version to the right value

* Cleanup

* Update FE end to end test

* Allow head request

* Fix controller

* Format

* Fix http client Bean

* Format

Co-authored-by: Cole Snodgrass <cole@airbyte.io>
 2023-01-06 11:04:03 -08:00
Octavia Squidington III
27bd807fd1 Bump Airbyte version from 0.40.25 to 0.40.26 (#20630) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2022-12-18 15:54:55 -08:00
Rose Hooper
3a8f47ea05 switch temporal to airbyte/temporal-auto-start:1.13.0 in chart values - works with amd64/arm64 (#18736) 
* switch temporal to 1.13.4 in chart values - works with amd64/arm64

* fix: use airbyte/temporal-auto-setup:1.13.0

* Update kustomization.yaml

* Update kustomization.yaml

* Update on-deploying.md

Co-authored-by: Kyryl Skobylko <xpuska513@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-12-15 14:28:11 -03:00
Conor
e7c3fbf62d restore containerOrchestrator image value (#20313) 
* Revert "fix: remove unused CONTAINER_ORCHESTRATOR_ENABLED var (#20261)"

This reverts commit ce29361b55.

* docs: add additional commentary on flag usage
 2022-12-12 18:06:47 -06:00
Octavia Squidington III
f5e15dee77 Bump Airbyte version from 0.40.24 to 0.40.25 (#20279) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2022-12-08 17:30:50 -08:00
Conor
ce29361b55 fix: remove unused CONTAINER_ORCHESTRATOR_ENABLED var (#20261) 
* fix: remove unused CONTAINER_ORCHESTRATOR_ENABLED var
 2022-12-08 16:27:28 -06:00
Octavia Squidington III
1581821930 Bump Airbyte version from 0.40.23 to 0.40.24 (#20206) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2022-12-07 15:44:56 -08:00
Octavia Squidington III
77112b02bf Bump Airbyte version from 0.40.22 to 0.40.23 (#19941) 
Co-authored-by: davinchia <davinchia@users.noreply.github.com>
 2022-11-30 20:02:24 +00:00
Anne
14a29a0542 Auto Detect Schema Change environment variable (#19312) 
* auto detect schema environment variable
 2022-11-28 09:57:41 -08:00
Octavia Squidington III
4c5d6ead94 Bump Airbyte version from 0.40.21 to 0.40.22 (#19687) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
Co-authored-by: lmossman <lake@airbyte.io>
 2022-11-21 17:43:32 -08:00
Alexandre Girard
47bf2b049c Add connector builder server to airbyte proxy, kube overlays, and helm charts (#19554) 2022-11-21 15:07:13 -08:00
Octavia Squidington III
8341076cb3 Bump Airbyte version from 0.40.20 to 0.40.21 (#19634) 
Co-authored-by: krishnaglick <krishnaglick@users.noreply.github.com>
 2022-11-18 20:39:06 -05:00
Octavia Squidington III
ed4ec64712 Bump Airbyte version from 0.40.19 to 0.40.20 (#19614) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2022-11-18 11:53:57 -08:00
Octavia Squidington III
061bce197a Bump Airbyte version from 0.40.18 to 0.40.19 (#19579) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2022-11-18 00:26:01 -08:00
Anne
fdb96d0a63 Notifications Workflow (#18735) 
* notification workflow
 2022-11-15 13:58:30 -08:00
Alexandre Girard
64b50adfdd Connector-builder server stub (#18410) 
* init

* bad copy/paste

* move to top level

* Revert "move to top level"

This reverts commit aca3534d38.

* attempt to wire up connector builder frontend to server

* copy from octaviacli

* fix connection to builder server

* update

* delete

* Update

* delete python-version

* Revert "delete python-version"

This reverts commit f9258a7755.

* setup python

* install python

* rename

* kube stuff

* Install python

* missing kube file

* rename

* Update files

* Update bumpversion

* install python

* try with different entrypoint

* rename container

* point to docker-compose.yaml file

* derp

* copy acceptance_test.sh

* copy from acceptance tests

* delete cruft

* update

* remove application env

* reset

* reset to master

* update

* skip comprehensive incremental tests

* Revert "skip comprehensive incremental tests"

This reverts commit 9cee657596.

* reset to master

* remove cruft

* delete superfluous steps

* update port to 8003

* reset to master

* Update publish docker

* move openapi spec to airbyte-connector-builder

* point to openapi spec

* dont expose the connector builder to localhost

* reset FE components to master

* Don't deploy the connector-builder

* Revert "Don't deploy the connector-builder"

This reverts commit 3d157494cf.

* Revert "Revert "Don't deploy the connector-builder""

This reverts commit beac3d48f0.

* comment out more things related to connector builder server

* more attempts at removing the connector builder

* comment out more things

* Apply suggestions from code review

Co-authored-by: Lake Mossman <lake@airbyte.io>

* Update airbyte-webapp/src/config/configProviders.ts

Co-authored-by: Lake Mossman <lake@airbyte.io>

* update

* rename

* indent

* Revert "move openapi spec to airbyte-connector-builder"

This reverts commit 57dda04723.

* Revert "rename"

This reverts commit b2d802b8fa.

* Revert "Revert "rename""

This reverts commit 91db24fd4a.

* point to wrong file in case it fixes the build

* point to right openapi file

* Revert "Revert "move openapi spec to airbyte-connector-builder""

This reverts commit e46a837454.

* point to moved file

* fix path

* Update from master

* newline

* Add failing test

* Revert "Add failing test"

This reverts commit ed9fea09b5.

* comment

* update commented requires

* Add a comment

* 2022

* rename to connector-builder-server

* typo

Co-authored-by: lmossman <lake@airbyte.io>
 2022-11-09 13:07:26 -08:00
Octavia Squidington III
b299688f3b Bump Airbyte version from 0.40.17 to 0.40.18 (#18827) 
Co-authored-by: grishick <grishick@users.noreply.github.com>
 2022-11-01 19:35:23 -07:00
Octavia Squidington III
73336ff4de Bump Airbyte version from 0.40.16 to 0.40.17 (#18316) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2022-10-21 14:00:39 -07:00
Octavia Squidington III
ce0bbf3f75 Bump Airbyte version from 0.40.15 to 0.40.16 (#18268) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
 2022-10-20 13:29:54 -07:00
Octavia Squidington III
a5a0409ad5 Bump Airbyte version from 0.40.14 to 0.40.15 (#17970) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-10-17 13:33:20 -07:00
Benoit Moriceau
7a71c55c1f Bmoric/remove dep server worker (#17894) 
* test [ci skip]

* Autogenerated files

* Add missing annotation

* Remove unused json2Schema block from worker

* Move tess

* Missing deps and format

* Fix test build

* TMP

* Add missing dependencies

* PR comments

* Tmp

* [ci skip] Tmp

* Fix acceptance test and add the seed dependency

* Fix build

* For diff

* tmp

* Build pass

* make the worker to be  on the platform only

* fix setting.yaml

* Fix pmd

* Fix Cron

* Add chart

* Fix cron

* Fix server build.gradle

* Fix jar conflict

* PR comments

* Add cron micronaut environemnt
 2022-10-17 12:35:04 -07:00
Octavia Squidington III
9cb32437e4 Bump Airbyte version from 0.40.13 to 0.40.14 (#17762) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-10-07 14:18:21 -07:00
Oleg Gusak
afbf400fa3 Kustomize: Missing NORMALIZATION_JOB_* environment variables in stable-with-resource-limits overlays (#17713) 
The `NORMALIZATION_JOB_MAIN_CONTAINER*` environment variables (introduced in f8ebd4f60c ) are missing in the `stable-with-resource-limits` k8s kustomize overlays which prevents `airbyte-worker` container from starting up. 
```
Error: couldn't find key NORMALIZATION_JOB_MAIN_CONTAINER_MEMORY_REQUEST in ConfigMap <>/airbyte-env-....
```
 2022-10-07 07:58:47 -03:00
Octavia Squidington III
e382a6e6db Bump Airbyte version from 0.40.12 to 0.40.13 (#17682) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2022-10-06 15:12:18 -07:00
Octavia Squidington III
71c8e3c062 Bump Airbyte version from 0.40.11 to 0.40.12 (#17653) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2022-10-05 18:25:09 -07:00
Pedro S. Lopez
69f53eb56a airbyte-cron: update connector definitions from remote (#16438) 
* add db connection injection to airbyte-cron

* load definitions

* fix patch version check for non-semver tags

* apply helper tests

* logging updates

* fix remote definitions provider: add tombstones

* docker compose env updates

* add test for tombstone presence

* rename helper class

* config updates

* dont use optionals as fields

* use apply helper instead of directly calling load data in bootloader

* avoid pmd warn

* add docstring

* sort docker compose env vars

* updates for javax -> jakarta

* clean up docker compose, update kube deployment env
 2022-10-05 17:21:37 -04:00
Octavia Squidington III
e333aa9365 Bump Airbyte version from 0.40.10 to 0.40.11 (#17610) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-10-05 08:35:39 -07:00
Jonathan Pearlin
759a27ec45 Use Micronaut auto-detected environment for docker vs kubernetes choices (#17388) 
* Use Micronaut auto-detected environment for docker vs kubernetes choices

* Handle set, but blank env var

* Formatting

* Revert change

* Add default value

* Explicitly set WORKER_ENVIRONMENT for container orchestrator

* Make public

* Add sleep to allow Temporal cache to populate

Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
 2022-10-04 15:14:13 -04:00
Benoit Moriceau
65a35b98bd Bmoric/clean applciation yml (#17353) 
* Cleanup application.yml

* Clean up cron application.yml and kube overlay

* Avoid flooding the logs with waiting for temporal namespace message

* Rm common app initializer

* Try to re-introduce an initializer
 2022-09-29 16:21:38 -07:00
Octavia Squidington III
1c40fe6644 Bump Airbyte version from 0.40.9 to 0.40.10 (#17359) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-09-28 17:09:25 -07:00
Jonathan Pearlin
0ace81637e Replace WorkerPlane with Micronaut environments (#17286) 
* Replace WorkerPlane with Micronaut environments

* Set proper environment for airbyte-workers
 2022-09-28 11:02:50 -04:00
Octavia Squidington III
8dfb8b0c92 Bump Airbyte version from 0.40.8 to 0.40.9 (#17093) 
Co-authored-by: terencecho <terencecho@users.noreply.github.com>
 2022-09-23 09:46:09 -05:00
Octavia Squidington III
387b96a924 Bump Airbyte version from 0.40.7 to 0.40.8 (#17009) 
Co-authored-by: gosusnp <gosusnp@users.noreply.github.com>
 2022-09-21 15:57:29 -07:00
Jonathan Pearlin
99d10c20d8 Fix issues with Micronaut and Kube acceptance tests (#16891) 
* Fix issues with Micronaut and Kube acceptance tests

* Defer default bean creation until actually needed
 2022-09-19 12:15:08 -04:00
Octavia Squidington III
607a7d68ff Bump Airbyte version from 0.40.6 to 0.40.7 (#16785) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-09-16 11:36:44 -07:00
Jonathan Pearlin
c8bec9e056 Add missing env var for Kube overlays (#16747) 
* Add missing env var for Kube overlays

* Set env var in kube resource file
 2022-09-14 15:32:45 -04:00
Octavia Squidington III
83799372cf Bump Airbyte version from 0.40.5 to 0.40.6 (#16656) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-09-13 11:56:33 -07:00
Valentin S
8a126e6329 Kustomize: adding missing WORKSPACE_ROOT env to avoid crashloop (#16630) 2022-09-13 13:09:51 -03:00
Octavia Squidington III
d8285cb24f Bump Airbyte version from 0.40.4 to 0.40.5 (#16610) 
Co-authored-by: alovew <alovew@users.noreply.github.com>
 2022-09-12 14:29:38 -07:00
Octavia Squidington III
abc01d3c49 Bump Airbyte version from 0.40.3 to 0.40.4 (#16275) 
Co-authored-by: timroes <timroes@users.noreply.github.com>
 2022-09-02 20:17:00 +02:00
letiescanciano
a9a1b61ef4 fix: Remove Fullstory leftovers (#16223) 2022-09-02 14:36:13 +03:00
Serhat Cillidag
0f045d652e Fix mismatch between container when setting limits (#16047) 
This was causing issues when generating manifest.
 2022-08-29 16:50:22 -03:00
Octavia Squidington III
9e17f97e24 Bump Airbyte version from 0.40.2 to 0.40.3 (#16028) 
Co-authored-by: zzztimbo <zzztimbo@users.noreply.github.com>
 2022-08-26 14:46:54 -07:00