jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-06 06:04:16 -05:00
Code Issues Packages Projects Releases Wiki Activity
8,493 Commits 5,163 Branches 518 Tags
6492eebd38d11ebfc5f3b2cf93960fc0be71bcd2
Commit Graph

257 Commits

Author SHA1 Message Date
andriikorotkov
350d5443a1 Add normalization to destination definition and actor definition table (#18300) 
* updated StandardDestinationDefinition.yaml, added normalization and tags to the destination_definition.yaml and added information about normalization and DBT to the ACTOR_DEFINITION table

* updated docs

* updated BootloaderAppTest.java for new migration

* updated schema dump

* Update normalization version and fix bigquery

* Use varchar 255

* Update migration version to the latest

* Update normalized table schema file and add comment

* Revert "Use varchar 255"

This reverts commit e182466e66.

* Use varchar 255

* Add unit test for migration

* Format code

Co-authored-by: Liren Tu <tuliren@gmail.com>
 2022-11-04 14:19:50 -07:00
Liren Tu
104c91c519 Fix migration dev center schema dump by run db-specific initialization script (#18984) 
* Run db-specific initialization script

* Refactor code

* Use constants

* Add unit test for dev center
 2022-11-04 13:28:54 -07:00
Jimmy Ma
74792c1336 Add unsupported_protocol_version column to Connection (#18876) 2022-11-02 16:43:16 -07:00
Octavia Squidington III
b299688f3b Bump Airbyte version from 0.40.17 to 0.40.18 (#18827) 
Co-authored-by: grishick <grishick@users.noreply.github.com>
 2022-11-01 19:35:23 -07:00
Charles
87a0a2a27c hide ConfigPersistence inside ConfigRepository to discourage use (#18803) 2022-11-01 16:51:09 -07:00
Charles
20ab047ae0 Remove the bulk actions from ConfigPersistence (#18800) 2022-11-01 16:50:03 -07:00
Charles
c9988c4db8 remove config persistence from seeding logic (#18749) 2022-11-01 16:48:01 -07:00
Charles
ebb912666e Remove ConfigPersistence usage from SecretsMigrator (#18747) 2022-11-01 15:59:29 -07:00
Jonathan Pearlin
657f997aae Update to latest Temporal SDK release (#18492) 2022-10-26 12:54:00 -04:00
Octavia Squidington III
73336ff4de Bump Airbyte version from 0.40.16 to 0.40.17 (#18316) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2022-10-21 14:00:39 -07:00
Octavia Squidington III
ce0bbf3f75 Bump Airbyte version from 0.40.15 to 0.40.16 (#18268) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
 2022-10-20 13:29:54 -07:00
Octavia Squidington III
a5a0409ad5 Bump Airbyte version from 0.40.14 to 0.40.15 (#17970) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-10-17 13:33:20 -07:00
Pedro S. Lopez
908f3949d2 remove usages of YamlSeedConfigPersistence (#17895) 2022-10-13 10:28:40 -04:00
Michael Siega
490f0ca241 Introduce secrets management into workspace persistence (#17851) 
* no-op refactor: rename getStandardWorkspace to prepare to introduce secrets

* no-op refactor: rename writeStandardWorkspace to prepare to introduce secrets

* introduce secrets management into workspace persistence
 2022-10-12 16:07:57 +02:00
Jonathan Pearlin
246172bd6c Use the Airbyte Base Java Image for all services (#17843) 
* Use the Amazon Corretto based base image for all services

* Add comment

* Use airbyte-base-java-image
 2022-10-12 08:59:02 -04:00
Xiaohan Song
fbead4d7d1 Add a new column in attempts table (#17806) 
* migration attempts

* migrator script

* version fix
 2022-10-11 11:27:53 -07:00
Parker Mossman
fb9efb378d Add Workspace and Connection Geography Support to API (#17650) 
* progress on adding geography throughout api

* fix workspace handler test

* more progress

* implement workspace defaulting and add/update more tests

* fix bootloader tests

* set defaultGeography in missing places

* add Geography column when reading Connection record from DB

* fix pmd

* add more comments/description

* format

* description
 2022-10-10 13:34:19 -07:00
Michael Siega
7009bbeb82 db migrations to support new webhook operations (#17671) 2022-10-08 00:04:01 +02:00
Octavia Squidington III
9cb32437e4 Bump Airbyte version from 0.40.13 to 0.40.14 (#17762) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-10-07 14:18:21 -07:00
Anne
b22a4399c8 Add connection migrations for schema changes (#17651) 2022-10-07 13:28:11 -07:00
Octavia Squidington III
e382a6e6db Bump Airbyte version from 0.40.12 to 0.40.13 (#17682) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2022-10-06 15:12:18 -07:00
Octavia Squidington III
71c8e3c062 Bump Airbyte version from 0.40.11 to 0.40.12 (#17653) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2022-10-05 18:25:09 -07:00
terencecho
a7a1c7f916 Create geography_type enum and add geography column in connection and workspace table (#16818) 
* init commit of geography_type and column

* add schema dump

* confirm prod database was meant to be changed

* add AUTO to geography

* set default and not nullable, also edit workspace table

* update version number

* update schema dump

Co-authored-by: pmossman <parker@airbyte.io>
 2022-10-05 14:39:25 -07:00
Pedro S. Lopez
69f53eb56a airbyte-cron: update connector definitions from remote (#16438) 
* add db connection injection to airbyte-cron

* load definitions

* fix patch version check for non-semver tags

* apply helper tests

* logging updates

* fix remote definitions provider: add tombstones

* docker compose env updates

* add test for tombstone presence

* rename helper class

* config updates

* dont use optionals as fields

* use apply helper instead of directly calling load data in bootloader

* avoid pmd warn

* add docstring

* sort docker compose env vars

* updates for javax -> jakarta

* clean up docker compose, update kube deployment env
 2022-10-05 17:21:37 -04:00
Octavia Squidington III
e333aa9365 Bump Airbyte version from 0.40.10 to 0.40.11 (#17610) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-10-05 08:35:39 -07:00
Charles
1e2f701fe7 remove import / export handler (#16403) 2022-09-29 16:24:49 -07:00
Jimmy Ma
4974855b41 Track protocol version support range (#17366) 
* Add Airbyte Protocol Range configs

* Refactor metadata read/write

* Add ProtocolVersion Min/Max get/set to JobsPersistence

* Store the supported protocol version range in airbyte_metadata

* Use defaults in EnvConfigs instead of .env
 2022-09-29 09:43:16 -07:00
Octavia Squidington III
1c40fe6644 Bump Airbyte version from 0.40.9 to 0.40.10 (#17359) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-09-28 17:09:25 -07:00
Octavia Squidington III
8dfb8b0c92 Bump Airbyte version from 0.40.8 to 0.40.9 (#17093) 
Co-authored-by: terencecho <terencecho@users.noreply.github.com>
 2022-09-23 09:46:09 -05:00
Octavia Squidington III
387b96a924 Bump Airbyte version from 0.40.7 to 0.40.8 (#17009) 
Co-authored-by: gosusnp <gosusnp@users.noreply.github.com>
 2022-09-21 15:57:29 -07:00
Cole Snodgrass
c6519430da move job persistence code out of airbyte-scheduler (#16831) 
* wip for moving scheduler-persistence to airbyte-persistence

* move main/resources

* move settings include to match existing includes

* fix incorrect import paths

* fix import order
 2022-09-20 13:37:35 -07:00
Volodymyr Pochtar
a72cb7d1f8 feat: replace openjdk with amazoncorretto:17.0.4 on platform for security compliance (#16919) 2022-09-20 19:01:48 +03:00
Octavia Squidington III
607a7d68ff Bump Airbyte version from 0.40.6 to 0.40.7 (#16785) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-09-16 11:36:44 -07:00
Anne
e462f695a2 Normalization Summaries table and read/write methods (#16655) 
* Add migration to create normalization summaries table
- read/write methods for normalization summary
 2022-09-14 14:47:05 -07:00
Octavia Squidington III
83799372cf Bump Airbyte version from 0.40.5 to 0.40.6 (#16656) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-09-13 11:56:33 -07:00
Octavia Squidington III
d8285cb24f Bump Airbyte version from 0.40.4 to 0.40.5 (#16610) 
Co-authored-by: alovew <alovew@users.noreply.github.com>
 2022-09-12 14:29:38 -07:00
Evan Tahler
834ac1a3bb Remove shared getDockerBuildTask to enable parallel docker builds (#16384) 
Define logic in root build.gradle to create a task in each subproject if the subproject contains dockerImageName in the gradle.properties file.

Some caveats:
- We also define a copyGeneratedTar task that is applied to all subprojects with the dockerImageName property.
- This does not need to be used in each subproject. We leave it up to each subproject to define what task is depends on since some projects have more custom copy logic.
 2022-09-09 18:40:35 -07:00
Anne
3fc673090d Populate and read from SyncStats table (#16476) 
- Populate sync stats table when job is complete
- Method to read from sync stats table
 2022-09-08 22:33:29 -07:00
Anne
4ef54ad62f Sync stats migration (#16285) 
* Sync stats migration
 2022-09-07 12:07:56 -07:00
Octavia Squidington III
abc01d3c49 Bump Airbyte version from 0.40.3 to 0.40.4 (#16275) 
Co-authored-by: timroes <timroes@users.noreply.github.com>
 2022-09-02 20:17:00 +02:00
Pedro S. Lopez
d83abd6672 Remove foreign key constraint for actor_definition_id in actor_oauth_param (#16118) 
* add migration

* fmt

* test migration

* update expected migration version

* update schema

* allow specifying a target migration version for the baseline

* run previous migrations in test

* fix pmd

* update migration version
 2022-09-01 13:38:30 -04:00
Anne
827e7a55ac Add protocol version migration (#16145) 
* Add protocol version migration
 2022-08-31 16:01:24 -07:00
Octavia Squidington III
9e17f97e24 Bump Airbyte version from 0.40.2 to 0.40.3 (#16028) 
Co-authored-by: zzztimbo <zzztimbo@users.noreply.github.com>
 2022-08-26 14:46:54 -07:00
Octavia Squidington III
b7b18dfcc0 Bump Airbyte version from 0.40.1 to 0.40.2 (#15931) 
Co-authored-by: lmossman <lmossman@users.noreply.github.com>
 2022-08-24 11:02:50 -07:00
Evan Tahler
381326f4d3 Bump Airbyte version from 0.40.0-alpha to 0.40.1 (#15857) 2022-08-22 14:34:17 -07:00
Evan Tahler
4774949ab0 Remove -alpha tags from Airbyte release versions (#15766) 
* Remove alpha tags in autobump files

* remove more alpha tags
 2022-08-22 11:06:49 -07:00
Octavia Squidington III
c1a0cbc0d0 Bump Airbyte version from 0.39.42-alpha to 0.40.0-alpha (#15493) 
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
 2022-08-10 10:20:12 +08:00
Anne
e9afa9bef3 Error Prone PMD rules (#15010) 
* Implement ErrorProne PMD rules:
AssignmentInOperand
AvoidAccessibilityAlteration
AvoidBranchingStatementAsLastInLoop
AvoidCatchingNPE
AvoidCatchingThrowable
AvoidDuplicateLiterals rule
 2022-08-09 15:30:48 -07:00
Octavia Squidington III
5031e72426 Bump Airbyte version from 0.39.41-alpha to 0.39.42-alpha (#15335) 
Co-authored-by: xiaohansong <xiaohansong@users.noreply.github.com>
Co-authored-by: Xiaohan Song <xiaohan@airbyte.io>
 2022-08-05 14:43:31 -07:00
Octavia Squidington III
3d5237cdaf Bump Airbyte version from 0.39.40-alpha to 0.39.41-alpha (#15085) 
Co-authored-by: girarda <girarda@users.noreply.github.com>
 2022-07-27 14:07:53 -07:00