jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-31 06:05:12 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,968 Commits 5,135 Branches 518 Tags
9f6963ccfcddd7a573c4ca0ff94de41ce6175cc0
Commit Graph

13 Commits

Author SHA1 Message Date
Augustin
fd3655707e connectors-ci: add finalize_build logic to handle custom Dockerfiles (#26489) 2023-05-25 09:32:19 +02:00
Edward Gao
7abda87840 destination bigquery: run normalization inside container if env var is set (#25097) 
* super hacky start

* also check that we're writing

* v0 convert normalization logs to airbytemessage

* add start+end logs

* aggregate errors into a single trace?

* pipefail; quick tweaks to log parser

* make spotbugs happy

* more comments, uncomment env var check

* copy in SentryExceptionHelper

* final fixes

* write tests + fix bugs

* move to base-java

* remove outdated comment

* fix spotbugs

* Automated Change

* minor version bump

* changelog

* fix behavior when env var not set

* run normalization even if destination fails

* better logic

* better logging

* oops

* move to base-java

* rebump version

* Automated Change

* auto-bump connector version

* wtf how did this work previously

* auto-bump connector version

---------

Co-authored-by: edgao <edgao@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-25 20:11:57 +00:00
oneshcheret
f6bcc4914f Postgres source: add integration with data dog (#21533) 
* Source postgres: add dd for env running locally

* Source postgres: add dd for running in cloud

* auto-bump connector version

* Source postgres: bump postgres strict-encrypt version

* Source postgres: filter datadog agent env variables just for postgres source

* Source postgres: format

* Source postgres: clean code

* Source postgres: pass java opts for all connectors

* Source postgres: temp removing dd agent from image

* Source postgres: add dd agent to image

* Source postgres: temp revert adding dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp hardcoded dd env variable

* Source postgres: temp removing hardcoded dd env variable

* Source postgres: temp added hardcoded dd env variable

* Source postgres: temp added hardcoded dd env variable

* Source postgres: temp added hardcoded dd env variable

* Source postgres: rename to java_opts and pass data dog host

* Source postgres: add vars to kube pods

* Source postgres: add vars to kube pods

* Source postgres: add vars to kube pods

* Source postgres: add Trace to more methods

* Source postgres: add Trace to more methods

* Source postgres: add Trace to more methods

* Source postgres: temp reverting service name removing

* Source postgres: temp reverting service name removing

* Source postgres: temp reverting service name removing

* Source postgres: temp adding trace to integration runner

* Source postgres: temp adding trace to integration runner

* Source postgres: bump postgres source dd version

* Source postgres: bump postgres source dd version

* Source postgres: revert temp changes

* Source postgres: merge with master

* Automated Commit - Formatting Changes

* Source postgres: move dd java agent to base java

* Source postgres: move dd java agent to base java

* Source postgres: clean up

* Source postgres: clean up

* Automated Change

* Source postgres: clean up

* Source postgres: bump version

* Source postgres: bump version for test

* Source postgres: temp bump version

* Source postgres: bump version

* Automated Change

* Source postgres: bump version

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: sashaNeshcheret <sashaNeshcheret@users.noreply.github.com>
 2023-03-21 22:16:09 +05:30
Volodymyr Pochtar
a142141c98 Revert "Revert "feat: replace openjdk with amazoncorretto:17.0.4 on connectors for seсurity compliance (#17511)" (#17820)" (#17833) 
This reverts commit e47c94ecff.
 2022-10-11 14:22:54 +03:00
Volodymyr Pochtar
e47c94ecff Revert "feat: replace openjdk with amazoncorretto:17.0.4 on connectors for seсurity compliance (#17511)" (#17820) 
This reverts commit ab71f5bc29.
 2022-10-11 11:58:01 +03:00
Volodymyr Pochtar
ab71f5bc29 feat: replace openjdk with amazoncorretto:17.0.4 on connectors for seсurity compliance (#17511) 2022-10-10 12:35:39 +03:00
George Claireaux
e88db7605a Remove legacy sentry code from java connectors (#14414) 
* remove a bunch of things

* removed the rest

* formatting
 2022-07-20 12:30:46 +01:00
Greg Solovyev
53e625a511 Bump mina-sshd from 2.7.0 to 2.8.0 (#12376) 
this is an attempt to merge the main change
from  https://github.com/airbytehq/airbyte/pull/11514,
which now has multiple conflicts.

The gist of the change

When creating a Postgres destination connector with SSH tunnel method 'SSH Key Authentication', one is required to provide a RSA key. Creating a rsa-sha2-256 or rsa-sha2-512 key, will result in the error SshException: KeyExchange signature verification failed for key type=ssh-rsa, if you haven't enabled ssh-rsa in the SSH server's host key algorithms.

mina-sshd in version 2.7.0 uses the wrong server key signature algorithm during DH group key exchange. https://issues.apache.org/jira/browse/SSHD-1163.

Bumping mina-sshd to version 2.8.0 addresses this issue. Changelog https://github.com/apache/mina-sshd/blob/master/docs/changes/2.8.0.md.
 2022-04-26 14:37:50 -07:00
Alexander Tsukanov
479f0d7c8d [MVP] Integrate sentry to all java-based connectors (#9745) 
* airbyte-9328: Added Sentry integration to BigQuery and BigQuery denormalized connector.

* airbyte-5050: Added strategy for INSERT ROW.

* airbyte-9328: Added Sentry integration to Snowflake.

* airbyte-9328: Fix Sentry config.

* airbyte-9328: Fixed PR comments.

* airbyte-9328: Fixed PR comments.

* airbyte-9328: Fix PR comments.

* airbyte-9328: Fixed PR comments.

* airbyte-9328: Fixed PR comments.

* airbyte-9328: Fixed PR comments.

* airbyte-9328: Small changes.

* airbyte-9328: Small changes.

* airbyte-9328: Move SENTRY DSN keys to Dockerfiles.

* Use new dsn

* Revert format

* Remove sentry dsn from compose temporarily

* Log sentry event id

* Move sentry to java base

* Remove sentry code from bigquery

* Update dockerfiles

* Fix build

* Update release tag format

* Bump version

* Add env to dockerfiles

* Fix e2e test connector dockerfil

* Fix snowflake bigquery dockerfile

* Mark new versions as unpublished

Co-authored-by: LiRen Tu <tuliren@gmail.com>
Co-authored-by: Liren Tu <tuliren.git@outlook.com>
 2022-01-29 16:58:35 -08:00
Jared Rhizor
25674fc306 upgrade to Gradle 7.3.1 / Java 17 (#7964) 
* upgrade gradle

* upgrade to Java 17 (and fix a few of the node versioning misses)

* oops

* try to run a different format version

* fix spotless by upgrading / reformatting some files

* fix ci settings

* upgrade mockito to avoid other errors

* undo bad format

* fix "incorrect" sql comments

* fmt

* add debug flag

* remove

* bump

* bump jooq to a version that has a java 17 dist

* fix

* remove logs

* oops

* revert jooq upgrade

* fix

* set up java for connector test

* fix yaml

* generate std source tests

* fail zombie job attempts and add failure reason (#8709)

* fail zombie job attempts and add failure reason

* remove failure reason

* bump gcp dependencies to pick up grpc update (#8713)

* Bump Airbyte version from 0.33.9-alpha to 0.33.10-alpha (#8714)

Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>

* Change CDK "Caching" header to "nested streams & caching"

* Update fields in source-connectors specifications: file, freshdesk, github, google-directory, google-workspace-admin-reports, iterable (#8524)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* move S3Config into destination-s3; update dependencies accordingly (#8562)

Co-authored-by: Lake Mossman <lake@airbyte.io>
Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Iryna Grankova <87977540+igrankova@users.noreply.github.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2021-12-10 16:57:54 -08:00
Harsha Teja Kanna
3e7f95c25a 🎉 Support build on MacOS M1 (Apple Silicon) (#7104) 
- See this doc for details: https://github.com/airbytehq/airbyte/blob/master/docs/contributing-to-airbyte/developing-locally.md
- Unit test does not work yet.
 2021-10-19 11:20:21 -07:00
Jared Rhizor
b4793b2510 add AIRBYTE_ENTRYPOINT for kubernetes support (#3973) 
* add AIRBYTE_ENTRYPOINT for kubernetes support

* bump versions

* bump version in seed

* Update generic template

* keep scaffold sources at 0.1.0

* add missing newline

* handle python base versions correctly

* re-bump mysql and postgres sources

* re-bump snowflake destination

* add skip tests option

* switch to running tests

* reverse conditional to make it safer

* fix publish to include the test running

* fix iterable version

* fix file generation

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-06-09 13:01:45 -07:00
Charles
31013556c3 Integrations Reorganization: Bases (#673) 2020-10-21 11:23:49 -07:00