jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-28 19:01:58 -05:00
Code Issues Packages Projects Releases Wiki Activity
9,635 Commits 5,416 Branches 518 Tags
e414595e412d69645f01d577c7b666e0c61686b7
Commit Graph

18 Commits

Author SHA1 Message Date
Jimmy Ma
094aff1520 Java connectors use protocol v0 objects (#20404) 
* Dupl v0 objects

* v0 namespace swap

* Introduce some object conversions in the tests

* Update source-java-jdbc template

* Use v0 objects in db-lib

* Fix more protocol object references

* Fix arg capture in tests
 2022-12-15 13:39:50 -08:00
Andrii Leonets
39c8801169 Extend template for the Java JDBC template by SAT SPEC (#19660) 
* extend template for the Java JDBC template by SAT SPEC

* extend example source scaffold-java-jdbc

* review upd

* add other SAT tests to the template

* review upd

* comment non-spec tests

* Revert "comment non-spec tests"

This reverts commit 8c78049fd9.

* Revert "add other SAT tests to the template"

This reverts commit c15b4dcd87.

* review

* review

* typo

* typo

* new line
 2022-12-06 17:36:35 +02:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585) 
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
 2022-10-11 11:04:23 -04:00
Augustin
4df0a48427 cdk and docs: remove "additionalProperties" (#14881) 2022-07-22 15:34:27 +02:00
Denis Davydov
426e9594cb fix build: run gradlew format (#13265) 
* fix build: run gradlew format

* Revert "fix build: run gradlew format"

This reverts commit e679b4f26f.

* fix connector template to fix the build
 2022-05-27 17:36:43 +03:00
LiRen Tu
35f2aa9aed 🎉 Jdbc sources: publish new version with adaptive fetch size (#12480) 
* Default scaffold to use adaptive streaming config

* Switch more connectors to use adaptive streaming config

* Bump version for cockroach db

* Bump version for db2

* Bump mssql version

* Bump mysql version

* Bump oracle version

* Bump postgres version

* Bump redshift version

* Bump snowflake version

* Bump tidb version

* auto-bump connector version

* Fix db2 findbug issue

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* Fix more findbug issues

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* Fix findbug issue for mysql-strict-encrypt

* Fix findbugs issue for oracle source

* auto-bump connector version

* Remove suppress warnings annotation

* Fix oracle encrypt tests

* Fix oracle encrypt acceptance test

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-04-29 23:14:58 -07:00
LiRen Tu
55a0db7c67 🎉 JDBC source: adjust streaming query fetch size dynamically (#12400) 
* Merge all streaming configs to one

* Implement new streaming query config

* Format code

* Fix comparison

* Use double for mean byte size

* Update fetch size only when changed

* Calculate mean size by sampling n rows

* Add javadoc

* Change min fetch size to 1

* Add comment by buffer size

* Update java connector template

* Perform division first

* Add unit test for fetching large rows

* Format code

* Fix connector compilation error
 2022-04-28 22:36:17 -07:00
LiRen Tu
c873898f47 Fix datamodel_code_generator exception in connector build (#9894) 
* Try python 3.7

* Use black 21.12b0

* Add comment

* Update comment

* Remove unused imports from template
 2022-01-29 22:08:56 -08:00
Noah Kawasaki
5391880f7a 🎉 Source and Destination Snowflake: Add jdbc_url_params support for optional JDBC parameters (#9623) 2022-01-28 22:07:12 +01:00
LiRen Tu
e4661fb92a Remove regex check from Java source acceptance test (#9829) 
* Move getRegexTests to python source acceptance test

* Remove unused imports

* Update test template
 2022-01-26 17:51:37 -08:00
LiRen Tu
6843bc1d1f 🎉 Source MySQL: support all MySQL 8.0 types (#7970) 
* Add jdbc compatible layer

* Support routine mysql types

* Format code

* Fix build

* Refactor abstract jdbc source and operation classes

* Update mysql source operations

* Test discover command for mysql

* Remove abstract jdbc compatible source layer

* Format code

* Update template

* Fix more types

* Bump version

* Log original field type

* Update comments

* Bump version in seed
 2021-12-11 21:49:32 -08:00
Christophe Duong
27df558a89 🎉 BigQuery destinations with partitionned/clustered keys (#7240) 
* [ #5959 ][ #2579 ] Add support of partitioned tables by _airbyte_emitted_at field (#7141)

Co-authored-by: Andrés Bravo <andresbravog@gmail.com>
 2021-10-25 12:41:04 +02:00
Charles
ba44f700b9 add final for params, local variables, and fields (#7084) 2021-10-15 16:41:04 -07:00
Marcos Marx
10434372de Change license in connector generator base files (#6522) 
* change license in generator base files

* run gradlew scaffold

* format eof

* add eof singer base

* remove license from test_* http source

* format test_incremental http source
 2021-09-29 04:45:42 -03:00
Jared Rhizor
fb902dcc2e fix mysql doc link / scaffold links (#4956) 2021-07-29 23:00:04 -07:00
Andrii Leonets
107f5b8d61 🎉 Abstract level for SQL relational database sources (#4123) 
Abstract level for SQL relational database sources
 2021-07-05 17:18:07 +03:00
Andrii Leonets
6fb1b9ba84 🐛 Fix ScaffoldJavaJdbcSourceAcceptanceTest template (#4132) 
* Fix ScaffoldJavaJdbcSourceAcceptanceTest template

* Update exception signature
 2021-06-15 08:57:44 -07:00
etsybaev
eec3e03ddb 🎉 Added JDBC source connector bootstrap template (#3819) 
* [3560] Added JDBC source connector bootstrap template
 2021-06-08 21:04:10 +03:00