jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-23 11:57:55 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,118 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

23 Commits

Author SHA1 Message Date
Xiaohan Song
c31dab84e9 [source-postgres] Reenable cat test (#44121) 2024-08-15 11:33:41 -07:00
Akash Kulkarni
a4544c106f [Source-postgres] : Adopt latest CDK (#43418) 
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
 2024-08-09 10:03:55 -07:00
Xiaohan Song
57a2623283 add final teardown in postgres CAT test (#42916) 2024-08-01 13:28:48 -07:00
Xiaohan Song
224db75b22 [source-postgres] CAT test for CDC postgres (#42107) 
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Dhroov Makwana <pabloescoder@gmail.com>
Co-authored-by: Audrey Maldonado <audrey.maldonado@gmail.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: maxi297 <maxime@airbyte.io>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Jeroen de Vries <jeroen@maildevries.eu>
Co-authored-by: prashant-mittal9 <168704883+prashant-mittal9@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: lazebnyi <lazebnyi@users.noreply.github.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Aldo Gonzalez <168454423+aldogonzalez8@users.noreply.github.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Anton Karpets <karpets.as@gmail.com>
Co-authored-by: askarpets <anton.karpets@globallogic.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Tim Werner <t.werner@comventure.de>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: James Truty <jtruty@gmail.com>
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Matias Samuel Miranda <matias.miranda@merantix-momentum.com>
Co-authored-by: Akash Kulkarni <akash@airbyte.io>
 2024-07-29 15:01:46 -07:00
Xiaohan Song
8bf87e807b [source-postgres]Non CDC CAT test for postgres (#41650) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: bgroff <bgroff@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Artem Inzhyyants <36314070+artem1205@users.noreply.github.com>
Co-authored-by: Dan Aronson <dan.ar27@gmail.com>
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: artem1205 <artem1205@users.noreply.github.com>
Co-authored-by: Antonio Papa <antoniogpapa@gmail.com>
Co-authored-by: Adam Marcus <marcua@marcua.net>
Co-authored-by: Bryce Groff <bgroff@hawaii.edu>
Co-authored-by: Patrick Nilan <nilan.patrick@gmail.com>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Catherine Noll <noll.catherine@gmail.com>
 2024-07-24 13:01:52 -07:00
Xiaohan Song
e1c1944e05 [source-postgres] add optional for all array schemabuilder (#41654) 2024-07-15 18:13:16 +00:00
Yue Li
b2846c03ec source-postgres: improve UI message and doc on xmin (#38848) 
The current recommendation for using xmin on the UI of the Postgres source connector is misleading; we want to say that the database is not experiencing a high transaction rate such that it is less likely to trigger xmin wraparound soon.

Added sections on the doc and troubleshooting page regarding Xmin as well.
 2024-06-04 16:06:23 -07:00
Xiaohan Song
b104667a0c Stream status on postgres (#38716) 
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
 2024-05-29 13:05:20 -07:00
Xiaohan Song
bb478d550a Attempt to fix flakiness (#36258) 2024-03-19 16:18:33 -07:00
Marius Posta
e606b77846 source-postgres: re-enable incremental SATs (#31306) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-10-19 11:30:01 -04:00
Akash Kulkarni
52520d01ce Migrate source-postgres-strict-encrypt logic into source-postgres and make it the default cloud image (#31486) 
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: akashkulk <akashkulk@users.noreply.github.com>
 2023-10-18 12:39:08 -07:00
Aaron ("AJ") Steers
d094b152c9 Java CDK 'no-op': v0.0.1 (#28687) 
Co-authored-by: aaronsteers <aaronsteers@users.noreply.github.com>
Co-authored-by: Conor <cpdeethree@users.noreply.github.com>
Co-authored-by: cpdeethree <conor@airbyte.io>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Joe Bell <joseph.bell@airbyte.io>
 2023-08-21 14:01:32 -05:00
Duy Nguyen
633c939d46 [Source-postgres] Set default cursor value for cdc mode (#27442) 
* use LSN as default cursor for postgres CDC

* Fixed static constant

* Set lsn default cursor value for postgres sync

* Bumped metadata and dockerfile versions

* Disable acceptance backwards compatibility discovery test as this is a breaking change

---------

Co-authored-by: Conor <cpdeethree@users.noreply.github.com>
 2023-07-13 11:12:34 -05:00
Subodh Kant Chaturvedi
a0b861aaa0 fix tests for postgres source (#23884) 2023-03-08 14:35:46 -06:00
Subodh Kant Chaturvedi
f6ec8769a3 DB sources cdc : upgrade Debezium version to 2.1.2 (#23112) 
* WIP

* remove wal2json

* revert test change

* working version for MySQL

* cleanup

* mssql changes

* rename module

* format

* undo unwanted change

* disable backward compatibility spec test

* fix acceptance-test-config.yml

* fix acceptance-test-config.yml

* update doc link

* fix mssql

* review comments

* master merge

* review comments

* disable few mssql tests

* temp commit for mssql tests experiment

* another temp commit

* another temp commit

* revert temp commits

* update test

* ssl support added for mssql cdc

* improve tests

* fix strict encrypt test

* make sql-server state backward compatible

* missed this one

* add error properties

* upgrade version and docs

* remove wal2json reference from docs

* auto-bump connector version

* add extra safety validation

* increase wait time

* auto-bump connector version

* update spec

---------

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-07 18:12:07 +05:30
Rodi Reich Zilberman
49f97f1142 Integration Branch for DB/DW Sources team for Feb '23 code freeze (#23185) 
* source-snowflake: use a safer method for parsing a BigInteger cursor value (#22358)

* use a safer method for parsing a BigInteger cursor value

* Add testing

* fix format change

* Fix failing integration tests

* Try removing the failing incremental test

* Try removing the failing incremental test

* Fix failing test

* Add metadata to connector logs (log level, class name, method name and line number) (#23105)

* Issue #17861 Add labels, class, method name and line numbers to connector logs

* Refactored unit test

* fix for warning about UTF8 charset in test class

---------

Co-authored-by: prateekmukhedkar <prateek@airbyte.io>

* Update docker image and release notes

* auto-bump connector version

* manually bump version on spec

---------

Co-authored-by: Prateek Mukhedkar <123108018+prateekmukhedkar@users.noreply.github.com>
Co-authored-by: prateekmukhedkar <prateek@airbyte.io>
Co-authored-by: Sergio Ropero <sergio@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-02-22 11:59:23 -08:00
Augustin
9d57772303 connector-acceptance-tests: support custom environment variables (#22937) 
* connector-acceptance-tests: support custom environment variables

* update postgres acceptance-test-config.yml
 2023-02-14 13:57:38 -06:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846) 
Rename source acceptance test to connector acceptance test
 2023-02-02 11:38:19 +01:00
Rodi Reich Zilberman
06ef1e90c6 source-postgres: enable SAT high test strictness level (#20549) 2023-01-04 09:08:43 +00:00
Andrii Leonets
58e4ef6912 Enable SPEC SAT for Java sources (#18779) 
* enable py spec compatibility tests

* add missing properties

* use expected spec file instead of the source spec.json + use dummy config file

* add missing files for the clickhouse

* move test files to the integration-test from the unit test folder

* add missing files to cockroachdb

* add missing files to db2 + fix spec format

* add missing files to elasticsearch + fix spec format

* add missing files to jdbc

* add missing files to mongodb_v2 + fix spec format

* add missing files to mssql + fix spec format

* add missing files to mysql + fix spec format

* add missing files to postgres + fix spec format

* add missing files to oracle + fix spec format

* add missing files to redshift

* add missing files to sftp

* add missing files to snowflake + fix spec format

* add missing files to tidb

* add missing files to kafka - fix spec format

* airbyte-source-acceptance-test added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* add missing import

* Delete acceptance-test-config.yml

* Delete acceptance-test-docker.sh

* Update build.gradle

* Update build.gradle

* format

* revert changes

* manual .sh files format

* upd expected spec

* format

* fix SAT after master merge

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-11-09 21:45:46 +02:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585) 
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
 2022-10-11 11:04:23 -04:00
LiRen Tu
825c35843a Fix documentation links (#5544) 2021-08-19 20:01:05 -07:00
Dmytro
7baefadbf9 Validate oneOf JSON Schema rules as part of connector Acceptance Test (#5242) 
* 3962: Add oneOf schema rules validation for acceptance test

* Add spec acceptance test for mssql and postgres connectors


Co-authored-by: Dmytro Rezchykov <dmitry.rezchykov@zazmic.com>
 2021-08-13 14:58:24 +03:00