jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-22 19:38:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,117 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

1127 Commits

Author SHA1 Message Date
Maxime Carbonneau-Leclerc
2f34f084e4 [ISSUE #6548] make all fields nullable except from pk and cursor field (#36201) 2024-03-20 09:48:38 -04:00
Serhii Lazebnyi
69b6ad4b33 CAT: add validation for state messages (#36001) 2024-03-18 14:25:33 +01:00
Marius Posta
f47db9051b delete bad or useless README files (#36196) 2024-03-15 12:02:23 -07:00
Maxime Carbonneau-Leclerc
357c2d686d Issue 35112/relax cats when not primary key (#35645) 2024-02-28 15:35:24 -05:00
Maxime Carbonneau-Leclerc
7baf1540a7 [ISSUE #35110] match CATs records only one primary key when primary k… (#35556) 2024-02-27 13:53:51 -05:00
Stephane Geneix
9144011b54 add entry into JAVA_OPTS to always select log4j2.xml as our logger configuration (#35569) 2024-02-22 19:37:32 -08:00
Joe Bell
2d80b5676d Destination Clickhouse - 1.0, remove normalization (#34637) 
Co-authored-by: Aaron ("AJ") Steers <aj@airbyte.io>
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: Obioma Anomnachi <onanomnachi@gmail.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: maxi297 <maxi297@users.noreply.github.com>
Co-authored-by: Ryan Waskewich <156025126+rwask@users.noreply.github.com>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: SatishChGit <satishchinthanippu@gmail.com>
Co-authored-by: evantahler <evan@airbyte.io>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Anton Karpets <anton.karpets@globallogic.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <akash@airbyte.io>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Artem Inzhyyants <36314070+artem1205@users.noreply.github.com>
 2024-02-22 11:17:25 -06:00
Augustin
cb3578c9e8 fix :airbyte-integrations:connectors:destination-duckdb' could not be found in project (#35279) 2024-02-14 17:50:14 +02:00
Marius Posta
796b2e8dad java CDK: clean up dependencies, refactor modules (#34745) 2024-02-08 19:46:51 -06:00
Artem Inzhyyants
a96b7f4785 CAT: add validation for stream statuses (#34675) 2024-02-08 22:13:00 +01:00
Daryna Ishchenko
8107081c6d CAT: Validate connector documentation (#34380) 2024-02-08 18:04:46 +02:00
Augustin
cf4cb225a5 internal poetry packages: declare poe tasks and airbyte-ci sections in pyproject.toml (#34735) 2024-02-07 15:08:05 +00:00
Artem Inzhyyants
8e7196ef55 CAT: fix NoAdditionalPropertiesValidator (#34709) 2024-01-31 19:23:21 +01:00
Artem Inzhyyants
dccb2fa716 CAT: set additionalProperties recursively for objects (#34448) 2024-01-29 18:11:31 +01:00
Daryna Ishchenko
0749ed1a32 CAT: fixed TestSpec.test_oauth_is_default_method to skip connector spec without predicate key (#34559) 2024-01-29 11:56:48 +02:00
Baz
7594c3646d 🎉 CAT: Add allowedHosts and suggestedSteams checks for metadata.yaml for connectors ql >= 400 (#34358) 2024-01-26 15:57:21 +02:00
Anton Karpets
3592ee9b53 ✨CAT: Add test to ensure all file types covered (#33746) 2024-01-26 12:52:55 +02:00
Daryna Ishchenko
89cfb39dbf CAT: Add scenario that OAuth is default method and fields are marked as airbyte_secret (#34178) 2024-01-25 16:37:06 +02:00
Augustin
5f35187010 airbyte-ci: upgrade to dagger 0.9.6 (#34321) 2024-01-18 08:16:27 -08:00
Augustin
617075d88e airbyte-ci: upgrade to dagger 0.9.5 (#33582) 2024-01-05 12:41:40 +01:00
Edward Gao
216d2b2e70 Destination postgres: enable in-connector normalization (#33873) 2024-01-04 14:15:33 -04:00
Brian Lai
7a0879870a [catify-certs] Add new certification test options and new test validating the existence of primary keys (#33521) 2023-12-20 15:45:12 -05:00
Augustin
0b33caecda Revert "[skip ci] formatting: add missing license headers (#33250)" (#33289) 2023-12-11 11:38:37 +01:00
Augustin
60c1cc01ad [skip ci] formatting: add missing license headers (#33250) 2023-12-11 10:15:18 +01:00
Denys Davydov
1ef5e80153 CAT: validate stream schemas to be valid json schemas (#32787) 
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
 2023-12-05 06:48:55 +01:00
Ella Rohm-Ensing
ac3eb28de2 airbyte-ci: add format commands (#31831) 
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
 2023-11-14 02:17:48 -06:00
Augustin
93c5704a14 airbyte-ci: Re-add CAT Dockerfile (#32249) 2023-11-07 10:32:25 -06:00
Augustin
79194285a4 🧹update cat to not run using docker + remove migrations tools (#32210) 2023-11-07 09:58:43 +00:00
Marius Posta
7cd8020ac8 java CDK: hoist top-level gradle projects into CDK (#31960) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
 2023-10-30 12:03:06 -07:00
Joe Bell
df30784342 Update CAT to check for duplicate streams (#31942) 
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com>
Co-authored-by: midavadim <midavadim@yahoo.com>
Co-authored-by: midavadim <midavadim@users.noreply.github.com>
Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Martin Hwasser <hwaxxer@users.noreply.github.com>
Co-authored-by: Joe Reuter <joe@airbyte.io>
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: ChristoGrab <ChristoGrab@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
 2023-10-30 17:40:55 +00:00
Edward Gao
877200de94 Destination snowflake: filter raw table commit on extracted_at (#31897) 2023-10-27 13:14:50 -04:00
Augustin
e3b262f055 CAT: improve test timeouts (#31810) 2023-10-27 08:47:15 +02:00
Gireesh Sreepathi
3e764712f4 Destination BigQuery + Snowflake : Disable type and dedupe step controlled by flag in Connector spec (#31686) 
Signed-off-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: gisripa <gisripa@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Evan Tahler <evan@airbyte.io>
 2023-10-26 13:46:54 -07:00
Stephane Geneix
228a0712d7 fix CAT error message when records are missing the ID attribute (#31822) 
Co-authored-by: stephane-airbyte <stephane-airbyte@users.noreply.github.com>
 2023-10-25 19:04:27 +00:00
Edward Gao
148dda1c1f Destinations Bigquery+Snowflake: Do not dedup raw table (#31520) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-25 12:19:58 -04:00
Stephane Geneix
df9da285bf 🐛 📝 Source Snowflake: fix coercion-to-UTC for timestamp datasource (#31631) 
Co-authored-by: stephane-airbyte <stephane-airbyte@users.noreply.github.com>
 2023-10-24 17:59:56 +00:00
Augustin
ff2fcf89a5 cat / airbyte-ci: improve CAT container orchestration (#31699) 2023-10-24 08:14:52 +00:00
Marius Posta
e606b77846 source-postgres: re-enable incremental SATs (#31306) 
Co-authored-by: postamar <postamar@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-10-19 11:30:01 -04:00
Edward Gao
f1baf2a2f2 Destinations snowflake+bigquery: Improve performance by filtering raw table on extracted_at (#31191) 
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-17 17:48:18 +00:00
Marius Posta
696118de6a gradle: remove broken mypy task (#31468) 2023-10-16 12:05:56 -07:00
Gireesh Sreepathi
c4ff29e23a Destinations bigquery: Fix string-json auto conversion for BigQuery (#31358) 
Signed-off-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: gisripa <gisripa@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-10-12 17:13:39 -07:00
Rodi Reich Zilberman
3d9578fdac Cap each log field (message, stacktrace) to max 32K characters (#30806) 
Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-10-11 13:34:53 -07:00
Augustin
d309a2f148 CAT: fix system deps install (#31275) 2023-10-11 08:11:53 -07:00
Evan Tahler
898846d40a Remove Dv2 Null checks (#31149) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-10-10 15:36:00 -04:00
Edward Gao
ad5ce75be9 Revert "T&D: Use non-null columns for PKs rather then scanning raw ta… (#31082) 2023-10-04 17:25:41 -05:00
Marius Posta
f8edc18039 airbyte-ci,gradle: replace airbyte-docker with airbyte-ci (#30743) 2023-10-04 08:38:17 -07:00
Pedro S. Lopez
bb034bbe99 CAT: add option to test with specific deployment_mode (#30838) 2023-10-03 12:47:03 -07:00
Ben Church
89f6ecc0d0 Update internal tool install instructions to include pyenv, editable, and force (#30858) 
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: Prateek Mukhedkar <prateek@airbyte.io>
 2023-10-03 13:59:27 -05:00
Evan Tahler
4992fce7ba T&D: Use non-null columns for PKs rather then scanning raw table to ensure all records have PKs (#30779) 
Co-authored-by: evantahler <evantahler@users.noreply.github.com>
Co-authored-by: Joe Bell <joseph.bell@airbyte.io>
Co-authored-by: jbfbell <jbfbell@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-10-03 16:23:01 +00:00
Marius Posta
7ae97175a6 gradle: fix repo wide behaviour (#30607) 2023-09-28 05:01:13 -07:00