jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 02:51:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

1127 Commits

Author SHA1 Message Date
Brian Lai
0aa35197af fix(connector-acceptance-tests): Don't fail schema validation when schema contains additionalProperties that is not True (#60216) 2025-05-11 18:28:55 -04:00
Natik Gadzhi
7541e11c11 Revert "chore(airbyte-ci): update dagger-io from 0.13.3 to 0.16.0" (#55074) 2025-03-01 12:34:49 -08:00
devin-ai-integration[bot]
3647b1b8a8 chore(airbyte-ci): update dagger-io from 0.13.3 to 0.16.0 (#54670) 2025-03-01 11:52:57 -08:00
Edward Gao
c8e3ec0210 Fix build: Revert "chore: clean out unused "bases" and utils (#53234)" (#53621) 2025-02-10 21:36:30 +00:00
Natik Gadzhi
4dec57a29f chore: clean out unused "bases" and utils (#53234) 2025-02-07 15:19:32 -08:00
Natik Gadzhi
e411522a6d fix(airbyte-ci): running CATs container in python 3.11 (#53143) 2025-02-03 15:13:57 -08:00
Natik Gadzhi
dae050c8fe feat(airbyte-ci): update tools to Python 3.11 (#52695) 2025-02-03 09:14:46 -08:00
Natik Gadzhi
abd0a11ba2 Revert "feat: update internal packages to Python 3.11" (#52692) 2025-01-31 11:01:47 -08:00
devin-ai-integration[bot]
e743cd4c3d feat: update internal packages to Python 3.11 (#52664) 
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: natik@airbyte.io <natik@airbyte.io>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2025-01-31 09:55:24 -08:00
Aaron ("AJ") Steers
83ecbe0fc3 CI: apply pre-commit format fix from #49806 (#49852) 2024-12-18 14:05:43 -08:00
Augustin
7845b6b690 cat/live-test: give ownership of copied objects to the image user (#48616) 2024-11-22 15:35:04 +01:00
Augustin
1d15fcf4b6 cat/live-test: mount connection objects to readable path (#48614) 2024-11-22 12:29:23 +01:00
Christo Grabowski
ec3c874238 CAT Fix: include optional fields when parsing inline spec for manifest-only connectors (#48113) 2024-11-01 16:49:29 -04:00
Artem Inzhyyants
246502e031 perf(source-bing-ads): bump CDK (#46991) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-10-23 11:25:42 +02:00
Augustin
0d6cf1bdc9 Upgrade to Dagger 0.13 (#46923) 
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to this change.
-->
Upgrade from dagger 0.9.6 to dagger 0.13

## How
<!--
* Describe how code changes achieve the solution.
-->
* change behavior of `with_exec()`. The `skip_entrypoint` keyword arg has been changed to an opposite kwarg: `use_entrypoint`
* The `pipeline()` function has been removed. Remove its use.

## How will I deem the update stable
* [x] `pipelines` tests are 🟢 
* [x] `CAT` tests are 🟢 
* [x] `base_image` tests are 🟢 
* [x] Tests are running for a java and a python connector 🟢  [(Python test)](https://github.com/airbytehq/airbyte/actions/runs/11370125686) [(Java test)](https://github.com/airbytehq/airbyte/actions/runs/11381915439/job/31664363609)
* [x] The publish pipeline still works for  java and python connectors 🟢  [(test)](https://github.com/airbytehq/airbyte/actions/runs/11367885824/job/31621641890)


## User Impact
Should have no impact

## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [x] YES 💚
- [ ] NO ❌
 2024-10-17 12:24:40 +02:00
Marius Posta
55cc0fecd4 connector acceptance tests: fix regression in test_airbyte_trace_message_on_failure (#44595) 2024-08-23 15:35:14 +00:00
Marius Posta
5909d775f3 connector acceptance tests: relax test_oneof_usage const criteria (#44540) 2024-08-22 06:44:34 -07:00
Marius Posta
0f3b136f5a connector acceptance tests: bug fixes (#44529) 2024-08-21 21:18:04 +00:00
Ben Church
243c8f2d18 feat(cat): add manifest.yaml spec support (#42879) 2024-07-31 07:30:58 -07:00
Xiaohan Song
224db75b22 [source-postgres] CAT test for CDC postgres (#42107) 
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Dhroov Makwana <pabloescoder@gmail.com>
Co-authored-by: Audrey Maldonado <audrey.maldonado@gmail.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Maxime Carbonneau-Leclerc <3360483+maxi297@users.noreply.github.com>
Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Baz <oleksandr.bazarnov@globallogic.com>
Co-authored-by: maxi297 <maxime@airbyte.io>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Rodi Reich Zilberman <867491+rodireich@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Gireesh Sreepathi <gisripa@gmail.com>
Co-authored-by: Jeroen de Vries <jeroen@maildevries.eu>
Co-authored-by: prashant-mittal9 <168704883+prashant-mittal9@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: lazebnyi <lazebnyi@users.noreply.github.com>
Co-authored-by: pmossman <pmossman@users.noreply.github.com>
Co-authored-by: Aldo Gonzalez <168454423+aldogonzalez8@users.noreply.github.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Brian Lai <51336873+brianjlai@users.noreply.github.com>
Co-authored-by: Anton Karpets <karpets.as@gmail.com>
Co-authored-by: askarpets <anton.karpets@globallogic.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Tim Werner <t.werner@comventure.de>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: James Truty <jtruty@gmail.com>
Co-authored-by: Ben Church <ben@airbyte.io>
Co-authored-by: Marius Posta <marius@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Matias Samuel Miranda <matias.miranda@merantix-momentum.com>
Co-authored-by: Akash Kulkarni <akash@airbyte.io>
 2024-07-29 15:01:46 -07:00
Catherine Noll
5c1fe7a0c4 CATs: fix client config path (#42580) 2024-07-29 12:12:40 -04:00
Catherine Noll
583eb842fc CATs: add final teardown option (#42517) 2024-07-25 17:42:42 -04:00
Xiaohan Song
8bf87e807b [source-postgres]Non CDC CAT test for postgres (#41650) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: bgroff <bgroff@users.noreply.github.com>
Co-authored-by: Akash Kulkarni <113392464+akashkulk@users.noreply.github.com>
Co-authored-by: Yue Li <61070669+theyueli@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <80129833+darynaishchenko@users.noreply.github.com>
Co-authored-by: Artem Inzhyyants <36314070+artem1205@users.noreply.github.com>
Co-authored-by: Dan Aronson <dan.ar27@gmail.com>
Co-authored-by: Stephane Geneix <147216312+stephane-airbyte@users.noreply.github.com>
Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Natik Gadzhi <natik@respawn.io>
Co-authored-by: artem1205 <artem1205@users.noreply.github.com>
Co-authored-by: Antonio Papa <antoniogpapa@gmail.com>
Co-authored-by: Adam Marcus <marcua@marcua.net>
Co-authored-by: Bryce Groff <bgroff@hawaii.edu>
Co-authored-by: Patrick Nilan <nilan.patrick@gmail.com>
Co-authored-by: Catherine Noll <clnoll@users.noreply.github.com>
Co-authored-by: Catherine Noll <noll.catherine@gmail.com>
 2024-07-24 13:01:52 -07:00
Catherine Noll
65ebd46bb7 CATs: only export /integration_tests (#42426) 2024-07-23 13:20:08 -04:00
Catherine Noll
376b26414e Catherine/cats running not required (#42082) 2024-07-17 18:50:05 -04:00
Catherine Noll
14b24a3333 CATs: share files from setup container to host (#41609) 2024-07-10 15:45:02 -04:00
Boris Staal
1c4ff2ae59 build(airbyte-ci): Test python versions matrix (#40731) 
Co-authored-by: Augustin <augustin@airbyte.io>
 2024-07-09 11:14:28 +02:00
Xiaohan Song
393cff0f81 Fix some naming issue on CAT client container logic (#40755) 
Co-authored-by: Catherine Noll <noll.catherine@gmail.com>
 2024-07-08 07:40:10 -04:00
Catherine Noll
21485decda CATs: handling for global state messages (#40649) 2024-07-02 05:31:42 -04:00
Catherine Noll
93a873ee92 Let tests access setup teardown container (#40643) 2024-07-01 10:50:47 -04:00
Catherine Noll
554d45a138 CATs: add connector code to setup container (#40613) 2024-07-01 09:40:33 -04:00
Catherine Noll
34e92b4d2f CATS: remove default for SetupTeardownConfig (#40640) 2024-07-01 05:50:51 -04:00
Catherine Noll
dc0e4f8842 CATs: fix control flow around setup/teardown config (#40635) 2024-06-30 12:00:25 -04:00
Catherine Noll
f8dc414b47 Add setup and teardown hooks to CATs (#40551) 2024-06-28 02:50:25 -04:00
Cristina Mariscal
e3c60e3457 Increasing maxSecondsBetweenMessages for facebook marketing connector o avoid heartbeat timeout error (#39400) 
Co-authored-by: cristina.mariscal <cristina.mariscal@cristina.mariscal--MacBook-Pro---DFJ27FJFXX>
 2024-06-12 17:42:45 -06:00
Augustin
78eaf7dbf9 connector-acceptance-test: install the pytest-reportlog plugin (#39338) 
## What
Add pytest-reportlog pluging to CAT dependency to generate json test reports
 2024-06-11 15:16:38 +02:00
Anton Karpets
04e776faef ✨CAT: add test_primary_keys_data_type (#38755) 
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
 2024-06-11 02:07:15 +02:00
Roman Yermilov [GL]
6968f9a71a Extend abnormal state test to include cursor format check (#39136) 2024-06-07 20:25:33 +02:00
Roman Yermilov [GL]
4a9248655d CAT incremental test: disable diff for the sequential slices test due to unhandled corner cases (#39131) 2024-06-06 12:55:47 +02:00
Roman Yermilov [GL]
1f325ec6e6 CAT: fix incremental by running tests per stream (#36814) 2024-06-03 13:55:11 +02:00
Evan Tahler
fe8b9b7ce8 Disable jooq logo and tips (#38194) 2024-05-14 11:11:52 -07:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Brian Lai
d74125bf10 [RFR for API Sources] New Python interfaces to support resumable full refresh (#37429) 2024-05-06 18:41:29 -04:00
Stephane Geneix
c326286b5a debuggability improvements to the CDK (#37746) 
A few changes to improve debuggability:
1) We now print the stack trace that created an orphan thread, in addition to the current stack trace.
2) we add the ability for a connector to tell the integration runner to not care about certain threads (by adding a thread filter)
3) We change the log of connector containers to include the name of the test that created it (usually each test will create and close a container)
4) We also log when the timeout timer gets triggered, to try to understand why some tests are still taking way more time than their timeout should allow

Another change that was initially in there but has been removed and might be worth thinking about:
Today, only Write checks for live threads on shutdown. We might want to do that for other operations as well
 2024-05-03 06:50:22 -07:00
dependabot[bot]
5751accfd6 Bump idna from 3.6 to 3.7 in /airbyte-integrations/bases/connector-acceptance-test (#37362) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-04-18 18:16:37 -07:00
Brian Leonard
3ed543b7fd 🚨🚨 Source Sendgrid: migrate to low code (#35776) 
Co-authored-by: askarpets <anton.karpets@globallogic.com>
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
 2024-04-15 18:05:37 +02:00
Ella Rohm-Ensing
b7819d9f6c python: assert actual == expected ordering (#36980) 2024-04-11 15:16:33 +00:00
Marius Posta
2495575795 java-cdk: re-export airbyte-api dependency (#36759) 2024-04-03 10:43:05 -07:00
Ella Rohm-Ensing
c1bc363694 pin beartype version in connectors ci packages (#36755) 2024-04-02 12:21:22 -07:00
Natik Gadzhi
27c225a9a8 airbyte-ci: Update pipelines requests and pyjwt (#36607) 2024-03-28 13:19:57 -07:00