jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-22 11:31:02 -05:00
Code Issues Packages Projects Releases Wiki Activity
22,318 Commits 5,109 Branches 518 Tags
baf4633ab8b51a55276115ea083837d8632fe217
Commit Graph

69 Commits

Author SHA1 Message Date
Catherine Noll
383f0b1037 Docs: update connector test documentation (#44126) 
Co-authored-by: katmarkham <40400595+katmarkham@users.noreply.github.com>
 2024-08-16 12:02:30 -04:00
Audrey Maldonado
6c980bd8f9 Re-ordering some material and temporarily removing a document (#40612) 2024-06-28 21:17:48 +00:00
Anton Karpets
04e776faef ✨CAT: add test_primary_keys_data_type (#38755) 
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
 2024-06-11 02:07:15 +02:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Marius Posta
f90b5d1b62 docs: update and remove some bad content (#36197) 2024-03-15 13:12:37 -07:00
Maxime Carbonneau-Leclerc
357c2d686d Issue 35112/relax cats when not primary key (#35645) 2024-02-28 15:35:24 -05:00
Augustin
4889e6e024 🧹 remove qa_checks.py (#35434) 2024-02-20 02:28:28 -06:00
Augustin
05a1512a7e update doc to reference poetry (#35414) 2024-02-20 07:57:53 +00:00
Daryna Ishchenko
8107081c6d CAT: Validate connector documentation (#34380) 2024-02-08 18:04:46 +02:00
Baz
7594c3646d 🎉 CAT: Add allowedHosts and suggestedSteams checks for metadata.yaml for connectors ql >= 400 (#34358) 2024-01-26 15:57:21 +02:00
Anton Karpets
3592ee9b53 ✨CAT: Add test to ensure all file types covered (#33746) 2024-01-26 12:52:55 +02:00
Daryna Ishchenko
89cfb39dbf CAT: Add scenario that OAuth is default method and fields are marked as airbyte_secret (#34178) 2024-01-25 16:37:06 +02:00
Brian Lai
7a0879870a [catify-certs] Add new certification test options and new test validating the existence of primary keys (#33521) 2023-12-20 15:45:12 -05:00
Pedro S. Lopez
295dbb3bf2 📄 docs: remove custom registry instructions (#32614) 
Co-authored-by: pedroslopez <pedroslopez@users.noreply.github.com>
 2023-12-15 12:19:38 -04:00
Evan Tahler
8db613a480 Fix some docs, remove outdated accpetance-test doc mentions and file (#33389) 
Co-authored-by: Natik Gadzhi <natik@respawn.io>
 2023-12-12 18:25:20 -06:00
Evan Tahler
c75325b91d Update README.md (#32464) 2023-11-14 09:11:09 +01:00
Augustin
b35a2b2907 doc: update connector tutorials to reference airbyte-ci for connector build (#31650) 2023-10-23 22:42:53 +02:00
Ben Church
4d5e17bc90 [skip ci] Update test_incremental to be unaware when source defines the cursor (#27872) 
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
 2023-09-05 15:57:18 -07:00
Ben Church
ba7ef7b30a 📚 Update the docs to be more clear about how and when you run CAT (#29733) 2023-08-25 19:33:43 +00:00
Ben Church
fb7258e2bd Move tools/ci_* projects to airbyte-ci, update to use Poetry, bump to python 3.10 (#27957) 
* Move ci_connector_ops

* Move ci_credentials

* Move tools/ci_common_utils

* Rename tools to airbyte-ci

* Move to ci

* Convert ci_credentials

* Convert ci_common_utls

* Convert ci_connector_ops

* Get pipelines running

* Move pipelines to own poetry project

* Update readme

* Delete

* Add ci_code_validator

* Use pipx to install gha deps

* Fix'

* Ensure every thing is running

* Automated Commit - Formatting Changes

* Gitignore miss

* Add pipx installer

* Get local pipx dependencies

* Fix paths

* Install pipx

* ceremonial source-faker change

* Add installation step for ci_code_validator

* Add comment

* remove ci_code_validator

* Address code review comments

* add pipx install to acceptance-test-docker.sh

* Run formater

* Revert "ceremonial source-faker change"

This reverts commit 26884cd0db.

* gitignore lecacy pipeline report path

* update poetry.lock

* skip upload if logs do not exist

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
 2023-07-26 15:49:59 +00:00
Ben Church
5b183cbb7a Bnchrch/cat/backwards fail removed prop (#27685) 
* Incorrect way to do this

* Working

* Make tests pretty

* Revert "Incorrect way to do this"

This reverts commit f8e29594c1b5fa07bad805806f2571af883d27fd.

* Add backwards compatibility docs

* bump version

* format

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-06-28 08:21:27 -07:00
Augustin
5b8200181c connectors-ci: deprecate slash test (#27200) 2023-06-14 18:19:13 +02:00
Ben Church
623391bfa3 Update docs (#26935) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-06-02 09:54:48 -07:00
Augustin
42f3d4559f connectors-ci: re-upload spec if image exists + fix pre-release (#26604) 
* connectors-ci: fix pre-release

* fix edge case

* Automated Change

---------

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
 2023-05-25 21:53:51 +02:00
Marcos Marx
87f277f41b remove old testing docs (#26605) 2023-05-25 15:22:52 -03:00
Augustin
80032f73f9 connectors-ci: deprecate slash publish (#25865) 2023-05-22 10:10:56 +02:00
Ben Church
f2944dd59b Docs: Metadata add docs ahead of merge (#26015) 
* Cherry pick docs files from  metadata-service/feat-remove-definitions

* Add link to checklist

* Fix docasaurus error
 2023-05-11 16:10:13 -05:00
Alexandre Girard
fc3655c12a low-code: Clean up SessionTokenAuthenticator interface (#25086) 
* Username and session token are optional fields

* update

* Add titles, descriptions, and examples

* Automated Commit - Formatting Changes

* fix a small typo

---------

Co-authored-by: girarda <girarda@users.noreply.github.com>
 2023-04-17 14:42:49 -07:00
Rodi Reich Zilberman
0bab1756b8 Rename airbyte-config module (#24885) 
* rename airbyte-config module

* Automated Commit - Formatting Changes

* sanity

* update import

* update import

* update script

* update script

* update script

* update script

* Automated Change

* Automated Change

* Automated Change

* Automated Change

* update awsdatalake icon

* point slash commands to new path

* sanity

* Automated Commit - Formatting Changes

* sanity

* Automated Change

* Automated Change

* sanity

---------

Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-04-06 10:47:30 -07:00
Ella Rohm-Ensing
9cfc647fa5 Ella/fail on extra fields (#23985) 
* Pass argument along, add test that should pass and test that should fail

* Add tests with additionalProperties

* Set additionalproperties=false when not set|

* Parametrize test cases

* Make the behavior 'optional'

* Fix parametrization for all combinations

* Improve CI credentials README and rename param

* Update naming to be clearer about columns only

* record_has_unexpected_field > record_has_unexpected_column

* Automated Change

* Add bypass for beta + ga connectors that failed

* Update docs and TODOs

* Update changelog and dockerfile

* Update TODO

* Update a few neglected connectors

* Remove uploaded file

* Update dockerfile after merge conflict

---------

Co-authored-by: marcosmarxm <marcosmarxm@users.noreply.github.com>
 2023-03-23 22:22:44 +00:00
Catherine Noll
d4ec2d952e Update /test to optionally test against the local CDK (#23434) 2023-02-28 11:53:51 -05:00
Roman Yermilov [GL]
ea776ef19a SAT ignored fields key for basic read (#22996) 
* [SAT] add ignored fields for basic read

* [SAT] ignored_fields validation fixture

* [SAT] set ignored_fields default value

* Update airbyte-integrations/bases/connector-acceptance-test/CHANGELOG.md

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Automated Change

* [SAT] fixture tests and some small fixes

* Update airbyte-integrations/bases/connector-acceptance-test/CHANGELOG.md

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Automated Change

---------

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: roman-yermilov-gl <roman-yermilov-gl@users.noreply.github.com>
 2023-02-28 18:11:59 +04:00
Ben Church
c3f657f564 Add a tutorial for using a locally generated catalog (#23448) 2023-02-24 15:46:12 -08:00
Augustin
9d57772303 connector-acceptance-tests: support custom environment variables (#22937) 
* connector-acceptance-tests: support custom environment variables

* update postgres acceptance-test-config.yml
 2023-02-14 13:57:38 -06:00
Evan Tahler
e6441bf6be Update connector-acceptance-tests-reference.md (#22370) 
* Update connector-acceptance-tests-reference.md

* format and naming
 2023-02-03 12:37:55 -06:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846) 
Rename source acceptance test to connector acceptance test
 2023-02-02 11:38:19 +01:00
Evan Tahler
adc5a25704 Github Action to enforce allowed hosts are set for GA and Beta connectors (#21684) 
* Github Action to enforce allowed hosts are set for GA connectors

* include beta connectors too

* fix keys and add github

* Update tools/ci_connector_ops/ci_connector_ops/allowed_hosts_checks.py

Co-authored-by: Augustin <augustin@airbyte.io>

* remove comments

* bump version

* add docs

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-01-30 14:44:37 -08:00
Rodi Reich Zilberman
06ef1e90c6 source-postgres: enable SAT high test strictness level (#20549) 2023-01-04 09:08:43 +00:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850) 
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
 2023-01-03 15:55:36 -08:00
Augustin
b78fdadaf2 SAT: optionally disable discovered catalog caching (#19806) 2022-11-29 13:41:45 +01:00
Denys Davydov
459856b73c #2576 oncall. SAT: test spec against exposed secrets (#19124) 
* #2576 oncall. SAT: test spec against exposed secrets

* #2576 upd changelog

* #2576 review fixes

* #2576 more test fixes
 2022-11-10 23:31:04 +02:00
Augustin
a196cf712c SAT: make future_state configuration mandatory in high test strictness level (#19085) 2022-11-08 23:10:22 +01:00
Augustin
7d73b08606 SAT: basic read on full catalog when test_strictness_level == high (#18937) 2022-11-07 08:09:34 +01:00
Augustin
c25ac8a748 SAT: make expect_records mandatory in high test_strictness_level (#18497) 2022-10-28 11:45:29 +02:00
Augustin
726d3bde4d SAT: enforce bypass_reason declaration on empty_streams when test_strictness_level == high (#18425) 2022-10-25 22:31:16 +02:00
Augustin
0865c62ee6 SAT: make all tests mandatory when test_strictness_level == high (#18414) 2022-10-25 21:45:12 +02:00
Augustin
e933de02e8 SAT: declare bypass_reason in acceptance-test-config.yml (#18364) 2022-10-25 08:52:35 +02:00
Augustin
efc9ac1bc9 SAT: update reference about backward compatibility tests (#15588) 
* update sat reference

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2022-08-17 13:56:11 -07:00
Augustin
fd70913df9 SAT: compatibility tests for catalogs (#15486) 2022-08-10 17:42:07 +02:00
Augustin
2d60438cd8 SAT: new tests for spec backward compatibility - syntactic validation (#15194) 2022-08-05 08:24:21 +02:00