Ben Church
1d856ab943
Feat: Metadata Service remove old catalog system ( #26013 )
...
* Remove Definition File References from Python files (#25590 )
* Remove check_images_exist.sh
* Update definitions.py
* Update build_report.py
* Update tools/bin/ci_integration_workflow_launcher.py
* Update tools/bin/ci_check_dependency.py
* tools/bin/scan_all_spec_airbyte_secret.py
* Remove qa engine references
* Revert "Remove check_images_exist.sh"
This reverts commit 7675162789#25593 )
* Remove Definition File References from Java files (LocalDefinitionProvider), shell scripts and docs (#25592 )
* Remove CombinedConnectorCatalogGenerator.java
* Update local definition provider
* Update local def test
* Add spec mask downloader
* Make downloader work
* Delete generators and add tests
* REMOVE THE YAML FILES
* Roughly update docs
* Update shell scripts
* Remove unused
* Add connector metadata file doc
* Apply suggestions from code review
Co-authored-by: Augustin <augustin@airbyte.io >
* Additional PR comments
* Run format tasks
---------
Co-authored-by: Augustin <augustin@airbyte.io >
* Remove unused import
* bundle registry
* Ignore future updates
* Update registry
* new registry
* Readd maskeddatainterceptor
* Automated Change
* Remove icon validation
* Automated Change
* Automated Change
* Source Amazon Ads: get rid of `fail_on_extra_columns: false` in SAT (#25913 )
* Source Amazon Ads: small schema fixes
* Source Amazon Ads: update changelog
* Source Amazon Ads: update unittest
* Source Amazon Ads: unittest additional property is boolean
* Source Amazon Ads: bump version
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
* connectors-ci: make spec-cache / metadata bucket and creds not required for pre-release (#26119 )
* Automated Change
---------
Co-authored-by: Augustin <augustin@airbyte.io >
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com >
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 11:40:11 -07:00
Maxime Carbonneau-Leclerc
1fdaa1d074
[ISSUE #20044 ] generate pydantic models from handwritten schema ( #20475 )
...
* handwritten low code manifest example components
* add MinMaxDatetime to jsonschema
* add a basic gradle command to generate manifest components
* Add auth components to handwritten component schema
- ApiKeyAuthenticator
- BasicHttpAuthenticator
- BearerAuthenticator
- DeclarativeOauth2Authenticator
- NoAuth
* Respect optional properties in DeclarativeOauth2Authenticator
* Fix `Dict[str, Any]` mapping in auth components
* add default error handler composite error handler and http response filter components
* [low code component schema] adding backoff strategies to schema
* [low code component schema] fix float types
* [low code component schema] add RecordFilter
* Remove `config` from auth components
* [low code component schema] add Interpolation (with pending question on 'type' not being defined)
* Add CartesianProductStreamSlicer & DatetimeStreamSlicer
* Add ListStreamSlicer, and fix nesting of DatetimeStreamSlicer
* [low code component schema] add InterpolatedRequestOptionsProvider
* Add slicer components, and fix a couple of components after reviewing output
* [low code component schema] adding transformations and adding type to interpolators
* adding spec and a few small tweaks
* Add DefaultSchemaLoader
* [low code component schema] attempt on custom class
* Add descriptions for auth components
* add RequestOption
* remove interpolated objects from the schema in favor of strings only
* a few schema fixes and adding some custom pagination and stream slicer
* [low code component schema] fix CustomBackoffStrategy
* Add CustomRecordExtractor
* add some description and add additional properties
* insert a transformer to hydrate default manifest components and perform validation against the handwritten schema
* [low code component schema] validating existing schemas
* [low code component schema] clean validation script
* add manifest transformer tests and a few tweaks to the schema
* Revert "[low code component schema] clean validation script"
This reverts commit 2408f41cf69d39977815#20044 ] generate pydantic models from handwritten schema
* [ISSUE #20044 ] code review
* [ISSUE #20044 ] re-generating declarative component schema files
Co-authored-by: brianjlai <brian.lai@airbyte.io >
Co-authored-by: Catherine Noll <noll.catherine@gmail.com >
2022-12-20 16:53:35 -06:00
terencecho
a1e21c9bc5
octavia-cli: undue skip_reset flag revert and update integration tests ( #20093 )
...
* Revert "Revert "octavia-cli: Added flag to control whether to reset the streams or not (#18337 )""
This reverts commit da0d9a7984
2022-12-05 15:26:13 -08:00
George Claireaux
2d0cc781f5
Fix pre-commit hook failing because of black ( #11737 )
...
* update black version
* Update .pre-commit-config.yaml
Co-authored-by: Augustin <augustin.lafanechere@gmail.com >
Co-authored-by: Augustin <augustin.lafanechere@gmail.com >
2022-04-05 21:49:37 +01:00
Eugene Kulak
6cd20e6879
🐛 Source FB Marketing: fix execute_in_batch when batch is bigger than 50 ( #10588 )
...
* fix execute_in_batch
* add tests
* fix pre-commit config
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2022-02-24 01:22:53 +04:00
Maksym Pavlenok
6bd75a18c8
🐛 Incorrect path to Py tools ( #10553 )
2022-02-22 21:18:35 +02:00
Maksym Pavlenok
bbd13802d8
🐛 Fix Python checker configs and Connector Base workflow ( #10505 )
2022-02-22 19:58:55 +02:00
Eugene Kulak
d5663691c7
🐛 SAT: Fix test_oneof_usage fail #9860 ( #9861 )
...
* fix pre-commit config
* fix tests
* beatify CHANGELOG.md
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
2022-01-28 23:44:47 +02:00
Augustin
d65b8f986b
🐙 octavia-cli: generate open api client ( #9277 )
2022-01-17 09:27:14 +01:00
Parker Mossman
c071d73221
specify python3 instead of python3.7 for pre-commit ( #9293 )
2022-01-07 14:16:24 -08:00
Sergei Solonitcyn
85accd7a40
Airbyte 8278 all in one static code checker to be run locally as well as during ci pipelines ( #8873 )
...
airbyte-8278 All-in-one static code checker to be run locally as well as during CI pipelines
2021-12-28 05:15:40 +02:00
Edward Gao
5bb1810308
exclude destination_specs.yaml from commit hook ( #9022 )
2021-12-21 15:43:57 -08:00
Dmytro
c0cb8f338a
Fix Github check connection for organizations with large number of re… ( #8170 )
2021-11-22 15:34:42 +02:00
Eugene Kulak
319492791e
CDK: fix logging configuration inside source and streams ( #7808 )
2021-11-11 16:07:38 +02:00
Yaroslav Dudar
7ec756fe12
🎆 Spec.json linter ( #6366 )
...
added python script linter for spec.json validation
2021-09-30 13:01:20 +03:00
Dmytro
501d07f402
Facebook marketing source: fix field value type conversion
2021-09-29 09:32:19 +03:00
Dmytro
3aabd92137
Fix facebook marketing source SAT fail on invalid config file ( #5621 )
...
* Fix facebook marketing source SAT fail on invalid config file
2021-08-31 11:48:03 +03:00
Dmytro
de44001856
Add mypy to precommit hooks ( #5662 )
...
Co-authored-by: Dmytro Rezchykov <dmitry.rezchykov@zazmic.com >
2021-08-27 09:26:40 +03:00
Dmytro
3630cdeded
🎉 New Source: Amazon Ads (initial version) ( #5023 )
...
* 3772: Amazon Ads source, initial version
Co-authored-by: Dmytro Rezchykov <dmitry.rezchykov@zazmic.com >
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2021-08-26 11:15:38 +03:00
vitaliizazmic
5700645946
🎉 New Source: PrestaShop ( #4465 )
...
* Source PrestaShop #2980 - init commit
* Source PrestaShop #2980 - schemas
* Source PrestaShop #2980 - full refresh sync
* Source PrestaShop #2980 - incremental sync, acceptance tests
* Source PrestaShop #2980 - incremental acceptance tests
* Source PrestaShop #2980 - incremental acceptance tests (remove configurations from incremental)
* Source PrestaShop #2980 - change Configurations stream to full refresh
* Source PrestaShop #2980 - docs
* format
* fix schemas, fill streams with data
* fix tests and future_state
* rename presta-shop -> prestashop
* fix mounting volumes inside a nested container
* special handle for NULL dates (MySQL)
* fix build URL
* fix URL and polishing
* fix header
* fix template
* format, update pre-commit to execute in the right order
* fix scaffolding
* bump and changelog for SAT
* register as the default source
* fix test timeout
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
2021-07-26 21:55:07 -04:00
Eugene Kulak
1fedca9052
🎆 Introduce pre-commit ( #4005 )
...
* add pre-commit config
* replace spotless with prettier
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
2021-07-22 12:13:19 -04:00
