1
0
mirror of synced 2026-01-04 18:04:31 -05:00
Commit Graph

29 Commits

Author SHA1 Message Date
Ben Church
1d856ab943 Feat: Metadata Service remove old catalog system (#26013)
* Remove Definition File References from Python files (#25590)

* Remove check_images_exist.sh

* Update definitions.py

* Update build_report.py

* Update tools/bin/ci_integration_workflow_launcher.py

* Update tools/bin/ci_check_dependency.py

* tools/bin/scan_all_spec_airbyte_secret.py

* Remove qa engine references

* Revert "Remove check_images_exist.sh"

This reverts commit 7675162789.

* Improve get url function

* Add test

* remove scan_all_spec_airbyte_secret.py

* add additional test

* Remove check_images_exist.sh (#25593)

* Remove Definition File References from Java files (LocalDefinitionProvider), shell scripts and docs (#25592)

* Remove CombinedConnectorCatalogGenerator.java

* Update local definition provider

* Update local def test

* Add spec mask downloader

* Make downloader work

* Delete generators and add tests

* REMOVE THE YAML FILES

* Roughly update docs

* Update shell scripts

* Remove unused

* Add connector metadata file doc

* Apply suggestions from code review

Co-authored-by: Augustin <augustin@airbyte.io>

* Additional PR comments

* Run format tasks

---------

Co-authored-by: Augustin <augustin@airbyte.io>

* Remove unused import

* bundle registry

* Ignore future updates

* Update registry

* new registry

* Readd maskeddatainterceptor

* Automated Change

* Remove icon validation

* Automated Change

* Automated Change

* Source Amazon Ads: get rid of `fail_on_extra_columns: false` in SAT (#25913)

* Source Amazon Ads: small schema fixes

* Source Amazon Ads: update changelog

* Source Amazon Ads: update unittest

* Source Amazon Ads: unittest additional property is boolean

* Source Amazon Ads: bump version

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* connectors-ci: make spec-cache / metadata bucket and creds not required for pre-release (#26119)

* Automated Change

---------

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-16 11:40:11 -07:00
Rodi Reich Zilberman
0bab1756b8 Rename airbyte-config module (#24885)
* rename airbyte-config module

* Automated Commit - Formatting Changes

* sanity

* update import

* update import

* update script

* update script

* update script

* update script

* Automated Change

* Automated Change

* Automated Change

* Automated Change

* update awsdatalake icon

* point slash commands to new path

* sanity

* Automated Commit - Formatting Changes

* sanity

* Automated Change

* Automated Change

* sanity

---------

Co-authored-by: rodireich <rodireich@users.noreply.github.com>
2023-04-06 10:47:30 -07:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Augustin
e4707f5ed1 normalization: delete supportsDbt and supportsNormalization from DestinationDefinitionSpecificationRead (#21005)
* delete supportsDbt and supportsNormalization from DestinationDefinitionSpecificationRead

* FE changes

* add new fields to the DestinationDefinitionRead API model

* update handlers

* update api doc

* update handlers

* remove debug loggin

* implement suggestions

* update octavia-cli tests

* fix supported check

* update octavia-cli

* fix integration tests

* fix mocks

* fix forgotten renaming

Co-authored-by: Evan Tahler <evan@airbyte.io>
2023-01-07 01:12:50 +00:00
terencecho
a1e21c9bc5 octavia-cli: undue skip_reset flag revert and update integration tests (#20093)
* Revert "Revert "octavia-cli: Added flag to control whether to reset the streams or not (#18337)""

This reverts commit da0d9a7984.

* Update octavia cli integration tests
2022-12-05 15:26:13 -08:00
terencecho
da0d9a7984 Revert "octavia-cli: Added flag to control whether to reset the streams or not (#18337)"
This reverts commit 4f9b66071e.
2022-12-05 11:20:23 -08:00
Marcelo Castro
4f9b66071e octavia-cli: Added flag to control whether to reset the streams or not (#18337)
* Added flag on octavia to control wheter to reset the streams or not

* Restore test_api_http_headers

* Going back to reseting by default
2022-12-05 10:12:19 -08:00
Evan Tahler
ea58882fa3 Fix affected connectors (#19865)
* source-appsflyer

* source-cart

* source-chargebee

* source-lemlist

* source-linnworks

* source-mailgun

* source-pardot

* source-plaid

* source-prestashop

* source-quickbooks-singer

* source-recharge

* source-tplcentral

* remove icons that aren't real

* Remove TODOs

* add missing specs

* Update docs/integrations/sources/primetric.md

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* bump readmes

* revert ci_check_deps logic

* New name

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
2022-11-30 09:51:21 -08:00
Evan Tahler
3d053e32ee Use Nginx + Basic Auth to secure OSS Airbyte (#17694)
* Use Nginx + Basic Auth to secure OSS Airbyte

* use local passwords

* Use gradle builds

* K8s setup and source values from ENV

* note about disabling

* add back defaults

* custom 401 page

* update http message

* update docs

* remove kube files

* additional doc updates

* Add a test suite

* fix failure exit codes

* doc updates

* Add docs

* bump to re-test

* add more sleep in tests for CI

* better sleep in test

* Update docs/operator-guides/security.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* PR updates

* test comment

* change test host on CI

* update tests and nginx to boot without backend

* proxy updates for docker DNS

* simpler test for uptime

* acceptance test skips PWs

* remove resolver madness

* fixup tests

* more proxy_pass revert

* update acceptance test exit codes

* relax test expectations

* add temporal mount back for testing

* Update docs/operator-guides/security.md

Co-authored-by: swyx <shawnthe1@gmail.com>

* Update airbyte-proxy/401.html

Co-authored-by: swyx <shawnthe1@gmail.com>

* more doc updates

* Octavia CLI uses Basic Auth  (#17982)

* [WIP] Octavia CLI uses Basic Auth

* readme

* augustin: add basic auth headers to clien

* augustin: add basic auth headers to client

* tests passing

* lint

* docs

* Move monkey patch to test

* coerce headers into strings

* monkey patch get_basic_auth_token

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>

* fix launch permissions

* Keep worker port internal

* more readme

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: swyx <shawnthe1@gmail.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-10-19 15:52:01 -07:00
Liren Tu
04236ac404 📝 S3 destination: fix typo in the spec field description (#17153) 2022-09-26 23:31:47 -07:00
Michael Siega
294ee8f226 Expose cron scheduling in the Connections APIs (#15253)
* Expose cron scheduling in the Connections APIs

* Update airbyte-api/src/main/openapi/config.yaml

Co-authored-by: terencecho <terence@airbyte.io>

* Update airbyte-server/src/test/java/io/airbyte/server/helpers/ConnectionHelpers.java

Co-authored-by: terencecho <terence@airbyte.io>

* update octavia-cli tests for new schedule schema, and fix update API impl

* check for null schedule data before updating

* handle new schedule related fields in generate / apply / import

* update octavia-cli changelog

* ensure that legacy manual schedule flag is consistent with schedule_type

* update octavia cli test coverage for new schedule schema

* fix failing octavia cli integration tests

* fix file diff check

* Update octavia-cli/unit_tests/test_apply/test_resources.py

Co-authored-by: Augustin <augustin.lafanechere@gmail.com>

Co-authored-by: terencecho <terence@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-08-11 19:27:08 +02:00
Daniel Diamond
635cdfbf02 🎉 octavia-cli: Add ability to import all resources (#14374) 2022-07-05 19:41:15 +02:00
Daniel Diamond
8b635aa02f 🎉 octavia-cli: Add ability to import existing resources (#14137) 2022-07-01 18:23:36 +02:00
Augustin
72af00a649 octavia-cli: fix workspace not having anonymous_data_collection property (#13869) 2022-06-17 17:48:40 +02:00
Augustin
a182aca5e6 octavia-cli: per workspace state (#13070) 2022-06-15 20:24:32 +02:00
Paweł Kociński
49e82a49f1 octavia-cli: allow user to set custom API HTTP headers(#12893) 2022-06-15 15:26:53 +02:00
Augustin
f614187124 octavia-cli: enable transformations (#12727) 2022-06-07 19:16:25 +02:00
Augustin
c3170f9240 airbyte-api: add jackson model annotations to remove null values from responses (#13370) 2022-06-03 12:01:30 +02:00
Alexandre Girard
3894134d11 Bump year in license short to 2022 (#13191)
* Bump to 2022

* format
2022-05-25 17:56:49 -07:00
Augustin
05b123fa10 🐛 octavia-cli: fix sync_catalog in generated connections (#12704) 2022-05-10 08:05:38 +02:00
Augustin
07068b0fe0 🐙 octavia-cli: use model serialization (#12133) 2022-05-06 18:55:22 +02:00
Subodh Kant Chaturvedi
405bf4daad workspaceId should be part of spec request (#12112)
* workspaceId should be part of spec request

* address review comment

* fix test

* format

* update octavia according to API changes

* create integration test for definition generation

* fix test

* fix test

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-04-22 19:30:06 +05:30
Augustin
b5966e97be 🐛 octavia-cli: fix typo in integration test (#11912) 2022-04-12 11:26:57 +02:00
Augustin
9f21fae668 🐛 octavia-cli: use list endpoint instead of list_latest (#11505) 2022-03-30 12:07:04 +02:00
Augustin
55ae3f856a 🐛 octavia-cli: propagate open api spec update (#11441) 2022-03-29 09:31:00 +02:00
Augustin
ba4e86f146 🐙 octavia-cli: secret management (#10885) 2022-03-09 21:35:56 +01:00
Marcos Marx
8f49e193f2 🐙 octavia-cli: add generate for connections (#10809)
* create connection cli command

* add connection.yaml template

* add template file

* remove unused vars and imports

* create group for generate command

* correct connection template

* implement suggestions

* implement suggestions

* fix existing tests

* test resources

* test renderer

* rename renderer module to renderers

* test generate command

* fix yaml style

* fix yaml style

* revert unrelated changes

* revert unrelated changes

* clean

* clean

* add required resource_name field to template

* undo snakecasing + delete jsonschema

* add source_id destination_id to yaml top

* fix

* add json schema in connection integration test

* make write_yaml a base method + implement _render

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-03-09 10:06:39 -03:00
Augustin
a9ac813467 use yaml safe load (#10882) 2022-03-08 11:52:32 +01:00
Augustin
706d7f1686 🐙 octavia-cli: implement apply (#10703) 2022-03-05 19:18:07 +01:00