Ben Church
1d856ab943
Feat: Metadata Service remove old catalog system ( #26013 )
...
* Remove Definition File References from Python files (#25590 )
* Remove check_images_exist.sh
* Update definitions.py
* Update build_report.py
* Update tools/bin/ci_integration_workflow_launcher.py
* Update tools/bin/ci_check_dependency.py
* tools/bin/scan_all_spec_airbyte_secret.py
* Remove qa engine references
* Revert "Remove check_images_exist.sh"
This reverts commit 7675162789 .
* Improve get url function
* Add test
* remove scan_all_spec_airbyte_secret.py
* add additional test
* Remove check_images_exist.sh (#25593 )
* Remove Definition File References from Java files (LocalDefinitionProvider), shell scripts and docs (#25592 )
* Remove CombinedConnectorCatalogGenerator.java
* Update local definition provider
* Update local def test
* Add spec mask downloader
* Make downloader work
* Delete generators and add tests
* REMOVE THE YAML FILES
* Roughly update docs
* Update shell scripts
* Remove unused
* Add connector metadata file doc
* Apply suggestions from code review
Co-authored-by: Augustin <augustin@airbyte.io >
* Additional PR comments
* Run format tasks
---------
Co-authored-by: Augustin <augustin@airbyte.io >
* Remove unused import
* bundle registry
* Ignore future updates
* Update registry
* new registry
* Readd maskeddatainterceptor
* Automated Change
* Remove icon validation
* Automated Change
* Automated Change
* Source Amazon Ads: get rid of `fail_on_extra_columns: false` in SAT (#25913 )
* Source Amazon Ads: small schema fixes
* Source Amazon Ads: update changelog
* Source Amazon Ads: update unittest
* Source Amazon Ads: unittest additional property is boolean
* Source Amazon Ads: bump version
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
* connectors-ci: make spec-cache / metadata bucket and creds not required for pre-release (#26119 )
* Automated Change
---------
Co-authored-by: Augustin <augustin@airbyte.io >
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com >
Co-authored-by: Roman Yermilov [GL] <86300758+roman-yermilov-gl@users.noreply.github.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-05-16 11:40:11 -07:00
Rodi Reich Zilberman
0bab1756b8
Rename airbyte-config module ( #24885 )
...
* rename airbyte-config module
* Automated Commit - Formatting Changes
* sanity
* update import
* update import
* update script
* update script
* update script
* update script
* Automated Change
* Automated Change
* Automated Change
* Automated Change
* update awsdatalake icon
* point slash commands to new path
* sanity
* Automated Commit - Formatting Changes
* sanity
* Automated Change
* Automated Change
* sanity
---------
Co-authored-by: rodireich <rodireich@users.noreply.github.com >
2023-04-06 10:47:30 -07:00
Cole Snodgrass
2e099acc52
update headers from 2022 -> 2023 ( #22594 )
...
* It's 2023!
* 2022 -> 2023
---------
Co-authored-by: evantahler <evan@airbyte.io >
2023-02-08 13:01:16 -08:00
Augustin
e4707f5ed1
normalization: delete supportsDbt and supportsNormalization from DestinationDefinitionSpecificationRead ( #21005 )
...
* delete supportsDbt and supportsNormalization from DestinationDefinitionSpecificationRead
* FE changes
* add new fields to the DestinationDefinitionRead API model
* update handlers
* update api doc
* update handlers
* remove debug loggin
* implement suggestions
* update octavia-cli tests
* fix supported check
* update octavia-cli
* fix integration tests
* fix mocks
* fix forgotten renaming
Co-authored-by: Evan Tahler <evan@airbyte.io >
2023-01-07 01:12:50 +00:00
terencecho
a1e21c9bc5
octavia-cli: undue skip_reset flag revert and update integration tests ( #20093 )
...
* Revert "Revert "octavia-cli: Added flag to control whether to reset the streams or not (#18337 )""
This reverts commit da0d9a7984 .
* Update octavia cli integration tests
2022-12-05 15:26:13 -08:00
terencecho
da0d9a7984
Revert "octavia-cli: Added flag to control whether to reset the streams or not ( #18337 )"
...
This reverts commit 4f9b66071e .
2022-12-05 11:20:23 -08:00
Marcelo Castro
4f9b66071e
octavia-cli: Added flag to control whether to reset the streams or not ( #18337 )
...
* Added flag on octavia to control wheter to reset the streams or not
* Restore test_api_http_headers
* Going back to reseting by default
2022-12-05 10:12:19 -08:00
Evan Tahler
ea58882fa3
Fix affected connectors ( #19865 )
...
* source-appsflyer
* source-cart
* source-chargebee
* source-lemlist
* source-linnworks
* source-mailgun
* source-pardot
* source-plaid
* source-prestashop
* source-quickbooks-singer
* source-recharge
* source-tplcentral
* remove icons that aren't real
* Remove TODOs
* add missing specs
* Update docs/integrations/sources/primetric.md
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com >
* bump readmes
* revert ci_check_deps logic
* New name
Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com >
2022-11-30 09:51:21 -08:00
Evan Tahler
3d053e32ee
Use Nginx + Basic Auth to secure OSS Airbyte ( #17694 )
...
* Use Nginx + Basic Auth to secure OSS Airbyte
* use local passwords
* Use gradle builds
* K8s setup and source values from ENV
* note about disabling
* add back defaults
* custom 401 page
* update http message
* update docs
* remove kube files
* additional doc updates
* Add a test suite
* fix failure exit codes
* doc updates
* Add docs
* bump to re-test
* add more sleep in tests for CI
* better sleep in test
* Update docs/operator-guides/security.md
Co-authored-by: Davin Chia <davinchia@gmail.com >
* PR updates
* test comment
* change test host on CI
* update tests and nginx to boot without backend
* proxy updates for docker DNS
* simpler test for uptime
* acceptance test skips PWs
* remove resolver madness
* fixup tests
* more proxy_pass revert
* update acceptance test exit codes
* relax test expectations
* add temporal mount back for testing
* Update docs/operator-guides/security.md
Co-authored-by: swyx <shawnthe1@gmail.com >
* Update airbyte-proxy/401.html
Co-authored-by: swyx <shawnthe1@gmail.com >
* more doc updates
* Octavia CLI uses Basic Auth (#17982 )
* [WIP] Octavia CLI uses Basic Auth
* readme
* augustin: add basic auth headers to clien
* augustin: add basic auth headers to client
* tests passing
* lint
* docs
* Move monkey patch to test
* coerce headers into strings
* monkey patch get_basic_auth_token
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
* fix launch permissions
* Keep worker port internal
* more readme
Co-authored-by: Davin Chia <davinchia@gmail.com >
Co-authored-by: swyx <shawnthe1@gmail.com >
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
2022-10-19 15:52:01 -07:00
Liren Tu
04236ac404
📝 S3 destination: fix typo in the spec field description ( #17153 )
2022-09-26 23:31:47 -07:00
Michael Siega
294ee8f226
Expose cron scheduling in the Connections APIs ( #15253 )
...
* Expose cron scheduling in the Connections APIs
* Update airbyte-api/src/main/openapi/config.yaml
Co-authored-by: terencecho <terence@airbyte.io >
* Update airbyte-server/src/test/java/io/airbyte/server/helpers/ConnectionHelpers.java
Co-authored-by: terencecho <terence@airbyte.io >
* update octavia-cli tests for new schedule schema, and fix update API impl
* check for null schedule data before updating
* handle new schedule related fields in generate / apply / import
* update octavia-cli changelog
* ensure that legacy manual schedule flag is consistent with schedule_type
* update octavia cli test coverage for new schedule schema
* fix failing octavia cli integration tests
* fix file diff check
* Update octavia-cli/unit_tests/test_apply/test_resources.py
Co-authored-by: Augustin <augustin.lafanechere@gmail.com >
Co-authored-by: terencecho <terence@airbyte.io >
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
2022-08-11 19:27:08 +02:00
Daniel Diamond
635cdfbf02
🎉 octavia-cli: Add ability to import all resources ( #14374 )
2022-07-05 19:41:15 +02:00
Daniel Diamond
8b635aa02f
🎉 octavia-cli: Add ability to import existing resources ( #14137 )
2022-07-01 18:23:36 +02:00
Augustin
72af00a649
octavia-cli: fix workspace not having anonymous_data_collection property ( #13869 )
2022-06-17 17:48:40 +02:00
Augustin
a182aca5e6
octavia-cli: per workspace state ( #13070 )
2022-06-15 20:24:32 +02:00
Paweł Kociński
49e82a49f1
octavia-cli: allow user to set custom API HTTP headers( #12893 )
2022-06-15 15:26:53 +02:00
Augustin
f614187124
octavia-cli: enable transformations ( #12727 )
2022-06-07 19:16:25 +02:00
Augustin
c3170f9240
airbyte-api: add jackson model annotations to remove null values from responses ( #13370 )
2022-06-03 12:01:30 +02:00
Alexandre Girard
3894134d11
Bump year in license short to 2022 ( #13191 )
...
* Bump to 2022
* format
2022-05-25 17:56:49 -07:00
Augustin
05b123fa10
🐛 octavia-cli: fix sync_catalog in generated connections ( #12704 )
2022-05-10 08:05:38 +02:00
Augustin
07068b0fe0
🐙 octavia-cli: use model serialization ( #12133 )
2022-05-06 18:55:22 +02:00
Subodh Kant Chaturvedi
405bf4daad
workspaceId should be part of spec request ( #12112 )
...
* workspaceId should be part of spec request
* address review comment
* fix test
* format
* update octavia according to API changes
* create integration test for definition generation
* fix test
* fix test
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
2022-04-22 19:30:06 +05:30
Augustin
b5966e97be
🐛 octavia-cli: fix typo in integration test ( #11912 )
2022-04-12 11:26:57 +02:00
Augustin
9f21fae668
🐛 octavia-cli: use list endpoint instead of list_latest ( #11505 )
2022-03-30 12:07:04 +02:00
Augustin
55ae3f856a
🐛 octavia-cli: propagate open api spec update ( #11441 )
2022-03-29 09:31:00 +02:00
Augustin
ba4e86f146
🐙 octavia-cli: secret management ( #10885 )
2022-03-09 21:35:56 +01:00
Marcos Marx
8f49e193f2
🐙 octavia-cli: add generate for connections ( #10809 )
...
* create connection cli command
* add connection.yaml template
* add template file
* remove unused vars and imports
* create group for generate command
* correct connection template
* implement suggestions
* implement suggestions
* fix existing tests
* test resources
* test renderer
* rename renderer module to renderers
* test generate command
* fix yaml style
* fix yaml style
* revert unrelated changes
* revert unrelated changes
* clean
* clean
* add required resource_name field to template
* undo snakecasing + delete jsonschema
* add source_id destination_id to yaml top
* fix
* add json schema in connection integration test
* make write_yaml a base method + implement _render
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com >
2022-03-09 10:06:39 -03:00
Augustin
a9ac813467
use yaml safe load ( #10882 )
2022-03-08 11:52:32 +01:00
Augustin
706d7f1686
🐙 octavia-cli: implement apply ( #10703 )
2022-03-05 19:18:07 +01:00