jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-07 00:05:48 -05:00
Code Issues Packages Projects Releases Wiki Activity
4,013 Commits 5,180 Branches 518 Tags
b424c1a0e78141fcaef61ba09caf9541772ea347
Commit Graph

44 Commits

Author SHA1 Message Date
Vadym
f2f224fe08 Update SAT for validate_data_points Test Basic Read option. (#8342) 2021-11-30 21:06:14 +02:00
Sherif A. Nada
ad3b7be4c0 Document how to order spec fields in the UI 2021-11-18 19:14:46 -08:00
Lake Mossman
34565c6767 Add better command for generating seed specs to readme 2021-11-18 10:44:18 -08:00
Abhi Vaidyanatha
2aea2e0816 Fix a bunch of broken links. (#8083) 2021-11-18 09:55:20 -08:00
Sherif A. Nada
e15c2a925f Fix UX handbook assets (#8020) 2021-11-16 11:02:07 -08:00
Maksym Pavlenok
c0cc288f97 🎉 CI secrets: migration to GSM (#7528) 
* fix 404 responses for the ticket_comments stream

* add unit test

* add unit test

* add oauth2 access token

* Update airbyte-integrations/connectors/source-zendesk-support/source_zendesk_support/streams.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* switching among auth methods

* update spec file

* update CI secrets logic

* update CI secrets logic

* remove debug data

* add a debug message

* fix json convertation

* fix json convertation

* support one secret by several connectors

* Update tools/bin/ci_credentials.sh

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update tools/bin/ci_credentials.sh

Co-authored-by: LiRen Tu <tuliren@gmail.com>

* update function names

* update docs

* reset failed changes

* update json set value

* update secrets json key

* Update tools/bin/ci_credentials.sh


* add JSON validation

* Update docs/connector-development/README.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* update doc

* Update README.md

* rename the function write_standard_creds

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: LiRen Tu <tuliren@gmail.com>
 2021-11-10 10:49:44 +02:00
Aaditya S
6b0e9da4bf 📚 Fix typo in the cdk documentation (#7784) 2021-11-09 07:48:22 -08:00
Lake Mossman
09fce77107 REDO: Generate seed connector specs on build (#7613) 
* add specs module with logic to fetch specs on build

* format + build and add gradle dependency for new script

* check seed file for existing specs + refactor

* add tests + a bit more refactoring

* run gw format

* update yaml config persistence to merge specs into definitions

* add comment

* add dep

* add tests for GcsBucketSpecFetcher

* get rid of static block + format

* DRY up parse call

* add GCS details to comment

* formatting + fix test

* update comment

* do not format seed specs files

* change signature of run to allow cloud to reuse this script

* run gw format

* revert commits that change signature of run

* fix comment typo

Co-authored-by: Davin Chia <davinchia@gmail.com>

* rename enum to be distinct from the enum in cloud

* add missing dependencies between modules

* add readme for seed connector spec generator

* reword

* reference readme in comment

* ignore 'spec' field in newFields logic

* rearrange dependencies so that CONNECTORS_BASE build does not depend on SeedConnectorSpecGenerator

* run format

* add some more helpful info to the GCS fetch failure message

* add more info

* get rid of unnecessary static block

* Fix publishing docs (#7589)

* Fix publishing docs

* Reorder steps and add a comment about rebuilding the platform

* Update README.md

Co-authored-by: Lake Mossman <lake@airbyte.io>

* add dependency and rebuild

* update PR template with seed connector generation steps

* revert formatting changes to PR template

* Update build.gradle

* Remove unnecessary dep

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Christophe Duong <christophe.duong@gmail.com>
 2021-11-04 17:06:16 -07:00
Sherif Nada
25c45c50f7 move handbook up one level 2021-11-01 20:14:01 -07:00
Sherif A. Nada
6b2eb71274 Add connector development UX handbook (#7553) 2021-11-01 20:07:21 -07:00
vitaliizazmic
1d922ca5fc 🐛 Source Facebook Marketing: SAT ignored fields in TestFullRefresh.test_sequential_reads 
* Source Facebook Marketing #5190 - estimate cost_per_estimated_ad_recallers for AdsInsights streams if not presented in records

* Source Facebook Marketing #5190 - add ignored fields to full refresh test

* Source Facebook Marketing #5190 - annotations

* Source Facebook Marketing #5190 - reformat

* SAT #5190 - delete remove_ignored_fields

* Source Facebook Marketing #5190 - use dpath util for excluding fields

* Facebook marketing #5190 - follow EAFP principle

* Facebook Marketing #5190 - add unit tests.

* Source Facebook Marketing #5190 - fixing according to PR

* Source Facebook Marketing #5190 - support ignored fields by stream

* Source Facebook Marketing #5190 - update docs

* Source Facebook Marketing #5190 - merge conflicts

* Source Facebook Marketing #5190 - bump SAT version

* Source Facebook Marketing #5190 - fixing unit tests

* Source Facebook Marketing #5190 - bump
 2021-11-01 17:45:06 +02:00
Marcos Marx
a82d04f688 Docs: correct youtube video link for CDK Speedrun(#7256) 2021-10-21 17:32:48 -03:00
Jared Rhizor
1affb14827 even more link fixes (#7148) 
* even more link fixes

* add remaining exchangerates items
 2021-10-20 12:56:55 -07:00
Arthur Galuza
f0debaad32 🎉 Document stream caching (#6846) 
* Upd docs: add caching section

* Upd docs

* Update docs/connector-development/cdk-python/http-streams.md

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>

* Remove link to details

* Update docs/connector-development/cdk-python/http-streams.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/connector-development/cdk-python/http-streams.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Add demo snippet

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-10-14 16:35:29 +03:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
f52b67dec9 Rich embed the CDK Speedrun video. (#6915) 
* Rich embed the CDK Speedrun video.

* Fix attempt 1.'

* Remove link.
 2021-10-08 14:12:17 -07:00
Abhi Vaidyanatha
ca61cd1dfd Add CDK video to CDK Speedrun doc. (#6914) 2021-10-08 14:00:59 -07:00
Sherif A. Nada
c5e74cf335 Make spec storybook more prominent in docs 2021-09-29 00:29:29 -07:00
Dmytro
1c5ac5b5ea 🏗️ Python CDK: add schema transformer class (#6139) 
* Python CDK: add schema transformer class
 2021-09-27 13:07:17 +03:00
Marcos Marx
b4cca602ca Source Google Search Console: correct spec.json file (#6222) 
* correct spec.json file

* bump version

* bump version

* update doc for connector spec ref

Co-authored-by: Marcos Marx <marcosmarx@MacBook-Pro-de-Marcos.local>
 2021-09-23 02:06:31 -03:00
Abhi Vaidyanatha
fa0bd551ef Switch out old Speedrun Tutorial. (#6236) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-09-17 16:30:54 -07:00
Harsha Teja Kanna
84b3fbd8db 🎉 Added optional platform flag for build image script (#6000) 2021-09-14 23:37:07 -07:00
Abhi Vaidyanatha
e7413de0dc Add a variant of the CDK speedrun that uses the PokeAPI (#5780) 
* Add a variant of the CDK speedrun that uses the PokeAPI

* Make a lot of clarifications to improve the learning experience.

* Gradle format

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-09-08 14:56:13 -07:00
Abhi Vaidyanatha
8fcaba4fab Fix CDK speedrun stream stub (#5778) 
* Fix CDK speedrun stream stub

* Add start_date back

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-09-08 14:44:34 -07:00
Sherif A. Nada
74d6c07004 📚 Link to how to preview connector specifications in the UI (#5894) 2021-09-07 17:15:13 -07:00
Dmytro
8d2cd1e798 🎉 Tool for generation catalog schema from OpenAPI definition file (#5734) 
* Add tool for generating catalog json schema from openapi definition file
 2021-09-01 21:35:43 +03:00
Dmytro
47172577d3 SAT: check records to comply jsonschema format field (#5661) 
* SAT: check records to comply jsonschema format field
 2021-09-01 13:12:31 +03:00
Abhi Vaidyanatha
516d276893 Add Faros CDK information to CDK docs (#5686) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-27 18:36:37 -07:00
Jenny Brown
6a3b594574 Clarified wording that confused a new connector developer (#5558) 2021-08-25 16:09:49 -05:00
George Claireaux
6106dc3a5b made ordering requirement more clear for stream_slices (#5627) 2021-08-25 18:40:58 +01:00
Yaroslav Dudar
8ddce6f355 🎉 Python CDK: Allow to ignore http status errors and override retry parameters (#5363) 
added auto_fail_on_errors, max_retries, retry_factor properties to python cdk
 2021-08-25 10:31:24 +03:00
Arthur Galuza
51d406d6f2 🎉 Source Github: Add MultipleTokenAuthenticator (#5223) 
* Add multiple token authenticator

* Add MultipleTokenAuthenticator

* Upd docs

* Refactor

* Upd docs

* Fix merge typo

* Upd multiple token support: switch to list of tokens

* Upd multiple token support: refactoring

* Update airbyte-integrations/connectors/source-github/source_github/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update airbyte-integrations/connectors/source-github/source_github/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Cleanup, switch to MultipleTokenAuthenticator completely

* Upd changelog

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-08-19 08:41:14 +03:00
LiRen Tu
2906ec287a CI: Add action to check broken doc links (#5254) 
* Add action to check broken doc links

* Ignore localhost

* Update config

* Fix broken links

* Use quiet mode

* Ignore PR link

* Fix more broken links

* Fix more broken links

* Fix more broken links

* Verify pattern

* Fix more broken links

* Separate full and pr check

* Update pattern

* Test invalid link

* Remove invalid link
 2021-08-07 14:28:02 -07:00
Sherif A. Nada
f7ff9f0024 📚 Document how to obfuscate secrets & accept multiline strings in UI (#5208) 2021-08-05 14:00:52 -07:00
Abhi Vaidyanatha
d0cfb19e70 Link to Slack community from Getting Started and the Python CDK docs (#5217) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-04 21:54:38 -07:00
Abhi Vaidyanatha
e43af9b1c0 Update connector spec reference with specific example. (#5146) 
* Update connector spec reference with specific example.

* Update recommendations for source file

* Address reviews

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-02 16:24:38 -07:00
Sherif A. Nada
d5ea1b4817 📚 Add Connector Specification reference (#5078) 2021-07-30 14:19:23 -07:00
Sherif A. Nada
8500fef413 📚 Add some CDK docs clarifying state checkpointing intervals 2021-07-29 20:31:32 -07:00
George Claireaux
2fe0043014 Temporary solution for hitting secrets limit (#5085) 
* add more-secrets environment to publish and test workflows

* add link to more-secrets environment in relevant docs location
 2021-07-29 22:23:46 +01:00
Abhi Vaidyanatha
71d2f7937b Fix link to match GitBook syntax (#5065) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-28 19:17:52 -07:00
Abhi Vaidyanatha
e7dbf52ffa Fix really old broken links (#5064) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-28 19:14:05 -07:00
Abhi Vaidyanatha
e338b2a0ce Fix all broken docs links found by Ahrefs (#5060) 
* Fix broken links found by Ahrefs

* Fix another handbook link

* Fix links in meltano

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-28 16:49:45 -07:00
Abhi Vaidyanatha
211383d456 Fix broken links in (#5059) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-28 14:14:23 -07:00
Abhi Vaidyanatha
3765bcf3b8 Refactor docs to improve clarity around connector development. (#5037) 
* Refactor docs to improve clarity around connector development.

* Merge architecture and setup of source acceptance tests to reference

* Address reviewsa

* Address review comments

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-07-28 14:00:08 -07:00