1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

97 Commits

Author SHA1 Message Date
Alexander Marquardt
721b73df3c Update building-a-python-source.md (#14262) 2022-07-01 12:48:47 +02:00
Alexander Marquardt
6e733f5a91 Update cdk-speedrun.md (#14258)
Added a link at the bottom of the article , so the user may find the more in-depth tutorial about building a real-world connector.
2022-07-01 12:48:12 +02:00
Amruta Ranade
39ef8447f9 Fixed broken link 2022-06-30 17:45:47 -04:00
swyx
d9d06d2191 [docs] fix numbering and incorrect filename in CDK docs (#13045)
* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md
2022-06-28 08:25:09 -03:00
George Claireaux
30c5d2d9a7 🎉 New Source Dockerhub (#13931)
* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>
2022-06-20 15:13:29 +01:00
Alexander Marquardt
6a78aec852 Update 4-connection-checking.md (#13812)
* Update 4-connection-checking.md

As discussed in https://airbytehq-team.slack.com/archives/C02UQ9MJ4GG/p1655312684160609 - this example is misleading, as it does not actually connect to any API to validate connectivity.

* Update 4-connection-checking.md

Added a link to OneSignal check_connection, and move the "Note" to below the example
2022-06-15 21:41:15 +02:00
Charles
22b727c0ea Update Airbyte Protocol Docs (#13709) 2022-06-14 15:04:38 -07:00
Alexander Marquardt
4073099a8d Update building-a-python-source.md (#13348)
* Update building-a-python-source.md

Making it more clear when modifications to source_definitions.yaml will be picked up

* Update building-a-python-source.md

Fixed spelling as per @Amruta-Ranade comment
2022-06-01 11:13:08 +02:00
Topher Lubaway
3a64c25073 Fixes all broken links and enforces no broken (#13152)
* Fixes all broken links and enforces no broken

* Addresses peter's comments

removes unused summary.md: an artifact of gitbook
2022-05-25 15:59:29 -05:00
George Claireaux
2af780db3e base-java: Add utility for AirbyteTraceMessage and naively emit on any connector error (#12614)
* added AirbyteLoggedException class

* adding in int runr

* changes

* refactored to AirbyteTracedException to align with python impl.

* added catch for Exceptions that are already AirbyteTracedException

* refactor to static class & catch with UncaughtExceptionHandler

* testing ExceptionHandler

* add tests

* added docs section on using AirbyteTraceMessageUtility

* made AirbyteMessage maker methods more intuitive

* fix spotbugs errors

* format
2022-05-12 11:08:52 +01:00
swyx
a0b7e4a09b Docs: add reminder to clone repo in CDK speedrun guide (#12761) 2022-05-11 09:08:21 -03:00
Brian Lai
ceec454e30 update python cdk tutorial with updates to exchange rates api (#12427)
* update python cdk tutorial with updates to exchange rates api

* remove extra comment in source.py tutorial sample code
2022-04-29 13:44:04 -07:00
Pedro S. Lopez
0c12ad9136 python generators output spec.yaml files (#12245)
* generators output spec.yaml files

* source-singer generator also uses spec.yaml

* update scaffold

* update python cdk tutorials to use spec.yaml

* add docs updates

* consistency
2022-04-26 07:16:04 -07:00
Francisco Muniz de Paula Neto
1cd3a6bf82 Docs: Update cdk-speedrun.md (#12102)
Changes Embed of url to use simple link in markdown for Python CDK docs
2022-04-18 18:25:15 -03:00
Pedro S. Lopez
a6a6be2588 allow importing IncrementalMixin from airbyte_cdk.sources.streams (#11858)
* allow importing IncrementalMixin from airbyte_cdk.sources.streams

* format file

* update docs with hint on where to import IncrementalMixin from

* bump cdk version to 0.1.54

* update changelog

* only build python 3.9

* update changelog with python dep bump
2022-04-14 11:42:57 -07:00
Pedro S. Lopez
22ebb53ac0 📝 Update "Hard Way" incremental sync tutorial to pass SAT (#11988)
* update incremental sync tutorial to pass SAT

* add instructions for running tests

* pass `future_state_path`

* Update catalog.md
2022-04-14 07:36:22 -07:00
Jared Rhizor
14dfc1d417 fix parentheses and info/warning/danger formatting in docs (#11981)
* fix parens

* fix formatting for hints

* remove hint from non-docusaurus or gitbook doc
2022-04-13 12:08:34 -07:00
Pedro S. Lopez
24720c657d 📝 CDK tutorial: fix incorrect variable in code example (#11837) 2022-04-12 14:40:31 -07:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Sherif A. Nada
b85c51304f 🎉 Update hardway tutorial & generic source template to use SAT (#11908) 2022-04-11 20:12:06 -07:00
Topher Lubaway
c8337ea3ba Add docs sidebar (#11817)
* Brings pairity for doc checks from cloud

* WIP Sidebar config

It's sketchy JSON let's commit before we break i

* MVP sidebars

summary.md is no longer functional
it's higherarchy was translated into sidebar.js
as a JSON format that docusaurus likes

* Removes another unused readme
2022-04-07 14:16:35 -07:00
Pedro S. Lopez
eaa8b94e45 update building connector tutorial incorrect links and typo (#11769)
* fix "Build a Connector the Hard Way" doc typos and broken links

* Update adding-incremental-sync.md
2022-04-07 08:59:02 -07:00
Jared Rhizor
526c5a0c64 automatically figure out ARM-related variables (#11450)
* automatically figure out ARM-related variables

* clean up

* explicitly use amd64-prefixed versions of alpine and postgres
2022-03-31 13:58:46 -07:00
Greg Solovyev
e07f12dc41 Update incremental sync tutorial to match recent changes in build-a-connector tutorial (#11126) 2022-03-16 09:30:27 -07:00
Greg Solovyev
d84e852ac6 Greg/source connector guide (#11082)
Original API used in the example is no longer free, so while following the tutorial I found a different API to use in the tutorial and updated the example code to match the new API. Also made a few small changes.

Update Build-a-connector tutorial
 * Update screenshots and instructions to match current UI
 * Update code examples to use Polygon.io API
 * Add links to language-specific guides
 * Consistently use Python (uppercase P) when referring to the language
   and python (lowercase) p in code samples
 * Consistently do not use "." in lists
 * Add an image of Airbyte startup banner
 * Add a note for M1 macs
 * Remove unused images
 * Make Dockerfile consistent with the tutorial
2022-03-14 13:33:10 -07:00
Ramon Vermeulen
f0b0cbe191 Docs: incorrect line number (#11112)
incorrect line number in documentation
2022-03-14 17:14:54 -03:00
LiRen Tu
d57408269b 📝 Add connector-name examples in java profiling doc (#11006) 2022-03-09 14:38:28 -08:00
LiRen Tu
80a2b642f9 📝 Document java connector memory profiling (#10983)
* Add doc for java connector memory profiling

* Add doc to summary

* Update doc

* Update doc

* Update doc
2022-03-09 05:58:33 -08:00
Eugene Kulak
d173ce741f CDK: add support for streams with state attribute (#9746)
* add support for streams with state attribute
* fix pre-commit and format
* update state attribute docs and logic
* added IncrementalMixin

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
2022-02-17 00:20:33 +04:00
Anuj Gupta
ecfc9e1cc5 Correcting base URL for the example API (#9245) 2022-01-13 07:25:13 -03:00
Edward Gao
d0f9aa8907 Update "Building a connector the hard way" doc (#9008) 2021-12-21 10:50:59 -08:00
Marcos Marx
a82d04f688 Docs: correct youtube video link for CDK Speedrun(#7256) 2021-10-21 17:32:48 -03:00
Jared Rhizor
1affb14827 even more link fixes (#7148)
* even more link fixes

* add remaining exchangerates items
2021-10-20 12:56:55 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
f52b67dec9 Rich embed the CDK Speedrun video. (#6915)
* Rich embed the CDK Speedrun video.

* Fix attempt 1.'

* Remove link.
2021-10-08 14:12:17 -07:00
Abhi Vaidyanatha
ca61cd1dfd Add CDK video to CDK Speedrun doc. (#6914) 2021-10-08 14:00:59 -07:00
Abhi Vaidyanatha
fa0bd551ef Switch out old Speedrun Tutorial. (#6236)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-17 16:30:54 -07:00
Harsha Teja Kanna
84b3fbd8db 🎉 Added optional platform flag for build image script (#6000) 2021-09-14 23:37:07 -07:00
Abhi Vaidyanatha
e7413de0dc Add a variant of the CDK speedrun that uses the PokeAPI (#5780)
* Add a variant of the CDK speedrun that uses the PokeAPI

* Make a lot of clarifications to improve the learning experience.

* Gradle format

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-08 14:56:13 -07:00
Abhi Vaidyanatha
8fcaba4fab Fix CDK speedrun stream stub (#5778)
* Fix CDK speedrun stream stub

* Add start_date back

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-08 14:44:34 -07:00
Jenny Brown
6a3b594574 Clarified wording that confused a new connector developer (#5558) 2021-08-25 16:09:49 -05:00
Yaroslav Dudar
8ddce6f355 🎉 Python CDK: Allow to ignore http status errors and override retry parameters (#5363)
added auto_fail_on_errors, max_retries, retry_factor properties to python cdk
2021-08-25 10:31:24 +03:00
LiRen Tu
2906ec287a CI: Add action to check broken doc links (#5254)
* Add action to check broken doc links

* Ignore localhost

* Update config

* Fix broken links

* Use quiet mode

* Ignore PR link

* Fix more broken links

* Fix more broken links

* Fix more broken links

* Verify pattern

* Fix more broken links

* Separate full and pr check

* Update pattern

* Test invalid link

* Remove invalid link
2021-08-07 14:28:02 -07:00
Abhi Vaidyanatha
71d2f7937b Fix link to match GitBook syntax (#5065)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-28 19:17:52 -07:00
Abhi Vaidyanatha
e7dbf52ffa Fix really old broken links (#5064)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-28 19:14:05 -07:00
Abhi Vaidyanatha
e338b2a0ce Fix all broken docs links found by Ahrefs (#5060)
* Fix broken links found by Ahrefs

* Fix another handbook link

* Fix links in meltano

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-28 16:49:45 -07:00
Abhi Vaidyanatha
3765bcf3b8 Refactor docs to improve clarity around connector development. (#5037)
* Refactor docs to improve clarity around connector development.

* Merge architecture and setup of source acceptance tests to reference

* Address reviewsa

* Address review comments

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-28 14:00:08 -07:00