1
0
mirror of synced 2025-12-26 14:02:10 -05:00
Commit Graph

60 Commits

Author SHA1 Message Date
Luke Hsiao
84ab12f93d Docs: Update building-a-python-destination.md (#19516)
If a user used `append_dedupe`, they get the error:

```
{
  "type": "LOG",
  "log": {
    "level": "FATAL",
    "message": "1 validation error for ConnectorSpecification\nsupported_destination_sync_modes -> 2\n  value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])..."
  }
}
```
2022-11-29 17:42:36 -03:00
Ella Rohm-Ensing
f22485a908 Add improvements to "Building a connector the hard way" (#19093)
* Add improvements to "Building a connector the hard way"

* add log_error() formatting to pass SAT tests

* Update to new version of acceptance-test-config.yml

* Edit tutorial directory to match tutorial

* Change permissions on acceptance-test-docker.sh

This reverts commit 40b2d98053.
2022-11-08 17:13:21 -05:00
Pinhas Keizman
4a61e6aaa3 Update cdk-speedrun.md (#18416) 2022-10-25 08:31:56 -03:00
Tanvesh Takawale
da5aed8a31 CDK: fixed document links regarding airbyte specification (#18169) 2022-10-19 09:50:01 -07:00
Robert
c13d03b06c Docs: Fix some typos in connection-checking.yml (#17028)
Fixes some formatting issues and hopefully makes the guide slightly easier to follow.
2022-09-22 11:59:37 -03:00
BM
4a7461064b Docs: link removed. (#16688) 2022-09-14 08:28:47 -03:00
Augustin
e253b98260 doc: add airbyte_secret field in example (#16374) 2022-09-07 09:29:52 +02:00
Augustin
4df0a48427 cdk and docs: remove "additionalProperties" (#14881) 2022-07-22 15:34:27 +02:00
Brian Lai
7bff12aea5 [#3078] [CDK] Add support for enabling debug from command line and some basic general debug logs (#14521)
* allow for command line debug option and basic debug statements + declarative

* feedback from pr comments

* fix some tests w/ req/res mixed up and fixing logging tests

* formatting

* pr feedback: cleaning up traces in logger.py and update docs with debug configuration

* remove unneeded trace logger test

* remove extra print statement
2022-07-13 18:01:07 -04:00
Amruta Ranade
47d41ee7b2 fixing broken things in docs (#14685) 2022-07-13 13:53:23 -04:00
Amruta Ranade
c1b9f82239 Docs: Fixed broken links (#14622)
* fixing broken links

* more broken links
2022-07-12 10:12:54 -04:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
Alexander Marquardt
721b73df3c Update building-a-python-source.md (#14262) 2022-07-01 12:48:47 +02:00
Alexander Marquardt
6e733f5a91 Update cdk-speedrun.md (#14258)
Added a link at the bottom of the article , so the user may find the more in-depth tutorial about building a real-world connector.
2022-07-01 12:48:12 +02:00
Amruta Ranade
39ef8447f9 Fixed broken link 2022-06-30 17:45:47 -04:00
swyx
d9d06d2191 [docs] fix numbering and incorrect filename in CDK docs (#13045)
* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md
2022-06-28 08:25:09 -03:00
George Claireaux
30c5d2d9a7 🎉 New Source Dockerhub (#13931)
* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>
2022-06-20 15:13:29 +01:00
Alexander Marquardt
6a78aec852 Update 4-connection-checking.md (#13812)
* Update 4-connection-checking.md

As discussed in https://airbytehq-team.slack.com/archives/C02UQ9MJ4GG/p1655312684160609 - this example is misleading, as it does not actually connect to any API to validate connectivity.

* Update 4-connection-checking.md

Added a link to OneSignal check_connection, and move the "Note" to below the example
2022-06-15 21:41:15 +02:00
Charles
22b727c0ea Update Airbyte Protocol Docs (#13709) 2022-06-14 15:04:38 -07:00
Alexander Marquardt
4073099a8d Update building-a-python-source.md (#13348)
* Update building-a-python-source.md

Making it more clear when modifications to source_definitions.yaml will be picked up

* Update building-a-python-source.md

Fixed spelling as per @Amruta-Ranade comment
2022-06-01 11:13:08 +02:00
Topher Lubaway
3a64c25073 Fixes all broken links and enforces no broken (#13152)
* Fixes all broken links and enforces no broken

* Addresses peter's comments

removes unused summary.md: an artifact of gitbook
2022-05-25 15:59:29 -05:00
George Claireaux
2af780db3e base-java: Add utility for AirbyteTraceMessage and naively emit on any connector error (#12614)
* added AirbyteLoggedException class

* adding in int runr

* changes

* refactored to AirbyteTracedException to align with python impl.

* added catch for Exceptions that are already AirbyteTracedException

* refactor to static class & catch with UncaughtExceptionHandler

* testing ExceptionHandler

* add tests

* added docs section on using AirbyteTraceMessageUtility

* made AirbyteMessage maker methods more intuitive

* fix spotbugs errors

* format
2022-05-12 11:08:52 +01:00
swyx
a0b7e4a09b Docs: add reminder to clone repo in CDK speedrun guide (#12761) 2022-05-11 09:08:21 -03:00
Brian Lai
ceec454e30 update python cdk tutorial with updates to exchange rates api (#12427)
* update python cdk tutorial with updates to exchange rates api

* remove extra comment in source.py tutorial sample code
2022-04-29 13:44:04 -07:00
Pedro S. Lopez
0c12ad9136 python generators output spec.yaml files (#12245)
* generators output spec.yaml files

* source-singer generator also uses spec.yaml

* update scaffold

* update python cdk tutorials to use spec.yaml

* add docs updates

* consistency
2022-04-26 07:16:04 -07:00
Francisco Muniz de Paula Neto
1cd3a6bf82 Docs: Update cdk-speedrun.md (#12102)
Changes Embed of url to use simple link in markdown for Python CDK docs
2022-04-18 18:25:15 -03:00
Pedro S. Lopez
a6a6be2588 allow importing IncrementalMixin from airbyte_cdk.sources.streams (#11858)
* allow importing IncrementalMixin from airbyte_cdk.sources.streams

* format file

* update docs with hint on where to import IncrementalMixin from

* bump cdk version to 0.1.54

* update changelog

* only build python 3.9

* update changelog with python dep bump
2022-04-14 11:42:57 -07:00
Pedro S. Lopez
22ebb53ac0 📝 Update "Hard Way" incremental sync tutorial to pass SAT (#11988)
* update incremental sync tutorial to pass SAT

* add instructions for running tests

* pass `future_state_path`

* Update catalog.md
2022-04-14 07:36:22 -07:00
Jared Rhizor
14dfc1d417 fix parentheses and info/warning/danger formatting in docs (#11981)
* fix parens

* fix formatting for hints

* remove hint from non-docusaurus or gitbook doc
2022-04-13 12:08:34 -07:00
Pedro S. Lopez
24720c657d 📝 CDK tutorial: fix incorrect variable in code example (#11837) 2022-04-12 14:40:31 -07:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Sherif A. Nada
b85c51304f 🎉 Update hardway tutorial & generic source template to use SAT (#11908) 2022-04-11 20:12:06 -07:00
Topher Lubaway
c8337ea3ba Add docs sidebar (#11817)
* Brings pairity for doc checks from cloud

* WIP Sidebar config

It's sketchy JSON let's commit before we break i

* MVP sidebars

summary.md is no longer functional
it's higherarchy was translated into sidebar.js
as a JSON format that docusaurus likes

* Removes another unused readme
2022-04-07 14:16:35 -07:00
Pedro S. Lopez
eaa8b94e45 update building connector tutorial incorrect links and typo (#11769)
* fix "Build a Connector the Hard Way" doc typos and broken links

* Update adding-incremental-sync.md
2022-04-07 08:59:02 -07:00
Jared Rhizor
526c5a0c64 automatically figure out ARM-related variables (#11450)
* automatically figure out ARM-related variables

* clean up

* explicitly use amd64-prefixed versions of alpine and postgres
2022-03-31 13:58:46 -07:00
Greg Solovyev
e07f12dc41 Update incremental sync tutorial to match recent changes in build-a-connector tutorial (#11126) 2022-03-16 09:30:27 -07:00
Greg Solovyev
d84e852ac6 Greg/source connector guide (#11082)
Original API used in the example is no longer free, so while following the tutorial I found a different API to use in the tutorial and updated the example code to match the new API. Also made a few small changes.

Update Build-a-connector tutorial
 * Update screenshots and instructions to match current UI
 * Update code examples to use Polygon.io API
 * Add links to language-specific guides
 * Consistently use Python (uppercase P) when referring to the language
   and python (lowercase) p in code samples
 * Consistently do not use "." in lists
 * Add an image of Airbyte startup banner
 * Add a note for M1 macs
 * Remove unused images
 * Make Dockerfile consistent with the tutorial
2022-03-14 13:33:10 -07:00
Ramon Vermeulen
f0b0cbe191 Docs: incorrect line number (#11112)
incorrect line number in documentation
2022-03-14 17:14:54 -03:00
LiRen Tu
d57408269b 📝 Add connector-name examples in java profiling doc (#11006) 2022-03-09 14:38:28 -08:00
LiRen Tu
80a2b642f9 📝 Document java connector memory profiling (#10983)
* Add doc for java connector memory profiling

* Add doc to summary

* Update doc

* Update doc

* Update doc
2022-03-09 05:58:33 -08:00
Eugene Kulak
d173ce741f CDK: add support for streams with state attribute (#9746)
* add support for streams with state attribute
* fix pre-commit and format
* update state attribute docs and logic
* added IncrementalMixin

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
2022-02-17 00:20:33 +04:00
Anuj Gupta
ecfc9e1cc5 Correcting base URL for the example API (#9245) 2022-01-13 07:25:13 -03:00
Edward Gao
d0f9aa8907 Update "Building a connector the hard way" doc (#9008) 2021-12-21 10:50:59 -08:00
Marcos Marx
a82d04f688 Docs: correct youtube video link for CDK Speedrun(#7256) 2021-10-21 17:32:48 -03:00
Jared Rhizor
1affb14827 even more link fixes (#7148)
* even more link fixes

* add remaining exchangerates items
2021-10-20 12:56:55 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
f52b67dec9 Rich embed the CDK Speedrun video. (#6915)
* Rich embed the CDK Speedrun video.

* Fix attempt 1.'

* Remove link.
2021-10-08 14:12:17 -07:00
Abhi Vaidyanatha
ca61cd1dfd Add CDK video to CDK Speedrun doc. (#6914) 2021-10-08 14:00:59 -07:00
Abhi Vaidyanatha
fa0bd551ef Switch out old Speedrun Tutorial. (#6236)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-17 16:30:54 -07:00