1
0
mirror of synced 2025-12-22 03:21:25 -05:00
Commit Graph

74 Commits

Author SHA1 Message Date
Ben Church
f2944dd59b Docs: Metadata add docs ahead of merge (#26015)
* Cherry pick docs files from  metadata-service/feat-remove-definitions

* Add link to checklist

* Fix docasaurus error
2023-05-11 16:10:13 -05:00
Rodi Reich Zilberman
0bab1756b8 Rename airbyte-config module (#24885)
* rename airbyte-config module

* Automated Commit - Formatting Changes

* sanity

* update import

* update import

* update script

* update script

* update script

* update script

* Automated Change

* Automated Change

* Automated Change

* Automated Change

* update awsdatalake icon

* point slash commands to new path

* sanity

* Automated Commit - Formatting Changes

* sanity

* Automated Change

* Automated Change

* sanity

---------

Co-authored-by: rodireich <rodireich@users.noreply.github.com>
2023-04-06 10:47:30 -07:00
Cyril ALFARO
85ba3683df Fix: Make the test commands consistent with the first line (#21904)
Small fixed just to be clear

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-03-17 15:02:23 -03:00
Edward Gao
294cdbcf4a Normalization Bigquery: Add more reserved words (#24077)
* add current times for bigquery

* bump version + changelog
2023-03-15 18:33:59 +00:00
Alexandre Girard
9864e4bf19 Update links (#24100)
* Update links

* Add missing files
2023-03-15 10:20:44 -07:00
Alexandre Girard
5fecc7e626 add missing newline (#24035)
* add missing newline

* Automated Commit - Formatting Changes

---------

Co-authored-by: girarda <girarda@users.noreply.github.com>
2023-03-14 00:37:34 +00:00
Sherif A. Nada
1bc1ecfe6a Fix broken links in CDK speedrun tutorial (#24006) 2023-03-13 17:11:52 -07:00
Sophia Wiley
5512befeb1 Docs: updated links from .io to .com (#23652)
* updated links

* edited contributors link

* deleted line about CDK in docs
2023-03-06 17:27:55 +01:00
Prateek Mukhedkar
531627ebff Set sync_mode as incremental instead of full refresh in catalog specifying incremental sync (#22183)
Co-authored-by: prateekmukhedkar <prateek@airbyte.io>
2023-02-07 15:37:38 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Julian
710d8ee06f Docs Fixed: Broken link ConnectorSpecification #21052 (#21081) 2023-01-31 19:09:16 +00:00
Maxime Carbonneau-Leclerc
57dffd6154 [docs] update CDK Tutorial: Python HTTP (#22069)
* [docs] update CDK Tutorial: Python HTTP

* Update airbyte-cdk/python/docs/tutorials/cdk-tutorial-python-http/6-read-data.md

Co-authored-by: Sergio Ropero <42538006+sergio-ropero@users.noreply.github.com>

* Code review

---------

Co-authored-by: Sergio Ropero <42538006+sergio-ropero@users.noreply.github.com>
2023-01-30 18:00:11 +00:00
Sergio Ropero
12c22fb891 fix: Create your own source connector tutorial (#21985)
* First commit

* Fix some required parts and added extra information.
two tests failing:
```
       2 failed
         - ../actions-runner/_work/airbyte/airbyte/airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py:699 TestBasicRead.test_airbyte_trace_message_on_failure[inputs0]
         - ../actions-runner/_work/airbyte/airbyte/airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_incremental.py:196 TestIncremental.test_read_sequential_slices[inputs0]
```

* Improve message

* Remove copy-paste line :D
2023-01-30 18:04:22 +01:00
Jimmy Ma
c6b8279386 Add dependencies to docker-compose (#19321)
* Revert "Revert "Add dependencies to docker-compose (#19257)" (#19306)"

This reverts commit b16f28fd4d.

* Bump docker-compose version

* test

* Revert "test"

This reverts commit c3b28c9ec3.

* Bump docker compose version to 3.8

* test

* test

* Use a newer docker for platform build

* test

* Use docker compose v2

* Update docker for frontend e2e

* Use docker compose v2 for e2e tests

* Update tools to use docker compose v2

* Update more docker compose references to v2

* Update docker compose usage in docs

* Update deploying airbyte docs

* Fix permission

* Case insensistive check

* Add extra mention for docker compose in upgrading airbyte

* Improve upgrade docker note
2023-01-12 10:41:00 -08:00
Luke Hsiao
84ab12f93d Docs: Update building-a-python-destination.md (#19516)
If a user used `append_dedupe`, they get the error:

```
{
  "type": "LOG",
  "log": {
    "level": "FATAL",
    "message": "1 validation error for ConnectorSpecification\nsupported_destination_sync_modes -> 2\n  value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])..."
  }
}
```
2022-11-29 17:42:36 -03:00
Ella Rohm-Ensing
f22485a908 Add improvements to "Building a connector the hard way" (#19093)
* Add improvements to "Building a connector the hard way"

* add log_error() formatting to pass SAT tests

* Update to new version of acceptance-test-config.yml

* Edit tutorial directory to match tutorial

* Change permissions on acceptance-test-docker.sh

This reverts commit 40b2d98053.
2022-11-08 17:13:21 -05:00
Pinhas Keizman
4a61e6aaa3 Update cdk-speedrun.md (#18416) 2022-10-25 08:31:56 -03:00
Tanvesh Takawale
da5aed8a31 CDK: fixed document links regarding airbyte specification (#18169) 2022-10-19 09:50:01 -07:00
Robert
c13d03b06c Docs: Fix some typos in connection-checking.yml (#17028)
Fixes some formatting issues and hopefully makes the guide slightly easier to follow.
2022-09-22 11:59:37 -03:00
BM
4a7461064b Docs: link removed. (#16688) 2022-09-14 08:28:47 -03:00
Augustin
e253b98260 doc: add airbyte_secret field in example (#16374) 2022-09-07 09:29:52 +02:00
Augustin
4df0a48427 cdk and docs: remove "additionalProperties" (#14881) 2022-07-22 15:34:27 +02:00
Brian Lai
7bff12aea5 [#3078] [CDK] Add support for enabling debug from command line and some basic general debug logs (#14521)
* allow for command line debug option and basic debug statements + declarative

* feedback from pr comments

* fix some tests w/ req/res mixed up and fixing logging tests

* formatting

* pr feedback: cleaning up traces in logger.py and update docs with debug configuration

* remove unneeded trace logger test

* remove extra print statement
2022-07-13 18:01:07 -04:00
Amruta Ranade
47d41ee7b2 fixing broken things in docs (#14685) 2022-07-13 13:53:23 -04:00
Amruta Ranade
c1b9f82239 Docs: Fixed broken links (#14622)
* fixing broken links

* more broken links
2022-07-12 10:12:54 -04:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
Alexander Marquardt
721b73df3c Update building-a-python-source.md (#14262) 2022-07-01 12:48:47 +02:00
Alexander Marquardt
6e733f5a91 Update cdk-speedrun.md (#14258)
Added a link at the bottom of the article , so the user may find the more in-depth tutorial about building a real-world connector.
2022-07-01 12:48:12 +02:00
Amruta Ranade
39ef8447f9 Fixed broken link 2022-06-30 17:45:47 -04:00
swyx
d9d06d2191 [docs] fix numbering and incorrect filename in CDK docs (#13045)
* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md
2022-06-28 08:25:09 -03:00
George Claireaux
30c5d2d9a7 🎉 New Source Dockerhub (#13931)
* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>
2022-06-20 15:13:29 +01:00
Alexander Marquardt
6a78aec852 Update 4-connection-checking.md (#13812)
* Update 4-connection-checking.md

As discussed in https://airbytehq-team.slack.com/archives/C02UQ9MJ4GG/p1655312684160609 - this example is misleading, as it does not actually connect to any API to validate connectivity.

* Update 4-connection-checking.md

Added a link to OneSignal check_connection, and move the "Note" to below the example
2022-06-15 21:41:15 +02:00
Charles
22b727c0ea Update Airbyte Protocol Docs (#13709) 2022-06-14 15:04:38 -07:00
Alexander Marquardt
4073099a8d Update building-a-python-source.md (#13348)
* Update building-a-python-source.md

Making it more clear when modifications to source_definitions.yaml will be picked up

* Update building-a-python-source.md

Fixed spelling as per @Amruta-Ranade comment
2022-06-01 11:13:08 +02:00
Topher Lubaway
3a64c25073 Fixes all broken links and enforces no broken (#13152)
* Fixes all broken links and enforces no broken

* Addresses peter's comments

removes unused summary.md: an artifact of gitbook
2022-05-25 15:59:29 -05:00
George Claireaux
2af780db3e base-java: Add utility for AirbyteTraceMessage and naively emit on any connector error (#12614)
* added AirbyteLoggedException class

* adding in int runr

* changes

* refactored to AirbyteTracedException to align with python impl.

* added catch for Exceptions that are already AirbyteTracedException

* refactor to static class & catch with UncaughtExceptionHandler

* testing ExceptionHandler

* add tests

* added docs section on using AirbyteTraceMessageUtility

* made AirbyteMessage maker methods more intuitive

* fix spotbugs errors

* format
2022-05-12 11:08:52 +01:00
swyx
a0b7e4a09b Docs: add reminder to clone repo in CDK speedrun guide (#12761) 2022-05-11 09:08:21 -03:00
Brian Lai
ceec454e30 update python cdk tutorial with updates to exchange rates api (#12427)
* update python cdk tutorial with updates to exchange rates api

* remove extra comment in source.py tutorial sample code
2022-04-29 13:44:04 -07:00
Pedro S. Lopez
0c12ad9136 python generators output spec.yaml files (#12245)
* generators output spec.yaml files

* source-singer generator also uses spec.yaml

* update scaffold

* update python cdk tutorials to use spec.yaml

* add docs updates

* consistency
2022-04-26 07:16:04 -07:00
Francisco Muniz de Paula Neto
1cd3a6bf82 Docs: Update cdk-speedrun.md (#12102)
Changes Embed of url to use simple link in markdown for Python CDK docs
2022-04-18 18:25:15 -03:00
Pedro S. Lopez
a6a6be2588 allow importing IncrementalMixin from airbyte_cdk.sources.streams (#11858)
* allow importing IncrementalMixin from airbyte_cdk.sources.streams

* format file

* update docs with hint on where to import IncrementalMixin from

* bump cdk version to 0.1.54

* update changelog

* only build python 3.9

* update changelog with python dep bump
2022-04-14 11:42:57 -07:00
Pedro S. Lopez
22ebb53ac0 📝 Update "Hard Way" incremental sync tutorial to pass SAT (#11988)
* update incremental sync tutorial to pass SAT

* add instructions for running tests

* pass `future_state_path`

* Update catalog.md
2022-04-14 07:36:22 -07:00
Jared Rhizor
14dfc1d417 fix parentheses and info/warning/danger formatting in docs (#11981)
* fix parens

* fix formatting for hints

* remove hint from non-docusaurus or gitbook doc
2022-04-13 12:08:34 -07:00
Pedro S. Lopez
24720c657d 📝 CDK tutorial: fix incorrect variable in code example (#11837) 2022-04-12 14:40:31 -07:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Sherif A. Nada
b85c51304f 🎉 Update hardway tutorial & generic source template to use SAT (#11908) 2022-04-11 20:12:06 -07:00
Topher Lubaway
c8337ea3ba Add docs sidebar (#11817)
* Brings pairity for doc checks from cloud

* WIP Sidebar config

It's sketchy JSON let's commit before we break i

* MVP sidebars

summary.md is no longer functional
it's higherarchy was translated into sidebar.js
as a JSON format that docusaurus likes

* Removes another unused readme
2022-04-07 14:16:35 -07:00
Pedro S. Lopez
eaa8b94e45 update building connector tutorial incorrect links and typo (#11769)
* fix "Build a Connector the Hard Way" doc typos and broken links

* Update adding-incremental-sync.md
2022-04-07 08:59:02 -07:00
Jared Rhizor
526c5a0c64 automatically figure out ARM-related variables (#11450)
* automatically figure out ARM-related variables

* clean up

* explicitly use amd64-prefixed versions of alpine and postgres
2022-03-31 13:58:46 -07:00