jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-22 10:01:28 -05:00
Code Issues Packages Projects Releases Wiki Activity
15,991 Commits 5,357 Branches 518 Tags
ac0357cbffa0031e6fee2c2ef403bbdc179fe347
Commit Graph

92 Commits

Author SHA1 Message Date
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Alexandre Girard
87f051c3a9 Add a walkthrough of building a custom Python connector (#36743) 
Co-authored-by: Natik Gadzhi <natik@respawn.io>
 2024-04-08 21:08:25 -07:00
Zhou
d60ddd4e6e 📝 [docs] update instructions to use new connectors (#36298) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2024-03-27 16:00:33 -03:00
Ella Rohm-Ensing
195408eb15 Airbyte CDK: move from gradle to poetry (#36250) 2024-03-25 18:46:57 -05:00
Natik Gadzhi
0e9bdf314d connector-templates: move generated code from src so airbyte-ci builds it (#36428) 
### What

For newly generated python and low-code connectors, move sources from `src` to `source_%CONN_NAME%` so `airbyte-ci build` can pick them up correctly. Closes #35893.

### What changed?

- Moved the sources from `src`
- Updated package paths in `pyproject.toml` templates

### How to test?

You can make a new connector with `./generate.sh` and verify that it works with Poetry and that it builds with `airbyte-ci build --name source-test`

---
 2024-03-25 10:01:30 -07:00
Zhou
a38fdacdf8 📝 [docs] fix small typo (#36052) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2024-03-20 09:22:11 -03:00
Marius Posta
f90b5d1b62 docs: update and remove some bad content (#36197) 2024-03-15 13:12:37 -07:00
Marius Posta
2c21cfe2be docs: fix or remove broken links (#36185) 2024-03-15 09:07:03 -07:00
Natik Gadzhi
e4ccffbf6e Docs: Tutorials formatting + from scratch connector tutorial cleanup (#33839) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2024-03-07 04:15:27 +00:00
Augustin
84cf59216a doc: remove Node requirements on config based getting started tutorial (#35436) 2024-02-20 04:26:07 -06:00
Augustin
05a1512a7e update doc to reference poetry (#35414) 2024-02-20 07:57:53 +00:00
Natik Gadzhi
68e833104b Docs: review and update connector form scratch documentation and related guides (#33822) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2024-01-02 16:59:51 -08:00
Tim Roes
c5db1e947b 📚 Documentation November 2023 overhaul (#32811) 
Co-authored-by: Natalie Kwong <38087517+nataliekwong@users.noreply.github.com>
Co-authored-by: timroes <timroes@users.noreply.github.com>
Co-authored-by: nataliekwong <nataliekwong@users.noreply.github.com>
 2023-11-26 11:57:38 -08:00
Augustin
b35a2b2907 doc: update connector tutorials to reference airbyte-ci for connector build (#31650) 2023-10-23 22:42:53 +02:00
Evan Tahler
cc5d54558f Docs: remove 'build a python destination' (#31394) 2023-10-13 16:31:40 +00:00
Saku3449
c1a7b961b9 change to use the Exchange Rate Data API access token instead of the … (#29322) 2023-09-04 07:33:38 -05:00
Ben Church
8c52285d41 Update docs for adding a connector (#29344) 2023-08-10 14:11:49 -05:00
Marcos Marx
bdaddd4c20 Docs: update PR template and remove python destination as accepted contributions (#28665) 
* update PR template and remove python destination as accepted contributions

* fix warning callout

* improve speeling
 2023-07-26 10:09:53 -03:00
Ben Church
f2944dd59b Docs: Metadata add docs ahead of merge (#26015) 
* Cherry pick docs files from  metadata-service/feat-remove-definitions

* Add link to checklist

* Fix docasaurus error
 2023-05-11 16:10:13 -05:00
Rodi Reich Zilberman
0bab1756b8 Rename airbyte-config module (#24885) 
* rename airbyte-config module

* Automated Commit - Formatting Changes

* sanity

* update import

* update import

* update script

* update script

* update script

* update script

* Automated Change

* Automated Change

* Automated Change

* Automated Change

* update awsdatalake icon

* point slash commands to new path

* sanity

* Automated Commit - Formatting Changes

* sanity

* Automated Change

* Automated Change

* sanity

---------

Co-authored-by: rodireich <rodireich@users.noreply.github.com>
 2023-04-06 10:47:30 -07:00
Cyril ALFARO
85ba3683df Fix: Make the test commands consistent with the first line (#21904) 
Small fixed just to be clear

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-03-17 15:02:23 -03:00
Edward Gao
294cdbcf4a Normalization Bigquery: Add more reserved words (#24077) 
* add current times for bigquery

* bump version + changelog
 2023-03-15 18:33:59 +00:00
Alexandre Girard
9864e4bf19 Update links (#24100) 
* Update links

* Add missing files
 2023-03-15 10:20:44 -07:00
Alexandre Girard
5fecc7e626 add missing newline (#24035) 
* add missing newline

* Automated Commit - Formatting Changes

---------

Co-authored-by: girarda <girarda@users.noreply.github.com>
 2023-03-14 00:37:34 +00:00
Sherif A. Nada
1bc1ecfe6a Fix broken links in CDK speedrun tutorial (#24006) 2023-03-13 17:11:52 -07:00
Sophia Wiley
5512befeb1 Docs: updated links from .io to .com (#23652) 
* updated links

* edited contributors link

* deleted line about CDK in docs
 2023-03-06 17:27:55 +01:00
Prateek Mukhedkar
531627ebff Set sync_mode as incremental instead of full refresh in catalog specifying incremental sync (#22183) 
Co-authored-by: prateekmukhedkar <prateek@airbyte.io>
 2023-02-07 15:37:38 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846) 
Rename source acceptance test to connector acceptance test
 2023-02-02 11:38:19 +01:00
Julian
710d8ee06f Docs Fixed: Broken link ConnectorSpecification #21052 (#21081) 2023-01-31 19:09:16 +00:00
Maxime Carbonneau-Leclerc
57dffd6154 [docs] update CDK Tutorial: Python HTTP (#22069) 
* [docs] update CDK Tutorial: Python HTTP

* Update airbyte-cdk/python/docs/tutorials/cdk-tutorial-python-http/6-read-data.md

Co-authored-by: Sergio Ropero <42538006+sergio-ropero@users.noreply.github.com>

* Code review

---------

Co-authored-by: Sergio Ropero <42538006+sergio-ropero@users.noreply.github.com>
 2023-01-30 18:00:11 +00:00
Sergio Ropero
12c22fb891 fix: Create your own source connector tutorial (#21985) 
* First commit

* Fix some required parts and added extra information.
two tests failing:
```
       2 failed
         - ../actions-runner/_work/airbyte/airbyte/airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py:699 TestBasicRead.test_airbyte_trace_message_on_failure[inputs0]
         - ../actions-runner/_work/airbyte/airbyte/airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_incremental.py:196 TestIncremental.test_read_sequential_slices[inputs0]
```

* Improve message

* Remove copy-paste line :D
 2023-01-30 18:04:22 +01:00
Jimmy Ma
c6b8279386 Add dependencies to docker-compose (#19321) 
* Revert "Revert "Add dependencies to docker-compose (#19257)" (#19306)"

This reverts commit b16f28fd4d.

* Bump docker-compose version

* test

* Revert "test"

This reverts commit c3b28c9ec3.

* Bump docker compose version to 3.8

* test

* test

* Use a newer docker for platform build

* test

* Use docker compose v2

* Update docker for frontend e2e

* Use docker compose v2 for e2e tests

* Update tools to use docker compose v2

* Update more docker compose references to v2

* Update docker compose usage in docs

* Update deploying airbyte docs

* Fix permission

* Case insensistive check

* Add extra mention for docker compose in upgrading airbyte

* Improve upgrade docker note
 2023-01-12 10:41:00 -08:00
Luke Hsiao
84ab12f93d Docs: Update building-a-python-destination.md (#19516) 
If a user used `append_dedupe`, they get the error:

```
{
  "type": "LOG",
  "log": {
    "level": "FATAL",
    "message": "1 validation error for ConnectorSpecification\nsupported_destination_sync_modes -> 2\n  value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])..."
  }
}
```
 2022-11-29 17:42:36 -03:00
Ella Rohm-Ensing
f22485a908 Add improvements to "Building a connector the hard way" (#19093) 
* Add improvements to "Building a connector the hard way"

* add log_error() formatting to pass SAT tests

* Update to new version of acceptance-test-config.yml

* Edit tutorial directory to match tutorial

* Change permissions on acceptance-test-docker.sh

This reverts commit 40b2d98053.
 2022-11-08 17:13:21 -05:00
Pinhas Keizman
4a61e6aaa3 Update cdk-speedrun.md (#18416) 2022-10-25 08:31:56 -03:00
Tanvesh Takawale
da5aed8a31 CDK: fixed document links regarding airbyte specification (#18169) 2022-10-19 09:50:01 -07:00
Robert
c13d03b06c Docs: Fix some typos in connection-checking.yml (#17028) 
Fixes some formatting issues and hopefully makes the guide slightly easier to follow.
 2022-09-22 11:59:37 -03:00
BM
4a7461064b Docs: link removed. (#16688) 2022-09-14 08:28:47 -03:00
Augustin
e253b98260 doc: add airbyte_secret field in example (#16374) 2022-09-07 09:29:52 +02:00
Augustin
4df0a48427 cdk and docs: remove "additionalProperties" (#14881) 2022-07-22 15:34:27 +02:00
Brian Lai
7bff12aea5 [#3078] [CDK] Add support for enabling debug from command line and some basic general debug logs (#14521) 
* allow for command line debug option and basic debug statements + declarative

* feedback from pr comments

* fix some tests w/ req/res mixed up and fixing logging tests

* formatting

* pr feedback: cleaning up traces in logger.py and update docs with debug configuration

* remove unneeded trace logger test

* remove extra print statement
 2022-07-13 18:01:07 -04:00
Amruta Ranade
47d41ee7b2 fixing broken things in docs (#14685) 2022-07-13 13:53:23 -04:00
Amruta Ranade
c1b9f82239 Docs: Fixed broken links (#14622) 
* fixing broken links

* more broken links
 2022-07-12 10:12:54 -04:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) 
This reverts commit a2c194a11f.
 2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369) 
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
 2022-07-08 14:18:27 -05:00
Alexander Marquardt
721b73df3c Update building-a-python-source.md (#14262) 2022-07-01 12:48:47 +02:00
Alexander Marquardt
6e733f5a91 Update cdk-speedrun.md (#14258) 
Added a link at the bottom of the article , so the user may find the more in-depth tutorial about building a real-world connector.
 2022-07-01 12:48:12 +02:00
Amruta Ranade
39ef8447f9 Fixed broken link 2022-06-30 17:45:47 -04:00
swyx
d9d06d2191 [docs] fix numbering and incorrect filename in CDK docs (#13045) 
* [docs] fix numbering in CDK docs

* Update 5-declare-schema.md

* Update 5-declare-schema.md

* Update 6-read-data.md

* Update 8-test-your-connector.md
 2022-06-28 08:25:09 -03:00
George Claireaux
30c5d2d9a7 🎉 New Source Dockerhub (#13931) 
* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>
 2022-06-20 15:13:29 +01:00