1
0
mirror of synced 2026-01-01 18:02:53 -05:00
Commit Graph

120 Commits

Author SHA1 Message Date
George Claireaux
30c5d2d9a7 🎉 New Source Dockerhub (#13931)
* init

* implement working source + tests

* add docs

* add docs

* fix bad comments

* Update airbyte-integrations/connectors/source-dockerhub/acceptance-test-config.yml

* Update airbyte-integrations/connectors/source-dockerhub/Dockerfile

* Update airbyte-integrations/connectors/source-dockerhub/.dockerignore

* Apply suggestions from code review

* Update docs/integrations/sources/dockerhub.md

* Update airbyte-integrations/connectors/source-dockerhub/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@airbyte.io>

* address @Phlair's feedback

* address @Phlair's feedback

* each record is now a Docker image rather than response page

* format

* fix unit tests

* fix acceptance tests

* add icon, definition and generate seed spec

* add requests to requirements

Co-authored-by: sw-yx <shawnthe1@gmail.com>
2022-06-20 15:13:29 +01:00
Harshith Mullapudi
074adefcdc Harshith/test pr 12536 (#13874)
* 🎉 New Source: Firebolt (#1)

* fix: Boolean type cast

* test: Improve format testing and doc

* refactor: Move some db functionality

* docs: Adding types doc link in utils

* feat: Use future-proof Auth in SDK

* fix: integration tests are failing

* chore: update seed file

Co-authored-by: Petro Tiurin <93913847+ptiurin@users.noreply.github.com>
Co-authored-by: ptiurin <petro.tiurin@firebolt.io>
2022-06-17 17:47:08 +05:30
Amruta Ranade
96a4d7515f Updated connector catalog (#13862) 2022-06-16 17:32:01 -04:00
Amruta Ranade
1393b4a43d Updated connector catalog 2022-06-09 10:45:22 -04:00
Yevhen Sukhomud
da88158c2f 🎉 New SFTP source connector (#13120)
* 11797 New SFTP source
* 11797 Bump sftp source version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-30 14:28:13 +07:00
Amruta Ranade
5aeae3b2e1 update Amazon Ads cloud availability (#13249) 2022-05-26 21:22:17 -04:00
Topher Lubaway
3a64c25073 Fixes all broken links and enforces no broken (#13152)
* Fixes all broken links and enforces no broken

* Addresses peter's comments

removes unused summary.md: an artifact of gitbook
2022-05-25 15:59:29 -05:00
Amruta Ranade
4a9d9296d2 updated connector catalog based on the May 25 changelog (#13190) 2022-05-25 15:06:22 -04:00
Erica Struthers
e542a4bd73 Update README.md (#12891) 2022-05-19 11:43:06 -04:00
Baz
feb0d2f378 🎉 New Destination: Implement Destination Google Sheets using CDK (#12135) 2022-05-12 01:10:28 +03:00
Amruta Ranade
2617f833bb Updated connector statuses (#12765) 2022-05-11 17:45:04 +05:30
Amruta Ranade
2a8df3342e Fixed broken things + updated connector status (#12373) 2022-04-26 15:53:08 -04:00
Amruta Ranade
e0a13405e2 Add cloud availability status on connector catalog page (#12081) 2022-04-18 12:56:14 -04:00
Evan Tahler
8293ce3fbe 🎉 New Source: Faker (#11738)
* Faker WIP

* Update catalog to handle dates better

* Adding unit tests for faker source

* WIP  - tests mostly passing

* add docs

* bump python version and fix unit tests

* test array types

* remove comment

* better python map

* update `moduleDirectory`

* simplify intiilization\

* use `ConfiguredAirbyteCatalog` in test rather than custom dict class

* Tests passing by using deterministic time

* Bump birthdays

* Update airbyte-integrations/connectors/source-faker/integration_tests/acceptance.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* remove bootstrap and stronger types

* better incremental support

* fixup un-used imports

* bump to test codecov

* Add connector to medatata files

Co-authored-by: George Claireaux <george@claireaux.co.uk>
2022-04-14 15:21:30 -07:00
Jared Rhizor
14dfc1d417 fix parentheses and info/warning/danger formatting in docs (#11981)
* fix parens

* fix formatting for hints

* remove hint from non-docusaurus or gitbook doc
2022-04-13 12:08:34 -07:00
Topher Lubaway
03ed894917 Updated GA connector docs and connector (#11640)
pipeline trigger because gitbook is sad

This reverts commit 230134068f.
2022-03-31 15:29:34 -05:00
Topher Lubaway
230134068f Revert "Updated GA connector docs and connector " (#11639)
gitbook pipelines failed.  reverting to trigger gitbook pipeline again
This reverts commit 6aa7e4ce79.
2022-03-31 15:24:17 -05:00
Amruta Ranade
6aa7e4ce79 Updated GA connector docs and connector stages (#11628)
* updated GA connector docs and README

* minor edit
2022-03-31 10:07:03 -04:00
Juan
e661d8aeff Update integrations README.md (#10851)
Updated verbiage from grades to stages
Updated connector stages to match cloud stage tags
Added connectors missing on README.md that appear on cloud drop down
2022-03-04 08:25:15 -07:00
Harshith Mullapudi
382e2b7476 Publish all faros ai sources (#10526)
* Add more sources sponsored by Faros AI

* Fix doc link

* Add icons

* Fix phabricator links

* Remove references to phabricator source because we dont have stable source acceptance test for it yet

* fix: rebased with master

* fix: account name in docker image

* Delete config.json

* chore: added seed spec

* chore: fix formatting

Co-authored-by: Chris Wu <chris@faros.ai>
2022-02-22 11:34:47 +05:30
Serhii Chvaliuk
3eb3367cc3 🐛 Source Quickbooks: update label Quickbooks -> QuickBooks (#10346)
* Quickbooks -> QuickBooks

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-02-17 16:52:20 +02:00
Harshith Mullapudi
f4365c59cf Add Jenkins source from Faros AI to connector catalog (#9929)
* Add Jenkins source from Faros AI to connector catalog

* todos

* Add setup instruction

* Update doc

* Feedback and add to dropdown

Co-authored-by: Chris Wu <chris@faros.ai>
2022-02-02 16:09:28 +05:30
Harshith Mullapudi
51af69b3b8 Add streamr destination catalog (#9928)
* Add streamr document

* add missing end line

* fix name: streamr > Streamr

Co-authored-by: Thanh Le <mihthanh27@gmail.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-02-02 15:54:30 +05:30
Harshith Mullapudi
df332c7baa Revert "Add Streamr destination document (#9155)" (#9918)
This reverts commit 94d74bb4c6.
2022-01-31 16:33:21 +05:30
Harshith Mullapudi
a8135dd5be Revert "Add Jenkins source from Faros AI to connector catalog (#7837)" (#9917)
This reverts commit 5fd3292e2d.
2022-01-31 16:32:50 +05:30
Chris Wu
5fd3292e2d Add Jenkins source from Faros AI to connector catalog (#7837)
* Add Jenkins source from Faros AI to connector catalog

* todos

* Add setup instruction

* Update doc

* Feedback and add to dropdown
2022-01-31 15:55:58 +05:30
Thanh Le
94d74bb4c6 Add Streamr destination document (#9155)
* Add streamr document

* add missing end line

* fix name: streamr > Streamr

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-01-31 15:55:47 +05:30
LiRen Tu
b269b9fb1e 🎉 Source e2e test: support custom catalog (#9720)
* Add continuous feed mode to source e2e-test

* Update connector catalog doc

* Fix sonar qube issues

* Add cloud variant

* Format code

* Add testing source connector to seed
2022-01-23 21:09:03 -08:00
Zaimwa9
1a74de6156 🎉 New Source: PersistIq (#9515) 2022-01-21 19:40:17 +01:00
Juozas V
9afbbff454 🎉 New Source: Flexport (#8777) 2022-01-20 15:03:12 +01:00
Titas Skrebe
081510017a 🎉 New Source: Chartmogul (#9381)
* New source: Chartmogul

* update changelog

* bootstrap.md

* reorder schema

* make acceptance test pass

* add chartmogul to builds.md

* Update airbyte-integrations/connectors/source-chartmogul/source_chartmogul/source.py

Co-authored-by: Augustin <augustin@airbyte.io>

* Update airbyte-integrations/connectors/source-chartmogul/source_chartmogul/source.py

Co-authored-by: Augustin <augustin@airbyte.io>

* address comments

* fix unused imports

* update source_specs

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
2022-01-18 19:45:59 +01:00
Juozas V
22dcb0f674 🎉 New Source: 3PL Central (#7322)
* Add source-tplcentral

* Add source definition

* Add missing file

* Update catalog

* Update sample config

* Update formatting

* Update invalid config

* Fix primary key identifier

* Update naming

* Rename variable

* Parametrize page size

* Implement Items stream

* Update schemas

* Update response normalization

* Add arrow

* Implement items stream cursor

* Fix types

* Cleanup

* Add customers stream

* Fix items sort

* Add stock_details stream

* Add inventory stream

* Add orders stream

* Refactor streams to a separate file

* Update cursor handling

* Refactor request_params

* Simplify

* Update params generation

* Update response parse

* Refactor stream+slices

* Refactor parse_response

* Cleanup

* New order

* Fix style

* Refactor parse_reponse

* Fix cursor

* Don't fetch next page after the last

* Fix schema errors

* Flatten shared schemas

* Inline refs

* Fix handling None stream_state

* Update schemas

* Implement primary_key and cursor fields

* Fix style

* Fix style

* Fix schemas

* Fix deep_map

* Fix items schema

* Fix cursor formatting

* Update integration tests assets

* Update README.md

* Remove TODO.md

* Update spec.json

* Cleanup

* Add bootstrap.md

* Increase page sizes

* Increase state checkpoint interval

* Add documentation

* Update links to the documentation

* Add build status badge

* Implement test_source.py

* Improve code testability

* Add stream tests

* Implement test_incremental_streams

* Add requests-mock dependency

* Fix formatting

* Update author

* Run ./gradlew format

* Cleanup failed merge artifacts

* Update sample_state.json

* Add stream documentation urls

* Cleanup

* Preserve upstream naming

* Fix primary key

* Fix configured catalog

* Update schemas

* Update catalog.json

* Fix tests

* Add schema source files

* Split configured catalogs

* Cleanup

* Update documentationUrl

* Add new properties

* Run gradlew format

* Remove additionalProperties: false from the schemas

* Revert "Remove additionalProperties: false from the schemas"

This reverts commit d4e8fea2fd.
2021-12-28 13:35:36 +05:30
Serhii Lazebnyi
6d3a80aafe 🎉 New Source: SearchMetrics (#6992)
* Added streams

* SearchMetrics implementation

* Updated unit tests

* Update to review and tests

* Add SEARCH_METRICS_TESTS_CREDS to ci creds

* Add CountDomainKeyword stream and updated to review

* Updated to new master

* Updated to linter

* Deleted windows in days from config

* Updated version in seed
2021-12-22 22:31:21 +02:00
Daniel Diamond
105bb58ac6 🎉 New source: Qualaroo (#8623)
* init

* Add additional docs per connector checklist

* De-nest answered_questions

* gradlew format

* fix integration tests and remove incremental stream

* Remove bin files
2021-12-21 13:17:52 +05:30
Augustin
369571c400 🎉 New Source: OpenWeather (#7434) 2021-12-15 22:17:36 +01:00
sbaldwin-rs
3748c66daa 🎉 New Destination: Rockset (#8006) 2021-12-15 15:53:58 +01:00
Bo Lu
bbcd461bc5 🎉 New Destination: ClickHouse (#7620)
* add ClickHouse destination

* update docs

* format code

* code improvement as per code review

* add ssh tunneling and ssl/tls support and code enhancement

* merge from master

* disable testCustomDbtTransformationsFailure test

* fix string format bug

* fix reserved keywords bug and disable dbt

* disable dbt in expect result

* add type hints

* bump connector version

Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-12-13 19:39:19 -03:00
Luis Gomez
cba7285c99 🎉 New destination: RabbitMQ (#7560)
* Added RabbitMQ destination

* Added unit tests

* Added exchange to config

* Updated to support different connection parameters

* Added integration tests

* Added RabbitMQ destination documentation

* small change

* Addressed PR comments

* add creds

* format files

* bump connector config files version

* run format

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-12-13 19:11:32 -03:00
Marcos Marx
47e03a3d2d Docs: Update connector list (#8683) 2021-12-09 20:10:41 -03:00
Alasdair Brown
84b3bf55ac 🎉 Destination Amazon SQS: New connector (#7503)
* initial commit, working sending single messages

* Adds Unit Tests, removes un-implemented features from Spec, yields sent messages, fixed fifo suffix match, adds bootstrap

* Remove yield from RECORD message

* Complete readme for sqs

* Formatting

* Minor tidying of unit tests

* Add references in docs pages

* formatting

* Add docs links

* formatting
2021-12-10 03:51:51 +05:30
Madison Swain-Bowden
b28f20bb53 🎉 New Destination: SFTP JSON (#4924) 2021-11-24 15:23:21 +01:00
Koji Matsumoto
694cbed455 🎉 New Destination: MariaDB ColumnStore (#7961) 2021-11-23 19:31:27 +01:00
Augustin
dfa3714895 Consistent WooCommerce naming (#8133) 2021-11-23 18:04:53 +01:00
Luis Gomez
4b59fe4382 🎉 New Source: Outreach (#7507)
* Generated connector source code

* Added streams: prospect, sequence, sequenceState

* Updated spec and schemas

* Removed print statement

* Added unit tests

* Updated acceptance test files

* Updated spec

* Ran gradlew format

* Added comments

* Added Outreach source documentation
2021-11-23 10:33:25 +05:30
AlexanderBatoulis
fd90c95e18 🎉 New Source: Zenloop (#7380) 2021-11-22 17:14:43 +01:00
Ivica Taseski
0eba52e002 🎉 New destination: Kinesis (#7799)
* add kinesis destination connector

* format code

* add javadoc and general documentation

* fix buffer bug and refactor code

* rename vars to common airbyte usage

* run format

* run format + seed file

* add eof

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-21 23:17:38 -03:00
Adam Dobrawy
519ea2a58a 🎉 New Destination: Google Firestore (#7231)
* destination-firestore: add connector

* destination-firestore: Add connector to indexes in docs

* destination-firestore: fix sync mode spec

* destination-firestore: fix typo after connector rename

* destination-firestore: fix required field in spec

* destination firestore: fix code formatting

* destionation-firestore: add python adnotation for writer

* destination firestore: add all used libraries into the setup file

* destionation-firestore: fix python formatting
2021-11-22 02:20:45 +05:30
Mario Molina
5b0b5840d6 🎉 New Destination: MQTT (#7718)
* MQTT destination

* Reformat code

* Updating readme

* run seed

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-21 14:20:42 -03:00
Ivica Taseski
8a957caf14 🎉 New destination: Redis (#7653)
* add redis destination connector

* add redis destination connector

* refactor & docs

* format

* refactor code

* debug checkpoint

* refactor and code cleanup

* format code

* add redis docs

* bump version, docs and run seed:

* correct uuid

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-20 11:26:37 -03:00
Tuan Nguyen
74c13b5193 🎉 New Source: Airtable (#7639) 2021-11-19 19:00:55 +01:00