jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-10 09:04:48 -05:00
Code Issues Packages Projects Releases Wiki Activity
8,409 Commits 5,238 Branches 518 Tags
3468516a2b9f0ebb9ffbfcdf95a7c2fd8a8cd5fb
Commit Graph

2215 Commits

Author SHA1 Message Date
Subodh Kant Chaturvedi
fe3f459a8f mssql-source:upgrade debezium version to 1.9.6 (#18732) 
* mssql-source:upgrade debezium version to 1.9.6

* more improvements

* upgrade version

* auto-bump connector version

* fix test

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-04 23:02:51 +05:30
Baz
51ac4b5238 🐛 Source Google Analytics (UA): fix discovery stage, when custom_reports is provided as single dict (#18965) 2022-11-04 18:04:14 +02:00
Artem Inzhyyants
54218f595b 🐛 Source SalesForce: fix Bulk API unsupported list (#18799) 
* 🐛 Source SalesForce: fix Bulk API unsupported list

* 🐛 Source SalesForce: bump version

* 🐛 Source Facebook Marketing: docs update

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-04 12:34:25 +01:00
Liren Tu
6967d146ec 🎉 Source redshift & bigquery: emit cursor count in state (#18954) 
* Bump version for redshift, bigquery, and snowflake

* auto-bump connector version

* auto-bump connector version

* Log failed refresh token response

* Revert snowflake version bump

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-04 01:13:02 -07:00
Balasubramanian T K
838aebe322 🎉 New Source: SpaceX API [low-code cdk] (#18311) 
* Init: New Source: SpaceX API

* Chore: Removed duplicate and unwanted files

* fix: Reconfigured schema and matched the read records. chore: Acceptance test run and results passed without errors

* chore: Added documentation, updated airbyte docs specific to the connector

* fix conflict

* Chore: delete unwanted files

* chore: Created bootstrap.md

* chore: Update doc url, removed unwanted files

* fix: Fixed schema after crosscheck with several schema validators

* fix: resolved .vscode setting conflict, resolved merge conflict

* feat: Added support for all endpoints

* chore: updated documentation

* feat: changes to stream path to accept options and id

* fix: Resolve coomments

* chore: resolved comments

* chore: Delete unwanted files

* chore: Update Readme.md after resolving merge conflict

* update connector

* add spacex api to source def

* run format

* add schemaloader

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-03 22:14:39 -03:00
Eugene
5c870c1626 🐛Destination-dynamodb: enforce ssl connection (#18672) 
* [16283] Destination-dynamodb: Added strict-encrypt version and enforced ssl connection on cloud
 2022-11-03 22:15:24 +02:00
ev
f7bef97be6 New Source: Wikipedia Pageviews (#18343) 
* start adding connector

* fix check and stream slicer

* pass some tests

* fix: github url

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

* add stream slicer for top and fix some tests

* remove unneeded files

* Increment the version.

* add docs and clean up unneeded comments

* Bump airbyte-cdk version to 0.2

* add schemaloader

* add wikipedia to source def

* auto-bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-03 17:13:13 -03:00
JJ Nilbodee
c40f1b6b7f 🎉 New Source: SurveySparrow (#18395) 
* generated from template

* initial commit

* add sample_config

* add docs

* apply comments

* minor changes

* try using ListSlicer

* use ListStreamSlicer

* fix base url

* update cdk version in requirements

* add surveysparrow to source def

* add schemaloader

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-03 16:46:48 -03:00
Serhii Chvaliuk
c01b81bddb Source Mixpanel: "export" stream make line parsing more robust (#18846) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-11-03 19:46:06 +02:00
VitaliiMaltsev
8bb97010f3 MySQL Source: fixed unencrypted CDC connections (#18851) 
* MySQL Source: fixed unencrypted CDC connections

* updated changelog

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-03 19:40:20 +02:00
Zaza Javakhishvili
7693a3079a Source Amazon Seller Partner - add new reports and bump version (#18283) 
* add new amazon seller partner reports and bump version

* amazon seller partner new reports review based changes

* Amazon seller partner new reports review based changes 2

* amazon seller partner ./gradlew format

* amazon seller partner - add aditional 2 report types

* Amazon seller partner some stream fix

* amazon seller partner - ledger detailed view report data type fix

* amazon seller repport fix xml orders parse

* remove deprecated inventory helth report

* Amazon seller partner review based change 3

* Update acceptance-test-config.yml

* fix: generate source definitions for 0.2.28 version

Co-authored-by: Juozas V <monai@cure.lt>
Co-authored-by: sajarin <sajarindider@gmail.com>
 2022-11-03 11:19:10 -04:00
Tyler B
022fca824f Embed Metabase Connector Catalog (#18864) 
Replaces static connector catalog with the embedded Metabase connector catalog
 2022-11-03 09:52:47 -05:00
Tan Ho
f156be94bd New Source: Gridly (#18342) 
* Add source-gridly

* Correct current_page init value

* The first batch was fetching twice

* Remove `integration_tests/catalog.json` from source-gridly

* Allow select any view on grid to sync records

* Correct documentationUrl for source gridly

* use class property for source endpoint instead of local variable

* Add tests and format code

* Add gridly.md docs file

* add gridly to source def

* auto-bump connector version

Co-authored-by: Tan Ho <th@localizedirect.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-03 11:39:51 -03:00
Isaac Harris-Holt
606534ddbc 🎉 New Source: Alpha Vantage (#18320) 
* Initial commit

* Tidy and add custom dpath extractor

* Get acceptance tests passing

* Improve dict-checking for ObjectDpathExtractor

* Improve dict-checking for ObjectDpathExtractor

* Add more tests to ObjectDpathExtractor

* Add docs

* Address comments

* Update docs

* Add sample and invalid configs

* format

* add alpha vantage to source def

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-11-03 10:57:27 -03:00
Mario Molina
f49beff48d 🎉 New Source: Datadog [python cdk] (#18150) 
* New Source: Datadog

* Updating doc

* Adding unit tests

* Renaming limit var

* Updating description in spec

* add source def to seed

* add datadog to source def seed

* run format

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-03 10:46:31 -03:00
Baz
8958aa3cdc 🐛 Source Sendgrid: Skip the stream on authorization required permission error [400, 401] (#18847) 2022-11-02 20:39:58 +02:00
Amruta Ranade
fbe16d1bef edited connector docs (#18855) 2022-11-02 12:14:37 -04:00
Tim Roes
4ddd414359 🪟 🎉 Allow environment specific sections in docs (#18829) 
* Allow environment specific sections in docs

* Change syntax to lower case
 2022-11-02 08:49:14 -07:00
Subodh Kant Chaturvedi
0a37a8d352 mysql-source:fix tinyint unsigned handling (#18619) 
* mysql-source:fix tinyint unsigned handling

* update doc

* format

* upgrade version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-02 20:54:05 +05:30
Yowan Ramchoreeter
016907ed98 Add notes about EU OAUth (#18835) 
EU OAuth is not fully tested so adding a note to account for that.
 2022-11-02 11:13:30 -04:00
Tyler B
4b2d65f712 Remove "Filters and Segments" from Google Analytics v4 (#18508) 
Filters and Segments info was incorrectly added to the Google Analytics v4 connector instead of the Google Analytics (Universal Analytics) Connector.
 2022-11-02 11:12:47 -04:00
Serhii Lazebnyi
e45aec3ef5 🐛Source Exchange Rates: Fix handling error during check connection (#18726) 
* Fix handling error during check connection

* Updated PR number

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-01 23:20:20 +01:00
Serhii Lazebnyi
bc090834e0 🐛Destination Google Sheets: Fix empty headers list (#18729) 
* Fix empty headers list

* Updated PR number

* Bumped version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-01 23:19:46 +01:00
Artem Inzhyyants
88bbb5dabc 🐛 Source Facebook Marketing: reduce request limit after specific error (#18734) 
* 🐛 Source Facebook Marketing: reduce request limit after specific error

* 🐛 Source Facebook Marketing: bump version; update docs

* 🐛 Source Facebook Marketing: add test

* 🐛 Source Facebook Marketing: increase timeout
 2022-11-01 21:42:39 +01:00
Sherif A. Nada
978128afc2 Fix adjust.md header 2022-11-01 10:21:16 -07:00
Haithem SOUALA
aff9963a9f 🎉 New Source: Coinmarketcap [low-code CDK] (#18565) 
* init commit

* add docs

* add docs

* Delete logs.txt

* add items

* fix comments

* fix comment

* fix acceptance test

* remove *state.json used for incremental imports test

* Add ignored_fields on listing to get the acceptance test pass

- the crypto market is VERY volatile, the data change between 2 full imports when the test is run

* manually generate source_specs.yaml for coinmarketcap

Co-authored-by: Yiyang Li <yiyangli2010@gmail.com>
 2022-11-01 13:18:37 -03:00
Andrés Bravo
0ee930678b 🎉 New Source: Public APIs [python CDK] (#18471) 
* [ airbytehq/connector-contest#91 ] Add Source Public APIs

* [ airbytehq/connector-contest#91 ] Add Source Bootstrap.md

* [ airbytehq/connector-contest#91 ] Add Source documentation

* [ airbytehq/connector-contest#91 ] Add Source Public APIs

* [ airbytehq/connector-contest#91 ] Add Source Bootstrap.md

* [ airbytehq/connector-contest#91 ] Add Source documentation

* [ airbytehq/connector-contest#91 ] Remove uneeded incremental class and tests, updated doc

* [ airbytehq/connector-contest#91 ] Remove uneeded incremental class and tests, updated doc

* [ airbytehq/connector-contest#91 ] Fix pflake8 offenses

* run airbytePythonFormat on source-public-apis, and remove test_incremental_streams.py

* fix: generate and add source definitions

* - update documentationUrl;
- add new lint to eof

* auto-bump connector version

* correct documentationUrl in source_specs.yaml

Co-authored-by: Yiyang Li <yiyangli2010@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-01 13:18:10 -03:00
Serhii Chvaliuk
77223167bd Source Salesforce: add get_error_display_message for ConnectionError (#18753) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-11-01 15:48:04 +02:00
Yiyang Li
093a2941a1 🎉 New Destination: Heap Analytics [python cdk] (#18530) 
* 🎉 New Desination: Heap Analytics [python cdk]

- implement a heap client to load data via the server-side API: https://developers.heap.io/reference/server-side-apis-overview
- the connector supports a generic data source, and the api_type determines the output schema. The output schema is dynamic.
- users pick the columns that will be loaded to the destination
- Consequently, each configured catalog only includes one stream

* add a bootstrap to illustrate the connector

* add destination dest def

* run format all files

* correct unit test

* auto-bump connector version

Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-01 10:36:53 -03:00
Digambar Tupurwadi
ae1a499a97 Green house docs (#18314) 
* corrected the documentation for FreshDesk Connector

* corrected the documentation for Greenhouse Connector
 2022-10-31 22:13:13 -03:00
Serhii Chvaliuk
dc326b4e92 Source Prestashop: prevent users from using http url (#18599) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-31 20:16:11 +02:00
oneshcheret
2d4f443c75 Sources postgres, mysql, alloydb: encode database name (#18538) 
* Source postgres: encode database name

* Source postgres, mysql: move encoding in util class, apply for mysql

* Source postgres, mysql: make var final

* Source postgres, mysql: bump version

* Source postgres, mysql: format code

* auto-bump connector version

* Source mysql: bump version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-31 19:53:20 +02:00
Yevhen Sukhomud
5f7bfb93cd Destination Redis: TLS support (#18358) 
* 16249 Destination Redis TLS support

* Refactoring based on pr review
 2022-10-31 21:22:54 +07:00
Baz
a2bd577b9c 🐛 Source Amplitude: fix empty series for AverageSessionLength stream (#18684) 2022-10-31 16:10:09 +02:00
Roman Yermilov [GL]
fda55bf1b2 Source Intercom: change airbyte-cdk version to 0.2 (#18681) 
* Source Intercom: change airbyte-cdk version to 0.2

* Source Intercom: update chagelog

* Source Intercom: bump version and update chagelog

* Source Intercom: Fix PR id in chagelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-31 17:04:31 +04:00
Denys Davydov
3b44baf37f Source metabase: allow using only https urls (#18607) 
* #16519 source metabase: allow using only https urls

* source metabase: upd changelog

* #16519 fix url regexp

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-31 14:39:44 +02:00
Dainius Salkauskas
5b9f564ce5 🎉 New Source: Omnisend (#18577) 
* Init source omnisend

* Removed unnecessary files

* added campaigns, carts, orders, products streams

* Fix acceptance tests

* Added documentation

* Added pagination

* Removed abnormal state, uncommented acceptance tests

* Added docs references

* Added reference to PR

* Added stop condition for pagination

* Added title to API Key in spec.yaml

* add omnisend source to def seed

* run format

* auto-bump connector version

Co-authored-by: Rytis Mickevičius <rytis.mickevicius1@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-31 07:33:42 -03:00
Baz
7a632fb39d 🐛 Source Google Analytics (Universal Analytics): add Custom Reports schema validation on Check Connection (#18670) 2022-10-31 11:51:40 +02:00
Denys Davydov
6a40ac52fe Source S3: use AirbyteTracedException (#18602) 
* #750 # 837 #904 Source S3: use AirbyteTracedException

* source s3: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-29 07:23:39 +03:00
Marcos Marx
8a1f3e4ffe Source Mailjet SMS: publish PR and add source def (#18620) 
* init commit

* add docs

* fix comments

* use request_options_provider

* solve conflict

* solve doc conflict

* Source Mailjet Mail: publish connector and additional format (#18586)

* init commit

* add streams

* add schemas

* solve conflict

* add docs

* fix comments

* restore vscode config

* restore vscode config

* clean

* lint

* lint

* lint

* lint

* fix comments

* run format

* update acceptance test

* update schema

* update acceptance test

* auto-bump connector version

Co-authored-by: Haithem SOUALA <haithem.souala@woopit.fr>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>

* add source def + correct tests

* update schema

Co-authored-by: Haithem SOUALA <haithem.souala@woopit.fr>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 19:35:52 -03:00
alexchouraki
6cd991b39c 🎉 New Connector: Zendesk Sell [python cdk] (#17888) 
* first working connector - overwrite only

* edit readme and source definitions

* Update source_definitions.yaml

* changing catalog and adding all available streams

* remove custom fields

* remove documents

* manage incremental syncs

* add unit tests ; add start date to specs

* try catch for next page token method

* Create source_to_test.py

* Update source.py

* Update source_to_test.py

* working source

* Delete TODO.md

* Update source.py

* Update spec.yaml

* Update test_streams.py

* give up on incremental and have something that works

* removing start date necessity in spec and sample configs

* add connector to source def

* run format

* update airbyte cdk version

* correct unit test

* run format

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 19:33:38 -03:00
Haithem SOUALA
5e5a5e3a47 🎉 New Source: Mailjet SMS (#18345) 
* init commit

* add doc

* add doc

* change authentication methode

* fix doc

* fix doc

* add docs

* fix comments

* use request_options_provider

* lint

* fix comments

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-10-28 19:14:51 -03:00
sbrickel-nimble
683a3a3344 🎉 New Source: Waiteraid [low-code cdk] (#18165) 
* added source waiteraid

* 🎉 New Source: Waiteraid

* add searchBookings stream

* add P/R number

* add SUMMARY entry

* add docs/integrations/README.md entry

* add builds.md entry

* add docs to each endpoint

* fix schema
~

* Update airbyte-integrations/builds.md

added web address

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

* Delete catalog.json

* Delete TODO.md

* Update spec.yaml

* add waiteraid to source def seed

* auto-bump connector version

Co-authored-by: Sebastian Brickel <sebastianbrickel@Sebastians-MacBook-Air.local>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 14:13:14 -03:00
Cirdes
c219dab63c 🎉 New Destination: Typesense (#18349) 
* Initial boilerplate

* 🎉 New Destination: Typesense

* remove .java-version

* fix doc

* add typesense to dest def

* add release stage

* add requirement to main

* auto-bump connector version

* add changelog

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 13:46:29 -03:00
Balasubramanian T K
3036ddae5a 🎉New Source: Google Webfonts [low-code cdk] (#18496) 
* New source: Google webfonts

* chore: Add Docs

* chore: update changelog

* chore: resolved given comments for PR

* chore: unwanted files removed

* fix: generate and add source definitions

Co-authored-by: sajarin <sajarindider@gmail.com>
 2022-10-28 12:20:47 -04:00
Dainius Salkauskas
8766372664 🎉 New Source: ConvertKit (#18455) 
* Init source omnisend

* Removed unnecessary files

* Init source convertkit

* Added forms, sequences streams

* Added tags stream

* Added subscribers, broadcasts streams

* Added documentation

* Removed unnecessary files

* Updated pull request information in documentation

* Added sample config

* Updated invalid config

* Formatting, removed abnormal state, uncommented full_refresh acceptance test

* Added pagination for subscribers stream

* fix: add source definition for convertkit

* auto-bump connector version

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 12:20:05 -04:00
sarafonseca
0e2361d0e6 🎉 New Source: RD Station Marketing [python cdk] (#18348) 
* Add new source: RD Station Marketing

* Update catalog with all streams

* Update changelog with the rigth PR reference number

* Minor fixes to RD Station docs

* Change field replication_start_date to start_date

* Fix unit tests after changing replication_start_date name

* Fix typo

* Refact next_page_token logic

* Fix unit tests

* Remove print function

* Update airbyte-cdk version to 0.2

* Update airbyte-integrations/connectors/source-rd-station-marketing/source_rd_station_marketing/streams.py

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

* Change from yield to yield from

* Apply format

* add rd station to source def

* update doc changelog

* auto-bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 10:13:45 -03:00
Ivica Taseski
d9acf47efa 🎉 New destination: Yugabytedb (#18039) 
* add yugabytedb destination connector

* add dest def + add changelog

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 09:16:03 -03:00
Serhii Chvaliuk
592a785892 Source: Google Search Console: validate custom_reports.dimension (#18568) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-28 08:47:41 +03:00
Marcos Marx
b238e2a707 Source Mailjet Mail: publish connector and additional format (#18586) 
* init commit

* add streams

* add schemas

* solve conflict

* add docs

* fix comments

* restore vscode config

* restore vscode config

* clean

* lint

* lint

* lint

* lint

* fix comments

* run format

* update acceptance test

* update schema

* update acceptance test

* auto-bump connector version

Co-authored-by: Haithem SOUALA <haithem.souala@woopit.fr>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-28 00:46:56 -03:00