jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-05 21:02:13 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,553 Commits 5,162 Branches 518 Tags
bf52bcffcebe67c8f7c4d85e911d864d8864d3df
Commit Graph

3298 Commits

Author SHA1 Message Date
Lee Danilek
77ea559f33 🚨🚨 🐛 Convex source fix skipped records (#27226) 
* update cursor in next_page_token, add request_headers

* .

* fix unit tests

* also fix SyncMode.incremental so it doesn't return duplicate records in race conditions

* fix client version in json_schemas

* fix version number

* fix sync_mode

* cache json_schemas to pass typecheck

* never mind

* fix sync_mode

* update metadata and doc

* backward compatiblity bypass

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-06-21 18:18:34 -03:00
Denys Davydov
076065cce4 🐛 Source Facebook marketing: reduce start date by one day (#27483) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #1975 source fb marketing: reduce start date by one day

* source fb marketing: upd changelog

* 🤖 Auto format source-facebook-marketing code [skip ci]

* format code

* #1975 source fb marketing: remove cloud version override

* source facebook marketing: update CAT config

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-21 18:32:49 +03:00
Artem Inzhyyants
aaf8f34dbe Source Stripe: Fix formatting (#27522) 
* Source Stripe: Fix formatting

* 🤖 Auto format source-stripe code [skip ci]

* Source Stripe: Bump version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-21 14:16:39 +02:00
Artem Inzhyyants
5f35afee11 Source Google Analytics Data API: Fix formatting (#27531) 
* Source Google Analytics Data API: Fix formatting

* Source Stripe: Bump version
 2023-06-21 12:54:53 +02:00
Octavia Squidington III
bad8157c44 🤖 Cloud Availability updater: new connectors to deploy [20230621] (#27542) 2023-06-21 10:26:00 +02:00
Denys Davydov
0f002d2362 🐛 Source Klaviyo: do not store state in the future (#27498) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2132 source klaviyo: do not store state in the future

* source klaviyo: upd changelog

* 🤖 Auto format source-klaviyo code [skip ci]

* reformat code

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-21 10:41:23 +03:00
Amalia Advincula-Roye
a0f8b3519a Update google-analytics-v4.inapp.md (#27536) 
Fixed custom report syntax
 2023-06-20 18:53:14 -04:00
Akash Kulkarni
2f807440da Fix issue in streaming JDBC database (#27212) 
* Fix issue in streaming JDBC database

* Bump + publish

* 🤖 Auto format source-db2 code [skip ci]

* 🤖 Auto format source-mssql code [skip ci]

* 🤖 Auto format source-postgres-strict-encrypt code [skip ci]

* 🤖 Auto format source-postgres code [skip ci]

* 🤖 Auto format source-mssql-strict-encrypt code [skip ci]

* 🤖 Auto format source-oracle code [skip ci]

* 🤖 Auto format source-tidb code [skip ci]

* 🤖 Auto format source-snowflake code [skip ci]

* 🤖 Auto format source-redshift code [skip ci]

* 🤖 Auto format source-mysql code [skip ci]

* 🤖 Auto format source-mysql-strict-encrypt code [skip ci]

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-20 12:08:47 -05:00
Roman Yermilov [GL]
80e6a2666b 🐛Source Amazon Ads: fix portfolioId type (#25874) 
* Source Amazon Ads: fix portfolioId type

* Source Amazon Ads: update metadata

* Source Amazon Ads: disable backward compatibility tests for 1.1.0

* 🤖 Auto format source-amazon-ads code [skip ci]

---------

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-20 11:22:43 -05:00
Evan Tahler
9cbb7f267a Update postgres.md (#27325) 
* Update postgres.md

* Update postgres.md

* Update postgres.md
 2023-06-20 15:16:47 +00:00
Artem Inzhyyants
1bc32f25c3 Source Salesloft: update expected records (#27484) 
* Source Salesloft: update expected records

* 🤖 Auto format source-salesloft code [skip ci]

* Source Salesloft: update test config

* Source Salesloft: bump version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-19 23:22:48 +02:00
Artem Inzhyyants
3df819612f Source Stripe: Add new Streams (#27362) 
* Source Stripe: Add Stream: Cards

* Source Stripe: update docs; tests config; bump version

* Source Stripe: Add Stream: Payment Methods; Refactor

* Source Stripe: update docs

* Source Stripe: update docs

* Source Stripe: fix unit tests

* Source Stripe: update abnormal_state

* Source Stripe: update schemas

* Source Stripe: update acceptance tests

* Source Stripe: fix address type

* Source Stripe: fix schemas

* Source Stripe: Add stream: Reviews

* Source Stripe: update docs

* Source Stripe: update acceptance tests

* Source Stripe: update schema

* Source Stripe: add stream Cardholders

* Source Stripe: update expected records

* Source Stripe: add expected records for cardholder

* Source Stripe: fix unit test

* Source Stripe: add abnormal state

* Source Stripe: add stream: Authorizations

* Source Stripe: Add Stream: Setup Attempts; Usage Records

* Source Stripe: update docs

* Source Stripe: Add Stream: Transfer Reversals

* Source Stripe: bump versions + update docs

* Source Stripe: Add Stream: Transactions

* Source Stripe: Fix Unit test

* Source Stripe: Refactor

* Source Stripe: Refactor

* Source Stripe: Fix full refresh test

* Source Stripe: bump version

* Source Stripe: update source

* Source Stripe: remove cache file

* Source Stripe: update expected records

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-19 20:28:29 +02:00
Artem Inzhyyants
5ded14c1cd Source Xero: Update Airbyte CDK version to 0.40 (#27471) 
* Source Xero: Update CDK version to 0.40

* Source Xero: Update CDK version to 0.40
 2023-06-19 16:43:51 +02:00
Artem Inzhyyants
d0db23ae51 Source Trello: Update expected records (#27470) 
* Source Trello: Update expected records

* Source Trello: Update expected records + schema

* Source Trello: Update docs
 2023-06-19 16:43:39 +02:00
Arsen Losenko
2e821bf1c1 🐛 Source Typeform: add undeclared columns to streams (#27455) 
* Source Typeform: add undeclared columns to streams

* Update changelog

* Add date-time format to datetime fields

* Change version of connector

* Update version in changelog

* Change version to 0.2.0
 2023-06-19 16:28:15 +03:00
Akash Kulkarni
d30906d89d Remove noisy logging for LegacyStateManager (#27335) 
* Remove noisy logging for legacy state manager

Context : https://airbytehq-team.slack.com/archives/C043JHEEYKG/p1686654588724759

* Bump version + dockerfile
 2023-06-16 17:13:33 -05:00
Denys Davydov
86c70b9a51 ✨ Source Zendesk Support: add stream Organization Memeberships (#27431) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #16881 source zendesk support: add Organiation Memberships stream

* add docs

* source zendesk support: upd changelog

* source zendesk support: upd unit tests
 2023-06-16 18:52:33 +03:00
Denys Davydov
2ee1837969 🐛 Source Gitlab: certify to GA + make API URL param optional (#27392) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source gitlab: certify to GA

* #26254 make API URL optional field

* source gitlab: upd changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-16 16:13:06 +03:00
Roman Yermilov [GL]
6a87475ae2 Source Stripe: Files and TopUps stream (#27238) 
* Source Stripe: top ups stream

* Source Stripe: files stream

* Source Stripe: FileLinks stream

* Source Stripe: bump version

* Source Stripe: update docs

* Source Stripe: refactoring
 2023-06-15 12:38:19 -07:00
Daryna Ishchenko
e9f9c41b17 🐛 Source Mixpanel: add handler for 402 error (#27252) 
* added handler for 402 error

* added changelog

* fixed CAT, updated logging

* changed stream in check_connection

* refactored tests

* added check for all streams to avoid 402 error

* added check for all stream for right permissions

* upadated expected records

* updated streams method

* added get_json_schema to streams method

* refactored check_connection method
 2023-06-15 21:02:13 +03:00
Zack Dai
783f01c756 Source Google Analytics: fix custom report with segments (#22223) 
* Souce  google_analytics_v4: update fix segents

* Update google-analytics-v4.md

* Update google-analytics-v4.md

* add unit test for custom_reports

* bump connector version

* Source Google Analytics v4: fix test

* Source Google Analytics v4: refactor + fix unittest

* update metadata and dockerfile

* retrigger ci

* update doc

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2023-06-15 09:50:08 -03:00
Kostas Botsas
8057ead798 Fix typos in readme (#27387) 2023-06-15 06:50:18 -05:00
Daryna Ishchenko
7fc42be17c 🐛 Source Notion: migrated to advancedAuth (#26535) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* migrated to advanced_auth

* #26535 source notion: upd changelog

---------

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Ben Church <ben@airbyte.io>
 2023-06-15 12:21:41 +03:00
Arsen Losenko
53c52293e9 🐛 Source Facebook Marketing: add complete_oauth_server_output_specification to spec (#27201) 
* Source Facebook Marketing: add complete_oauth_server_output_specification to spec

* Update changelog

* Unpinned previous version for cloud, ran blackFormat
 2023-06-15 11:54:57 +03:00
Denys Davydov
ba773ce4ce 🐛 Source Gitlab: disallow http in cloud, disallow endpoints in URLs (#27346) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source Gitlab: disallow enpoints in URLs, disallow bare http in cloud

* source gitlab: update changelog

* #26254 source gitlab: rm http from spec
 2023-06-15 11:11:54 +03:00
Baz
04a8267284 🐛 Source Amazon Seller Partner: add app_id to the OAuth Flow (source spec side) (#27110) 2023-06-15 10:29:55 +03:00
Denys Davydov
9812ccfb20 🐛 Source Gitlab: fix OAuth token expiry date (#27351) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #911 Source Gitlab: fix Oauth token expiry date

* #911 Source Gitlab: fix Oauth token expiry date

* Source Gitlab: update changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-15 09:03:37 +03:00
Philip Krauss
18553a28c3 🎉 New destination connector for Xata.io (#24192) 
* Add Xata.io Destination Connector

* readme for connectir

* adjust versioning

* missing state propagation

* throw exception if inconsistentcy is found

* set version in dockerfile

* exchange mock for deprecated logger

* put invalid config to file

* changelog in docs

* add xata dest connector to builds.md

* bump dependency to newer sdk version

* bump to latest sdk version

* blank bootstrap

* use class logger

* correct way to use the logger

* unit tests

* add write integration test

* removed irrelevant log line

* raise exception on incorrect message

* e2e test for writing

* add metadata file

* remove unued file

* remove build md

* update metdata and docs

* fix formatting

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-06-14 17:55:17 -03:00
Jove Zhong
e63d371e10 🎉 New Destination: Timeplus (#21226) 
* timeplus destination connector to push data to Timeplus via REST API/SDK

* 0.2.0, support nullable columns, add more test data

boolean and pokemon

* mark the apikey as secret

* us.timeplus.cloud as sample URL

* removed the unnecessary pass

* rewrite the logic of when to delete/create stream

* format code, following the PEP-8

* add write integration test

* replacing AirbyteLogger() with logging.getLogger('airbyte')

* add logs to destination.py, refine integration test

* add docs/integrations/destinations/timeplus.md

* add icon.svg

* set to 0.4.0 version

* upgrade timeplus sdk from 1.1.1 to 1.2.1

* add metadata file

* fix docker version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-06-14 17:33:23 -03:00
Marcos Marx
52798f0dca 🎉 New Source: KYVE Network (#27373) 
* chore: freshly generated source-kyve

* chore: added source files

* chore: added unit_tests

* chore: added integration_tests

* fix: fixed acceptance-tests

* chore: add additional metadata

* chore: add metadata.yaml

* doc: update changelog in docs

* fix: changelog and specs.yaml

* fix: unit tests

* doc: update README

* fix unit tests v2

* update acceptance test script & skip discover and incremental tests

* chore: Update in metadata the definitionId

* fix: Address review issues
- Fixed Dockefile and changelog version to 0.1.0
- Added order property on spec.yaml
- AdditionalProperties to the proper objects in schema definitions and made all fields nullable

* format

* fix doc url

* Add tags to metadata

---------

Co-authored-by: fabianriewe <fabian@kyve.network>
Co-authored-by: cgkournelos-rf <cgkournelos@rocketfueldev.com>
Co-authored-by: Kostas Christopoulos <kostas@withplum.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-06-14 17:15:56 -03:00
Cian
ce5170d7f0 🐛 Source Google Search Console: Fix data_state config typo (#27307) 
* Fix data_state typo in Google Search Console src

* Increment version

* Update changelog

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
 2023-06-14 15:32:51 -04:00
Dani
ae246c4146 ✨Source Outreach: add streams users, tasks, templates, snippets (#27343) 
* add users, tasks, templates, snippets streams

* bumped docker version and updated doc

* Added pr to changelog

* Bumped version in metadata.yaml
 2023-06-14 13:41:40 -04:00
Artem Inzhyyants
46d1f2b227 Source Stripe: Add New streams (#27083) 
* Source Stripe: Add Stream: Cards

* Source Stripe: update docs; tests config; bump version

* Source Stripe: Add Stream: Payment Methods; Refactor

* Source Stripe: update docs

* Source Stripe: update docs

* Source Stripe: fix unit tests

* Source Stripe: update abnormal_state

* Source Stripe: update schemas

* Source Stripe: update acceptance tests

* Source Stripe: fix address type

* Source Stripe: fix schemas

* Source Stripe: Add stream: Reviews

* Source Stripe: update docs

* Source Stripe: update acceptance tests

* Source Stripe: update schema

* Source Stripe: add stream Cardholders

* Source Stripe: update expected records

* Source Stripe: add expected records for cardholder

* Source Stripe: fix unit test

* Source Stripe: add abnormal state

* Source Stripe: add stream: Authorizations

* Source Stripe: update comment
 2023-06-14 17:50:26 +02:00
Anatolii Yatsuk
cc5a2fc4e8 🐛 Source Drift: migrate to advancedAuth (#27202) 
Remove authSpecification in favour of advancedAuth in the specification
 2023-06-13 18:55:17 +03:00
Baz
f9bf2a3449 🐛 Source Monday: add error_handler for 403, 500 HTTPError codes (#27244) 2023-06-13 17:22:51 +03:00
Denys Davydov
6581b6992a 🐛 Source Snapchat Marketing: remove deprecated auth specification (#26358) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26246 #26247 source Square, source Snapchat-Marketing: remove deprecated authSpecification in favour of advancedAuth

* #26246, #26247: upd changelogs

* Automated Change

* Automated Change

* revert square changes

* Automated Change

* Automated Commit - Formatting Changes

* Automated Commit - Format and Process Resources Changes

---------

Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
 2023-06-13 13:48:36 +03:00
Serhii Chvaliuk
003ef5fc1e Source: Iterable - read timeout added (#26459) 
* read timeout added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* iterable.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

---------

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-06-13 12:08:12 +03:00
Marcos Marx
546adcb7e0 🐛 Source Dixa: fix tests and conversation stream (#27250) 
* fix tests and conversation stream

* fix eof conversation export stream

* fix unit test

* fix: semantic versioning correction for new stream

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
 2023-06-12 18:01:13 -03:00
Artem Inzhyyants
8fb73442b2 Source Google Analytics Data API: update api rate limit messages (#27207) 
* Source Google Analytics Data API: update api rate limit messages

* Source Google Analytics Data API: update docs
 2023-06-12 14:17:44 +02:00
Denys Davydov
41869692fb 🐛 Source Gitlab: skip 404 error (#27234) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #23541 source gitlab: skip 404 error

* source gitlab: upd changelog

* #source gitlab: upd stream schemas and bump version

* source gitlab: update merge request commits stream schema

* #23541 update expected records
 2023-06-12 14:42:24 +03:00
Evan Tahler
7351b6fff1 Update faker produced tables (#27220) 2023-06-09 11:50:29 -07:00
Artem Inzhyyants
797eb4f427 Source google analytics data api: Improve error messages (#27175) 
* Source Google Analytics v4: refactor error messages

* Source Google Analytics Data API: improve error messages

* Source Google Analytics Data API: Refactor

* Source Google Analytics Data API: bump version + update docs

* Source Google Analytics Data API: fix test config

* Source Google Analytics Data API: update message
 2023-06-09 14:11:44 +02:00
Serhii Lazebnyi
703a70516a 🐛Source Klaviyo: anonymize connection error messages (#27162) 
* Add api token anonymization

* Updated PR number
 2023-06-09 13:44:07 +02:00
Serhii Lazebnyi
da67a60b7c Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest, Source Snapchat Marketin, Source S3, Source Airtable and Source Posthog: fix builds (#27135) 
* Fix SAT tests for confluence, greenhouse, hubspot, stripe

* Fix CAT for close, klaviyo, notion, pinterest and snapchat marketing

* Fix CAT for source s3

* Fix CAT for airtable and posthog

* Bump posthog version
 2023-06-09 03:05:44 +02:00
Natalie Kwong
af1535c29f Create additional setup guides for top API sources (#27101) 
* New setup guides

* Remove Google Ads bottom note

* Add "s" for Google Sheets

* Improve headers on Shopify

* Add two streams back
 2023-06-08 19:05:40 -04:00
Sherif A. Nada
40c36a4657 redshift source docs: mention incremental is now supported (#27145) 2023-06-08 15:49:57 -04:00
Mal Hancock
0fc11c5119 🐛 Source Notion: fix typo in blocks stream (#27170) 
* fix typo in block stream

* update docs
 2023-06-08 11:53:25 -07:00
Gaëtan Podevijn
eb14b968d8 ✨ Destination Databricks: connector supports schema evolution (schemaMerge) #26658 (#26942) 
* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector (#1)

* Ssdp 165/enable schema evolution in the airbyte databricks connector (#4)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Ssdp 165/add doc (#5)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Edit connector doc
 2023-06-08 14:56:34 -03:00
Serhii Lazebnyi
0bdd8445cf Remove debug mode for pytest config (#27157) 
* Deleted pytest log level

* Force log level for smart open to error

* Bump version

* Bump version

* Delete extra space
 2023-06-08 19:17:15 +02:00
Denys Davydov
083667aeed 🐛 Source Gitlab: improve connectivity check (#27147) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #1275 source Gitlab: improve connection check

* source gitlab: update changelog

* #1275 source gitlab: rm debug code
 2023-06-08 18:11:08 +03:00