jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-30 12:04:43 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,968 Commits 5,123 Branches 518 Tags
9f6963ccfcddd7a573c4ca0ff94de41ce6175cc0
Commit Graph

5267 Commits

Author SHA1 Message Date
Roman Yermilov [GL]
de9acec0bd Source Stripe: add new CreditNotes stream (#27132) 
* Source Stripe: add new CreditNotes stream

* Source Stripe: bump version

* Source Stripe: update unittests

* Source Stripe: update documentation

* Source Stripe: disable slicing

* Fix formating

---------

Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
 2023-06-22 19:11:49 +02:00
Artem Inzhyyants
aa9b4ee5e6 Source Google Ads: handle authorization error (#27608) 
* Source Google Ads: Fix pattern descriptor

* 🤖 Auto format source-google-ads code [skip ci]

* Source Google Ads: handle authorization error

* Source Google Ads: handle authorization error

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-22 18:34:39 +02:00
Serhii Lazebnyi
d96f6cbcdb Source Shopify: Added new streams (#27315) 
* Added new streams

* Delete blocked streams

* Delete unnecessary scopes

* Bump version

* Updated configured catalog

* Fix test_privileges_validation

* Fixed CAT for shopify

* Fix CAT for shopify

* Fix abnormal state

* Firmat code

* Updated doc
 2023-06-22 18:13:32 +02:00
Serhii Chvaliuk
019153f178 Source Google Analytics v4: - add pk and lookback window (#26283) 
* primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* bump 0.2.3

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* test_parse_response fixed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* metadata = None added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* LOOKBACK_WINDOW added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* google-analytics-data-api.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* threshold_days: 2 added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* remove uuid from acceptance-test-config.yml

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* uuid removed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* oss_registry.json - removed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range added for pivot_report pk

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* improve LOOKBACK_WINDOW

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range -> (startDate, endDate)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* bump 0.3.0

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* get_source_defined_primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* added comment about cohort get_json_schema

* Major Version Number Bump

---------

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: grubberr <grubberr@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <darina.ishchenko17@gmail.com>
 2023-06-22 19:00:38 +03:00
Artem Inzhyyants
0c3d4499d6 Source S3: fix start date (#27611) 
* Source S3: fix start date

* Source S3: update docs

* Source S3: bump version
 2023-06-22 17:17:52 +02:00
Maxime Carbonneau-Leclerc
37f04f7ba0 ✨ Source Zenloop: improve error message on state discrepancy (#27610) 
* [ISSUE #26607] improve error message on state discrepancy

* trigger pipeline
 2023-06-22 11:12:26 -04:00
Maxime Carbonneau-Leclerc
d9a5e2d873 🐛 Source zenloop: update to state per partition (#27556) 
* [ISSUE #26581] per partition cursor

* [ISSUE #26581] format

* [ISSUE #26581] clean up state management

* [ISSUE #26581] improving Hashabledict

* [ISSUE #26581] format cdk

* [ISSUE #26581] fix tests

* [ISSUE #26581] code review from girarda

* Retrigger pipeline

* [ISSUE #26581] code review

* Automated Commit - Formatting Changes

* [ISSUE #26581] validation overlapping keys

* [ISSUE #26581] add typing

* [ISSUE #26581] code review

* [ISSUE #26607] zenloop migration (#27243)

* [ISSUE #26607] zenloop migration implementation without tests

* [ISSUE #26607] zenloop migration adding edge cases

* [ISSUE #26607] add cursor field for state

* [ISSUE #26607] update abnormal state

* [ISSUE #26607] ensure default state

* [ISSUE #26607] updating CATs state

* [ISSUE #26607] revert migrating cursor

* [ISSUE #26607] remove default cursor value

* [ISSUE #26607] improve error message

* [ISSUE #26607] changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>

* 🤖 Auto format source-zenloop code [skip ci]

* Automated Commit - Formatting Changes

* [ISSUE #26581] move partition serialization to JSON

* Revert "[ISSUE #26607] zenloop migration (#27243)"

This reverts commit 5c6f19b775.

* Revert "Revert "[ISSUE #26607] zenloop migration (#27243)""

This reverts commit e363fd6cb8.

* [ISSUE #26607] update zenloop version

* TMP specify cdk version

* [ISSUE #26607] do not lock zenloop airbyte_cdk version

* trigger pipeline

* Automated Commit - Formatting Changes

* trigger pipeline

---------

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-22 08:42:20 -05:00
Daryna Ishchenko
dc7255bb6f 🐛 Source Google Directory: update version in cloud to 0.2.0 (#27236) 
* update version in cloud

* 🤖 Auto format source-google-directory code [skip ci]

* increased connectors version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-22 13:30:53 +03:00
Joe Reuter
5f05971924 Connector builder: Add documentation for unified oauth authenticator (#27061) 
* add documentation

* adjust docs
 2023-06-22 12:20:32 +02:00
Artem Inzhyyants
eef872e9f3 Source S3: Add logging for file reading (#27604) 
* Source S3: Add logging for file reading

* Source S3: update docs
 2023-06-22 10:53:32 +02:00
Charles
bf52bcffce deprecate otel docs (#27589) 2023-06-21 16:44:05 -07:00
Lee Danilek
77ea559f33 🚨🚨 🐛 Convex source fix skipped records (#27226) 
* update cursor in next_page_token, add request_headers

* .

* fix unit tests

* also fix SyncMode.incremental so it doesn't return duplicate records in race conditions

* fix client version in json_schemas

* fix version number

* fix sync_mode

* cache json_schemas to pass typecheck

* never mind

* fix sync_mode

* update metadata and doc

* backward compatiblity bypass

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-06-21 18:18:34 -03:00
Denys Davydov
076065cce4 🐛 Source Facebook marketing: reduce start date by one day (#27483) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #1975 source fb marketing: reduce start date by one day

* source fb marketing: upd changelog

* 🤖 Auto format source-facebook-marketing code [skip ci]

* format code

* #1975 source fb marketing: remove cloud version override

* source facebook marketing: update CAT config

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-21 18:32:49 +03:00
Artem Inzhyyants
aaf8f34dbe Source Stripe: Fix formatting (#27522) 
* Source Stripe: Fix formatting

* 🤖 Auto format source-stripe code [skip ci]

* Source Stripe: Bump version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-21 14:16:39 +02:00
Artem Inzhyyants
5f35afee11 Source Google Analytics Data API: Fix formatting (#27531) 
* Source Google Analytics Data API: Fix formatting

* Source Stripe: Bump version
 2023-06-21 12:54:53 +02:00
Octavia Squidington III
bad8157c44 🤖 Cloud Availability updater: new connectors to deploy [20230621] (#27542) 2023-06-21 10:26:00 +02:00
Denys Davydov
0f002d2362 🐛 Source Klaviyo: do not store state in the future (#27498) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2132 source klaviyo: do not store state in the future

* source klaviyo: upd changelog

* 🤖 Auto format source-klaviyo code [skip ci]

* reformat code

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-21 10:41:23 +03:00
Amalia Advincula-Roye
a0f8b3519a Update google-analytics-v4.inapp.md (#27536) 
Fixed custom report syntax
 2023-06-20 18:53:14 -04:00
Akash Kulkarni
2f807440da Fix issue in streaming JDBC database (#27212) 
* Fix issue in streaming JDBC database

* Bump + publish

* 🤖 Auto format source-db2 code [skip ci]

* 🤖 Auto format source-mssql code [skip ci]

* 🤖 Auto format source-postgres-strict-encrypt code [skip ci]

* 🤖 Auto format source-postgres code [skip ci]

* 🤖 Auto format source-mssql-strict-encrypt code [skip ci]

* 🤖 Auto format source-oracle code [skip ci]

* 🤖 Auto format source-tidb code [skip ci]

* 🤖 Auto format source-snowflake code [skip ci]

* 🤖 Auto format source-redshift code [skip ci]

* 🤖 Auto format source-mysql code [skip ci]

* 🤖 Auto format source-mysql-strict-encrypt code [skip ci]

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-20 12:08:47 -05:00
Roman Yermilov [GL]
80e6a2666b 🐛Source Amazon Ads: fix portfolioId type (#25874) 
* Source Amazon Ads: fix portfolioId type

* Source Amazon Ads: update metadata

* Source Amazon Ads: disable backward compatibility tests for 1.1.0

* 🤖 Auto format source-amazon-ads code [skip ci]

---------

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-20 11:22:43 -05:00
Evan Tahler
9cbb7f267a Update postgres.md (#27325) 
* Update postgres.md

* Update postgres.md

* Update postgres.md
 2023-06-20 15:16:47 +00:00
Artem Inzhyyants
1bc32f25c3 Source Salesloft: update expected records (#27484) 
* Source Salesloft: update expected records

* 🤖 Auto format source-salesloft code [skip ci]

* Source Salesloft: update test config

* Source Salesloft: bump version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-19 23:22:48 +02:00
Artem Inzhyyants
3df819612f Source Stripe: Add new Streams (#27362) 
* Source Stripe: Add Stream: Cards

* Source Stripe: update docs; tests config; bump version

* Source Stripe: Add Stream: Payment Methods; Refactor

* Source Stripe: update docs

* Source Stripe: update docs

* Source Stripe: fix unit tests

* Source Stripe: update abnormal_state

* Source Stripe: update schemas

* Source Stripe: update acceptance tests

* Source Stripe: fix address type

* Source Stripe: fix schemas

* Source Stripe: Add stream: Reviews

* Source Stripe: update docs

* Source Stripe: update acceptance tests

* Source Stripe: update schema

* Source Stripe: add stream Cardholders

* Source Stripe: update expected records

* Source Stripe: add expected records for cardholder

* Source Stripe: fix unit test

* Source Stripe: add abnormal state

* Source Stripe: add stream: Authorizations

* Source Stripe: Add Stream: Setup Attempts; Usage Records

* Source Stripe: update docs

* Source Stripe: Add Stream: Transfer Reversals

* Source Stripe: bump versions + update docs

* Source Stripe: Add Stream: Transactions

* Source Stripe: Fix Unit test

* Source Stripe: Refactor

* Source Stripe: Refactor

* Source Stripe: Fix full refresh test

* Source Stripe: bump version

* Source Stripe: update source

* Source Stripe: remove cache file

* Source Stripe: update expected records

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-19 20:28:29 +02:00
Artem Inzhyyants
5ded14c1cd Source Xero: Update Airbyte CDK version to 0.40 (#27471) 
* Source Xero: Update CDK version to 0.40

* Source Xero: Update CDK version to 0.40
 2023-06-19 16:43:51 +02:00
Artem Inzhyyants
d0db23ae51 Source Trello: Update expected records (#27470) 
* Source Trello: Update expected records

* Source Trello: Update expected records + schema

* Source Trello: Update docs
 2023-06-19 16:43:39 +02:00
Arsen Losenko
2e821bf1c1 🐛 Source Typeform: add undeclared columns to streams (#27455) 
* Source Typeform: add undeclared columns to streams

* Update changelog

* Add date-time format to datetime fields

* Change version of connector

* Update version in changelog

* Change version to 0.2.0
 2023-06-19 16:28:15 +03:00
Akash Kulkarni
d30906d89d Remove noisy logging for LegacyStateManager (#27335) 
* Remove noisy logging for legacy state manager

Context : https://airbytehq-team.slack.com/archives/C043JHEEYKG/p1686654588724759

* Bump version + dockerfile
 2023-06-16 17:13:33 -05:00
Denys Davydov
86c70b9a51 ✨ Source Zendesk Support: add stream Organization Memeberships (#27431) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #16881 source zendesk support: add Organiation Memberships stream

* add docs

* source zendesk support: upd changelog

* source zendesk support: upd unit tests
 2023-06-16 18:52:33 +03:00
Denys Davydov
2ee1837969 🐛 Source Gitlab: certify to GA + make API URL param optional (#27392) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source gitlab: certify to GA

* #26254 make API URL optional field

* source gitlab: upd changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-16 16:13:06 +03:00
malikdiarra
2de02eebd4 Bump Airbyte version from 0.50.3 to 0.50.4 2023-06-16 01:18:02 +00:00
Roman Yermilov [GL]
6a87475ae2 Source Stripe: Files and TopUps stream (#27238) 
* Source Stripe: top ups stream

* Source Stripe: files stream

* Source Stripe: FileLinks stream

* Source Stripe: bump version

* Source Stripe: update docs

* Source Stripe: refactoring
 2023-06-15 12:38:19 -07:00
Daryna Ishchenko
e9f9c41b17 🐛 Source Mixpanel: add handler for 402 error (#27252) 
* added handler for 402 error

* added changelog

* fixed CAT, updated logging

* changed stream in check_connection

* refactored tests

* added check for all streams to avoid 402 error

* added check for all stream for right permissions

* upadated expected records

* updated streams method

* added get_json_schema to streams method

* refactored check_connection method
 2023-06-15 21:02:13 +03:00
Zack Dai
783f01c756 Source Google Analytics: fix custom report with segments (#22223) 
* Souce  google_analytics_v4: update fix segents

* Update google-analytics-v4.md

* Update google-analytics-v4.md

* add unit test for custom_reports

* bump connector version

* Source Google Analytics v4: fix test

* Source Google Analytics v4: refactor + fix unittest

* update metadata and dockerfile

* retrigger ci

* update doc

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2023-06-15 09:50:08 -03:00
Kostas Botsas
8057ead798 Fix typos in readme (#27387) 2023-06-15 06:50:18 -05:00
Daryna Ishchenko
7fc42be17c 🐛 Source Notion: migrated to advancedAuth (#26535) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* migrated to advanced_auth

* #26535 source notion: upd changelog

---------

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Ben Church <ben@airbyte.io>
 2023-06-15 12:21:41 +03:00
Arsen Losenko
53c52293e9 🐛 Source Facebook Marketing: add complete_oauth_server_output_specification to spec (#27201) 
* Source Facebook Marketing: add complete_oauth_server_output_specification to spec

* Update changelog

* Unpinned previous version for cloud, ran blackFormat
 2023-06-15 11:54:57 +03:00
Denys Davydov
ba773ce4ce 🐛 Source Gitlab: disallow http in cloud, disallow endpoints in URLs (#27346) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source Gitlab: disallow enpoints in URLs, disallow bare http in cloud

* source gitlab: update changelog

* #26254 source gitlab: rm http from spec
 2023-06-15 11:11:54 +03:00
Baz
04a8267284 🐛 Source Amazon Seller Partner: add app_id to the OAuth Flow (source spec side) (#27110) 2023-06-15 10:29:55 +03:00
Denys Davydov
9812ccfb20 🐛 Source Gitlab: fix OAuth token expiry date (#27351) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #911 Source Gitlab: fix Oauth token expiry date

* #911 Source Gitlab: fix Oauth token expiry date

* Source Gitlab: update changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-15 09:03:37 +03:00
girarda
90c91ed6af Bump Airbyte version from 0.50.2 to 0.50.3 2023-06-15 02:40:11 +00:00
Philip Krauss
18553a28c3 🎉 New destination connector for Xata.io (#24192) 
* Add Xata.io Destination Connector

* readme for connectir

* adjust versioning

* missing state propagation

* throw exception if inconsistentcy is found

* set version in dockerfile

* exchange mock for deprecated logger

* put invalid config to file

* changelog in docs

* add xata dest connector to builds.md

* bump dependency to newer sdk version

* bump to latest sdk version

* blank bootstrap

* use class logger

* correct way to use the logger

* unit tests

* add write integration test

* removed irrelevant log line

* raise exception on incorrect message

* e2e test for writing

* add metadata file

* remove unued file

* remove build md

* update metdata and docs

* fix formatting

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-06-14 17:55:17 -03:00
Jove Zhong
e63d371e10 🎉 New Destination: Timeplus (#21226) 
* timeplus destination connector to push data to Timeplus via REST API/SDK

* 0.2.0, support nullable columns, add more test data

boolean and pokemon

* mark the apikey as secret

* us.timeplus.cloud as sample URL

* removed the unnecessary pass

* rewrite the logic of when to delete/create stream

* format code, following the PEP-8

* add write integration test

* replacing AirbyteLogger() with logging.getLogger('airbyte')

* add logs to destination.py, refine integration test

* add docs/integrations/destinations/timeplus.md

* add icon.svg

* set to 0.4.0 version

* upgrade timeplus sdk from 1.1.1 to 1.2.1

* add metadata file

* fix docker version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-06-14 17:33:23 -03:00
Marcos Marx
52798f0dca 🎉 New Source: KYVE Network (#27373) 
* chore: freshly generated source-kyve

* chore: added source files

* chore: added unit_tests

* chore: added integration_tests

* fix: fixed acceptance-tests

* chore: add additional metadata

* chore: add metadata.yaml

* doc: update changelog in docs

* fix: changelog and specs.yaml

* fix: unit tests

* doc: update README

* fix unit tests v2

* update acceptance test script & skip discover and incremental tests

* chore: Update in metadata the definitionId

* fix: Address review issues
- Fixed Dockefile and changelog version to 0.1.0
- Added order property on spec.yaml
- AdditionalProperties to the proper objects in schema definitions and made all fields nullable

* format

* fix doc url

* Add tags to metadata

---------

Co-authored-by: fabianriewe <fabian@kyve.network>
Co-authored-by: cgkournelos-rf <cgkournelos@rocketfueldev.com>
Co-authored-by: Kostas Christopoulos <kostas@withplum.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-06-14 17:15:56 -03:00
Cian
ce5170d7f0 🐛 Source Google Search Console: Fix data_state config typo (#27307) 
* Fix data_state typo in Google Search Console src

* Increment version

* Update changelog

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
 2023-06-14 15:32:51 -04:00
Ben Church
9dc8bb7a19 Update documentation for support url to documentation url (#27375) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-06-14 14:24:43 -05:00
pmossman
d00afad6a9 Bump Airbyte version from 0.50.1 to 0.50.2 2023-06-14 18:05:45 +00:00
Dani
ae246c4146 ✨Source Outreach: add streams users, tasks, templates, snippets (#27343) 
* add users, tasks, templates, snippets streams

* bumped docker version and updated doc

* Added pr to changelog

* Bumped version in metadata.yaml
 2023-06-14 13:41:40 -04:00
Augustin
5b8200181c connectors-ci: deprecate slash test (#27200) 2023-06-14 18:19:13 +02:00
Artem Inzhyyants
46d1f2b227 Source Stripe: Add New streams (#27083) 
* Source Stripe: Add Stream: Cards

* Source Stripe: update docs; tests config; bump version

* Source Stripe: Add Stream: Payment Methods; Refactor

* Source Stripe: update docs

* Source Stripe: update docs

* Source Stripe: fix unit tests

* Source Stripe: update abnormal_state

* Source Stripe: update schemas

* Source Stripe: update acceptance tests

* Source Stripe: fix address type

* Source Stripe: fix schemas

* Source Stripe: Add stream: Reviews

* Source Stripe: update docs

* Source Stripe: update acceptance tests

* Source Stripe: update schema

* Source Stripe: add stream Cardholders

* Source Stripe: update expected records

* Source Stripe: add expected records for cardholder

* Source Stripe: fix unit test

* Source Stripe: add abnormal state

* Source Stripe: add stream: Authorizations

* Source Stripe: update comment
 2023-06-14 17:50:26 +02:00
Joe Reuter
69c3a73ba9 Connector builder: Adjust documentation for incremental sync changes (#27206) 
* adjust documentation

* update tutorial based on incremental sync changes

---------

Co-authored-by: lmossman <lake@airbyte.io>
 2023-06-13 14:09:55 -07:00