jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-08 12:03:02 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,968 Commits 5,225 Branches 518 Tags
9f6963ccfcddd7a573c4ca0ff94de41ce6175cc0
Commit Graph

2869 Commits

Author SHA1 Message Date
Maxime Carbonneau-Leclerc
22f7445db6 🐛 Source Greenhouse: update following state management changes in the CDK (#27773) 
* Update greenhouse custom component

* Force airbyte-cdk version

* Fix code, bump version and update changelogs

* Fix unit tests

* Fix tests

* Fix set_initial_state for GreenHouseSubstreamSlicer

* Reformat using black

* isort

* Update update_state to close_slice

* Simplify code and format

* Update considering fix

* Update CDK version to fix bug
 2023-06-29 15:22:59 -04:00
Maxime Carbonneau-Leclerc
96aa72d3b2 🐛 Source Posthog: update following state management changes in the CDK (#27764) 
* Update interface based on new Cursor interface

* Update version and changelogs

* Update unit tests

* Fix cursor assignation

* Update update_state to close_slice

* Update considering fix

* Update CDK version to fix bug
 2023-06-29 15:03:25 -04:00
Maxime Carbonneau-Leclerc
baaabf4390 🐛 Source Zenloop: update CDK version to avoid bug introduced during data feed release (#27838) 
* Update CDK version to fix bug

* Version bump
 2023-06-29 14:45:17 -04:00
Maxime Carbonneau-Leclerc
074cddf690 🐛 Source Quickbooks: update following state management changes in the CDK (#27803) 
* Update quickbooks following state management cleanup

* Update changelogs

* Update tests

* Ensure CDK version

* Update update_state to close_slice

* Update test to use partition end datetime

* Update considering fix

* renaming
 2023-06-29 11:13:02 -04:00
Arsen Losenko
9ac7793b07 ✨ Source Typeform: Add OAuth support (#27240) 
* Source Typeform: Add OAuth support

* Update spec to support OAuth

* Update spec structure and check implementation

* fix flake warnings

* Update spec.json

* Update unit tests

* Update spec and specify access_token path in check

* Keep structure for previous API token configs

* Remove backwards compatibility entries

* Get auth headers from authenticator, add forms_ids back to spec

* 🤖 Auto format source-typeform code [skip ci]

* Add major version bump

* Update unit tests

* Make "credentials" a required property

* Update version, update CAT config

* Skip previous version in spec and check tests

* Add OAuth information to docs, update setup description

* Update documentaion

* Make start_date optional

* Set start_date as optional in docs

* Apply suggestions from code review

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2023-06-29 17:46:52 +03:00
Maxime Carbonneau-Leclerc
9459b4ee1f 🐛 Source Zenloop: update following state management changes in the CDK (#27761) 
* Update zenloop stream_slices

* Ensuring most recent CDK version

* Update version and changelogs

* Update changelogs

* Format

* flake8 cleanup
 2023-06-29 08:45:55 -04:00
Artem Inzhyyants
c777ed8ab9 Source Close com: Update the Email Followup Tasks stream schema (#27776) 
* Source Close: update expected_records

* Source Close: update schemas

* Source Close: bump version + docs update
 2023-06-29 12:30:26 +02:00
Artem Inzhyyants
ad17938bc3 🚨🚨 Source MetaBase: Remove Activity Stream (#27777) 
* Source MetaBase: update `activity` stream

* Source MetaBase: update docs

* Source MetaBase: Remove Activity Stream

* Source MetaBase: update test config

* Source MetaBase: bump version

* Source MetaBase: add allowedhosts

* Source MetaBase: remove activity stream refs
 2023-06-29 12:30:09 +02:00
Denys Davydov
3d14fc721f 🐛 Source GA Data API: change page size when calling check() (#27718) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2277 source GA: limit page size when calling check

* source GA: upd changelog

* code formatting

* #2277 review fixes
 2023-06-29 10:52:04 +03:00
Denys Davydov
a9a98bc91d 🐛 Source Google Ads: refactor date slicing (#27711) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2344 source google ads: refactor date slicing

* #2344 source google ads: upd changelog

* #2344 review fixes
 2023-06-29 10:49:26 +03:00
Evan Tahler
9ce3cc6e79 Java DB Source connector licenses to Elv2 (#27737) 
* Java DB Source connector licenses to Elv2

* Bump PR Ids
 2023-06-28 18:52:02 -07:00
Evan Tahler
788a0ec7af Simplify faker offsets and limits (#27807) 2023-06-28 13:21:14 -07:00
Eric Schrock
620f8cb97f 🚨🚨 Source Okta: fix group members and resource sets streams (#27533) 
---------

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2023-06-28 12:21:58 -07:00
Mal Hancock
9641d33773 ✨ Source Datadog: Multiple query streams and datadog site parameter (#27804) 
* Source Datadog - Multiple query streams

* Source Datadog - Multiple query streams

* Source Datadog - Multiple query streams

* Source Datadog - Start date changes

* Source Datadog - Query date changes

* Source Datadog - Docs update

* Source Datadog - Review comment changes

* Source Datadog - Review comment changes

* formatting fixes

---------

Co-authored-by: richa-rochna <rochna.richa@gmail.com>
Co-authored-by: richar_backbase <richar@backbase.com>
Co-authored-by: Richa Rochna <99747757+richa-rochna@users.noreply.github.com>
 2023-06-28 10:57:57 -07:00
Tim Roes
56c35d741b Fix Stripe title in menu (#27800) 2023-06-28 18:56:48 +02:00
Mal Hancock
e0be3945ef 🐛 Source Datadog: Fix schemas (#27784) 
* update schemas and acceptance-test-config.yml

* disable incremental test

* bump version
 2023-06-28 09:53:34 -07:00
Evan Tahler
4dcb22d07a Stripe connector license to Elv2 (#27734) 
* Stripe connector license to Elv2

* PR ID
 2023-06-27 11:00:40 -05:00
Evan Tahler
62d9823cd8 Shopify connector license to Elv2 (#27732) 
* Shopify connector license to Elv2

* PR id
 2023-06-27 10:59:41 -05:00
Juan
14c0212d89 Update File source doc (#27763) 
Included that AzBlob URL only needs the path to the file and not the base URL.
 2023-06-27 11:46:21 -04:00
btkcodedev
569be8661d ✨Source Twilio: New streams VerifyServices (#27231) 
* Add new stream VerifyServices

* fix: format python files with flake8

* Override page_size

* find records with data_field

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
 2023-06-27 11:11:03 -04:00
btkcodedev
1716d2898c ✨Source Zendesk Support: New Stream - Posts (#27156) 
* Initial commit

* Update docs

* Update zendesk-support.md

* fix: add missing comma to unit test tuple

* Update unit_test.py

* 🤖 Auto format source-zendesk-support code [skip ci]

* increment expected_n_streams in unit tests

* increment one more thing for expected_n_streams in unit tests

* increment connector version

* fix unit test

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-27 11:10:26 -04:00
Artem Inzhyyants
16d7701742 Source Prestashop: Fix schema, remove empty datetime fields (#27716) 
* Source Prestashop: update schema; remove empty datetime fields

* Source Prestashop: update expected_records

* Source Prestashop: update docs

* Source Prestashop: update schemas

* Source Prestashop: fix backward compatibility

* Source Prestashop: bump version

* Source Prestashop: update expected_records

* Source Prestashop: update test config

* Source Prestashop: update test config

* Source Prestashop: update expected records

* Source Prestashop: update expected_records
 2023-06-27 17:09:03 +02:00
Denys Davydov
4da621f96a ✨ Source Zendesk Support: add stream Ticket Skips (#27436) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #16888 source zendesk support: add stream Ticket Skips

* source zendesk support: upd changelog

* fix typo after resolving merge conflict

* #16888 add expected recrods + set response_list_name

* update expected records

* upd expected records

* another expected records update
 2023-06-27 15:15:10 +03:00
Denys Davydov
a7dc3af9b4 ✨ Source Zendesk Support: add Skills Based Routing streams (#27450) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #16887 source zendesk support: add skill based routing streams

* source endesk support: upd changelog

* #16887 source zendesk support: update expected records + schemas

* source zendesk: fix formatting+expected records

* zendesk support: upd schema + expected records

* zendesk support: update expected records

* upd expected records

* upd expected records

* upd tags in expected records

* another expected records update
 2023-06-27 14:36:52 +03:00
Evan Tahler
037a522f8c Google Source connector licenses to Elv2 (#27738) 
* Google Source connector licenses to Elv2

* bump PR Ids

* Update metadata.yaml
 2023-06-27 03:38:13 -04:00
Evan Tahler
db882e3d2a Salesforce, Marketo, and Hubspot connector license to Elv2 (#27726) 
* Salesforce, Marketo, and Hubspot connector license to Elv2

* PR in docs
 2023-06-26 21:00:43 -05:00
Evan Tahler
d28b896ba5 Zendesk Support connector license to Elv2 (#27735) 
* Zendesk Support connector license to Elv2

* Update PR ID
 2023-06-26 19:49:06 -05:00
Evan Tahler
a4a30f52f6 Facebook Pages and Facebook Marketing connector license to Elv2 (#27728) 
* Facebook Pages and Facebook Marketing connector license to Elv2

* bump PR ID
 2023-06-26 19:26:21 -05:00
Evan Tahler
79dba56923 S3 and GCS connector license to Elv2 (#27725) 
* S3 and GCS connector license to Elv2

* docs update

* docs
 2023-06-26 18:27:18 -05:00
Daryna Ishchenko
c71b8f8748 🐛 Source Recharge: migrated to 2021-11 api version (#27503) 
* migrated to 2021-11 api version

* 🤖 Auto format source-recharge code [skip ci]

* updated changelog

* updated request params

* increased timeout for sat

* increased timeout for sat

* removed stream slices

* added stream_slices

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-26 16:07:54 +03:00
Arsen Losenko
9f2659dc3b 🐛 Source Typeform: add form_id field to records of responses stream (#27653) 
* Source Typeform: add form_id field to records of responses stream

* Update changelog

* Fix flake warnings

* Update airbyte-integrations/connectors/source-typeform/Dockerfile

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* Update version number

---------

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
 2023-06-26 13:20:50 +03:00
Evan Tahler
94097d0325 source-faker: cursor = updated_at & remove records_per_sync (#27684) 
* source-faker: cursor = updated_at & remove records_per_sync

* metadata

* flake
 2023-06-24 15:31:53 -04:00
Artem Inzhyyants
9734e285be Source Freshdesk: fix formatting (#27680) 
* Source Freshdesk: fix formatting

* Source Freshdesk: update docs

* Source Freshdesk: fix unittest
 2023-06-24 15:52:04 +02:00
Artem Inzhyyants
0b52a7de2c Source Gitlab: Fix formatting (#27679) 
* Source Gitlab: Fix formatting

* Source Gitlab: update docs
 2023-06-24 12:58:48 +02:00
Pedro S. Lopez
9c1cdffd6a 📄 Google Analytics: Universal Analytics OAuth is back on Cloud (#27659) 2023-06-23 16:39:48 -04:00
midavadim
c7b2f99af5 🎉 Source Amazon Ads add campaign negative keywords stream (#27482) 
* Add sponsored_product_campaign_negative_keywords stream

* revert changes

* 🤖 Auto format source-amazon-ads code [skip ci]

* Add sponsored_display_budget_rules stream

* 🤖 Auto format source-amazon-ads code [skip ci]

* ignore dailyBudget field
it can be updated, also it is sometimes integer, sometimes float"

* Fix sponsored_product_campaigns

* Fix sponsored_product_campaigns

* merged with the latest version

* updated source test

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-23 17:31:20 +03:00
Artem Inzhyyants
c68afefdf0 Source S3: handle Bucket Access Errors (#27651) 
* Source S3: handle bucket access errors

* Source S3: update docs
 2023-06-23 13:22:57 +02:00
Denys Davydov
a6dd6820a8 🐛 Source Bing Ads: retry DNS failure (#27619) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2209 Source Bing Ads: retry DNS failure

* source bing ads: upd changelog

* fix typing
 2023-06-23 08:16:01 +03:00
Roman Yermilov [GL]
de9acec0bd Source Stripe: add new CreditNotes stream (#27132) 
* Source Stripe: add new CreditNotes stream

* Source Stripe: bump version

* Source Stripe: update unittests

* Source Stripe: update documentation

* Source Stripe: disable slicing

* Fix formating

---------

Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
 2023-06-22 19:11:49 +02:00
Artem Inzhyyants
aa9b4ee5e6 Source Google Ads: handle authorization error (#27608) 
* Source Google Ads: Fix pattern descriptor

* 🤖 Auto format source-google-ads code [skip ci]

* Source Google Ads: handle authorization error

* Source Google Ads: handle authorization error

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-22 18:34:39 +02:00
Serhii Lazebnyi
d96f6cbcdb Source Shopify: Added new streams (#27315) 
* Added new streams

* Delete blocked streams

* Delete unnecessary scopes

* Bump version

* Updated configured catalog

* Fix test_privileges_validation

* Fixed CAT for shopify

* Fix CAT for shopify

* Fix abnormal state

* Firmat code

* Updated doc
 2023-06-22 18:13:32 +02:00
Serhii Chvaliuk
019153f178 Source Google Analytics v4: - add pk and lookback window (#26283) 
* primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* bump 0.2.3

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* test_parse_response fixed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* metadata = None added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* LOOKBACK_WINDOW added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* google-analytics-data-api.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* threshold_days: 2 added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* remove uuid from acceptance-test-config.yml

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* uuid removed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* oss_registry.json - removed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range added for pivot_report pk

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* improve LOOKBACK_WINDOW

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range -> (startDate, endDate)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* bump 0.3.0

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* get_source_defined_primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* added comment about cohort get_json_schema

* Major Version Number Bump

---------

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: grubberr <grubberr@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <darina.ishchenko17@gmail.com>
 2023-06-22 19:00:38 +03:00
Artem Inzhyyants
0c3d4499d6 Source S3: fix start date (#27611) 
* Source S3: fix start date

* Source S3: update docs

* Source S3: bump version
 2023-06-22 17:17:52 +02:00
Maxime Carbonneau-Leclerc
37f04f7ba0 ✨ Source Zenloop: improve error message on state discrepancy (#27610) 
* [ISSUE #26607] improve error message on state discrepancy

* trigger pipeline
 2023-06-22 11:12:26 -04:00
Maxime Carbonneau-Leclerc
d9a5e2d873 🐛 Source zenloop: update to state per partition (#27556) 
* [ISSUE #26581] per partition cursor

* [ISSUE #26581] format

* [ISSUE #26581] clean up state management

* [ISSUE #26581] improving Hashabledict

* [ISSUE #26581] format cdk

* [ISSUE #26581] fix tests

* [ISSUE #26581] code review from girarda

* Retrigger pipeline

* [ISSUE #26581] code review

* Automated Commit - Formatting Changes

* [ISSUE #26581] validation overlapping keys

* [ISSUE #26581] add typing

* [ISSUE #26581] code review

* [ISSUE #26607] zenloop migration (#27243)

* [ISSUE #26607] zenloop migration implementation without tests

* [ISSUE #26607] zenloop migration adding edge cases

* [ISSUE #26607] add cursor field for state

* [ISSUE #26607] update abnormal state

* [ISSUE #26607] ensure default state

* [ISSUE #26607] updating CATs state

* [ISSUE #26607] revert migrating cursor

* [ISSUE #26607] remove default cursor value

* [ISSUE #26607] improve error message

* [ISSUE #26607] changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>

* 🤖 Auto format source-zenloop code [skip ci]

* Automated Commit - Formatting Changes

* [ISSUE #26581] move partition serialization to JSON

* Revert "[ISSUE #26607] zenloop migration (#27243)"

This reverts commit 5c6f19b775.

* Revert "Revert "[ISSUE #26607] zenloop migration (#27243)""

This reverts commit e363fd6cb8.

* [ISSUE #26607] update zenloop version

* TMP specify cdk version

* [ISSUE #26607] do not lock zenloop airbyte_cdk version

* trigger pipeline

* Automated Commit - Formatting Changes

* trigger pipeline

---------

Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-22 08:42:20 -05:00
Daryna Ishchenko
dc7255bb6f 🐛 Source Google Directory: update version in cloud to 0.2.0 (#27236) 
* update version in cloud

* 🤖 Auto format source-google-directory code [skip ci]

* increased connectors version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-22 13:30:53 +03:00
Artem Inzhyyants
eef872e9f3 Source S3: Add logging for file reading (#27604) 
* Source S3: Add logging for file reading

* Source S3: update docs
 2023-06-22 10:53:32 +02:00
Lee Danilek
77ea559f33 🚨🚨 🐛 Convex source fix skipped records (#27226) 
* update cursor in next_page_token, add request_headers

* .

* fix unit tests

* also fix SyncMode.incremental so it doesn't return duplicate records in race conditions

* fix client version in json_schemas

* fix version number

* fix sync_mode

* cache json_schemas to pass typecheck

* never mind

* fix sync_mode

* update metadata and doc

* backward compatiblity bypass

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-06-21 18:18:34 -03:00
Denys Davydov
076065cce4 🐛 Source Facebook marketing: reduce start date by one day (#27483) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #1975 source fb marketing: reduce start date by one day

* source fb marketing: upd changelog

* 🤖 Auto format source-facebook-marketing code [skip ci]

* format code

* #1975 source fb marketing: remove cloud version override

* source facebook marketing: update CAT config

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-21 18:32:49 +03:00
Artem Inzhyyants
aaf8f34dbe Source Stripe: Fix formatting (#27522) 
* Source Stripe: Fix formatting

* 🤖 Auto format source-stripe code [skip ci]

* Source Stripe: Bump version

---------

Co-authored-by: octavia-squidington-iii <octavia-squidington-iii@users.noreply.github.com>
 2023-06-21 14:16:39 +02:00