jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-10 09:04:48 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,515 Commits 5,238 Branches 518 Tags
d30906d89dfa54eb4dca083f536ca4ea0c4e9435
Commit Graph

3283 Commits

Author SHA1 Message Date
Akash Kulkarni
d30906d89d Remove noisy logging for LegacyStateManager (#27335) 
* Remove noisy logging for legacy state manager

Context : https://airbytehq-team.slack.com/archives/C043JHEEYKG/p1686654588724759

* Bump version + dockerfile
 2023-06-16 17:13:33 -05:00
Denys Davydov
86c70b9a51 ✨ Source Zendesk Support: add stream Organization Memeberships (#27431) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #16881 source zendesk support: add Organiation Memberships stream

* add docs

* source zendesk support: upd changelog

* source zendesk support: upd unit tests
 2023-06-16 18:52:33 +03:00
Denys Davydov
2ee1837969 🐛 Source Gitlab: certify to GA + make API URL param optional (#27392) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source gitlab: certify to GA

* #26254 make API URL optional field

* source gitlab: upd changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-16 16:13:06 +03:00
Roman Yermilov [GL]
6a87475ae2 Source Stripe: Files and TopUps stream (#27238) 
* Source Stripe: top ups stream

* Source Stripe: files stream

* Source Stripe: FileLinks stream

* Source Stripe: bump version

* Source Stripe: update docs

* Source Stripe: refactoring
 2023-06-15 12:38:19 -07:00
Daryna Ishchenko
e9f9c41b17 🐛 Source Mixpanel: add handler for 402 error (#27252) 
* added handler for 402 error

* added changelog

* fixed CAT, updated logging

* changed stream in check_connection

* refactored tests

* added check for all streams to avoid 402 error

* added check for all stream for right permissions

* upadated expected records

* updated streams method

* added get_json_schema to streams method

* refactored check_connection method
 2023-06-15 21:02:13 +03:00
Zack Dai
783f01c756 Source Google Analytics: fix custom report with segments (#22223) 
* Souce  google_analytics_v4: update fix segents

* Update google-analytics-v4.md

* Update google-analytics-v4.md

* add unit test for custom_reports

* bump connector version

* Source Google Analytics v4: fix test

* Source Google Analytics v4: refactor + fix unittest

* update metadata and dockerfile

* retrigger ci

* update doc

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2023-06-15 09:50:08 -03:00
Kostas Botsas
8057ead798 Fix typos in readme (#27387) 2023-06-15 06:50:18 -05:00
Daryna Ishchenko
7fc42be17c 🐛 Source Notion: migrated to advancedAuth (#26535) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* migrated to advanced_auth

* #26535 source notion: upd changelog

---------

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Ben Church <ben@airbyte.io>
 2023-06-15 12:21:41 +03:00
Arsen Losenko
53c52293e9 🐛 Source Facebook Marketing: add complete_oauth_server_output_specification to spec (#27201) 
* Source Facebook Marketing: add complete_oauth_server_output_specification to spec

* Update changelog

* Unpinned previous version for cloud, ran blackFormat
 2023-06-15 11:54:57 +03:00
Denys Davydov
ba773ce4ce 🐛 Source Gitlab: disallow http in cloud, disallow endpoints in URLs (#27346) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26254 source Gitlab: disallow enpoints in URLs, disallow bare http in cloud

* source gitlab: update changelog

* #26254 source gitlab: rm http from spec
 2023-06-15 11:11:54 +03:00
Baz
04a8267284 🐛 Source Amazon Seller Partner: add app_id to the OAuth Flow (source spec side) (#27110) 2023-06-15 10:29:55 +03:00
Denys Davydov
9812ccfb20 🐛 Source Gitlab: fix OAuth token expiry date (#27351) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #911 Source Gitlab: fix Oauth token expiry date

* #911 Source Gitlab: fix Oauth token expiry date

* Source Gitlab: update changelog

---------

Co-authored-by: Augustin <augustin@airbyte.io>
 2023-06-15 09:03:37 +03:00
Philip Krauss
18553a28c3 🎉 New destination connector for Xata.io (#24192) 
* Add Xata.io Destination Connector

* readme for connectir

* adjust versioning

* missing state propagation

* throw exception if inconsistentcy is found

* set version in dockerfile

* exchange mock for deprecated logger

* put invalid config to file

* changelog in docs

* add xata dest connector to builds.md

* bump dependency to newer sdk version

* bump to latest sdk version

* blank bootstrap

* use class logger

* correct way to use the logger

* unit tests

* add write integration test

* removed irrelevant log line

* raise exception on incorrect message

* e2e test for writing

* add metadata file

* remove unued file

* remove build md

* update metdata and docs

* fix formatting

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-06-14 17:55:17 -03:00
Jove Zhong
e63d371e10 🎉 New Destination: Timeplus (#21226) 
* timeplus destination connector to push data to Timeplus via REST API/SDK

* 0.2.0, support nullable columns, add more test data

boolean and pokemon

* mark the apikey as secret

* us.timeplus.cloud as sample URL

* removed the unnecessary pass

* rewrite the logic of when to delete/create stream

* format code, following the PEP-8

* add write integration test

* replacing AirbyteLogger() with logging.getLogger('airbyte')

* add logs to destination.py, refine integration test

* add docs/integrations/destinations/timeplus.md

* add icon.svg

* set to 0.4.0 version

* upgrade timeplus sdk from 1.1.1 to 1.2.1

* add metadata file

* fix docker version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-06-14 17:33:23 -03:00
Marcos Marx
52798f0dca 🎉 New Source: KYVE Network (#27373) 
* chore: freshly generated source-kyve

* chore: added source files

* chore: added unit_tests

* chore: added integration_tests

* fix: fixed acceptance-tests

* chore: add additional metadata

* chore: add metadata.yaml

* doc: update changelog in docs

* fix: changelog and specs.yaml

* fix: unit tests

* doc: update README

* fix unit tests v2

* update acceptance test script & skip discover and incremental tests

* chore: Update in metadata the definitionId

* fix: Address review issues
- Fixed Dockefile and changelog version to 0.1.0
- Added order property on spec.yaml
- AdditionalProperties to the proper objects in schema definitions and made all fields nullable

* format

* fix doc url

* Add tags to metadata

---------

Co-authored-by: fabianriewe <fabian@kyve.network>
Co-authored-by: cgkournelos-rf <cgkournelos@rocketfueldev.com>
Co-authored-by: Kostas Christopoulos <kostas@withplum.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-06-14 17:15:56 -03:00
Cian
ce5170d7f0 🐛 Source Google Search Console: Fix data_state config typo (#27307) 
* Fix data_state typo in Google Search Console src

* Increment version

* Update changelog

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
 2023-06-14 15:32:51 -04:00
Dani
ae246c4146 ✨Source Outreach: add streams users, tasks, templates, snippets (#27343) 
* add users, tasks, templates, snippets streams

* bumped docker version and updated doc

* Added pr to changelog

* Bumped version in metadata.yaml
 2023-06-14 13:41:40 -04:00
Artem Inzhyyants
46d1f2b227 Source Stripe: Add New streams (#27083) 
* Source Stripe: Add Stream: Cards

* Source Stripe: update docs; tests config; bump version

* Source Stripe: Add Stream: Payment Methods; Refactor

* Source Stripe: update docs

* Source Stripe: update docs

* Source Stripe: fix unit tests

* Source Stripe: update abnormal_state

* Source Stripe: update schemas

* Source Stripe: update acceptance tests

* Source Stripe: fix address type

* Source Stripe: fix schemas

* Source Stripe: Add stream: Reviews

* Source Stripe: update docs

* Source Stripe: update acceptance tests

* Source Stripe: update schema

* Source Stripe: add stream Cardholders

* Source Stripe: update expected records

* Source Stripe: add expected records for cardholder

* Source Stripe: fix unit test

* Source Stripe: add abnormal state

* Source Stripe: add stream: Authorizations

* Source Stripe: update comment
 2023-06-14 17:50:26 +02:00
Anatolii Yatsuk
cc5a2fc4e8 🐛 Source Drift: migrate to advancedAuth (#27202) 
Remove authSpecification in favour of advancedAuth in the specification
 2023-06-13 18:55:17 +03:00
Baz
f9bf2a3449 🐛 Source Monday: add error_handler for 403, 500 HTTPError codes (#27244) 2023-06-13 17:22:51 +03:00
Denys Davydov
6581b6992a 🐛 Source Snapchat Marketing: remove deprecated auth specification (#26358) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26246 #26247 source Square, source Snapchat-Marketing: remove deprecated authSpecification in favour of advancedAuth

* #26246, #26247: upd changelogs

* Automated Change

* Automated Change

* revert square changes

* Automated Change

* Automated Commit - Formatting Changes

* Automated Commit - Format and Process Resources Changes

---------

Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
 2023-06-13 13:48:36 +03:00
Serhii Chvaliuk
003ef5fc1e Source: Iterable - read timeout added (#26459) 
* read timeout added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* iterable.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

---------

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-06-13 12:08:12 +03:00
Marcos Marx
546adcb7e0 🐛 Source Dixa: fix tests and conversation stream (#27250) 
* fix tests and conversation stream

* fix eof conversation export stream

* fix unit test

* fix: semantic versioning correction for new stream

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
 2023-06-12 18:01:13 -03:00
Artem Inzhyyants
8fb73442b2 Source Google Analytics Data API: update api rate limit messages (#27207) 
* Source Google Analytics Data API: update api rate limit messages

* Source Google Analytics Data API: update docs
 2023-06-12 14:17:44 +02:00
Denys Davydov
41869692fb 🐛 Source Gitlab: skip 404 error (#27234) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #23541 source gitlab: skip 404 error

* source gitlab: upd changelog

* #source gitlab: upd stream schemas and bump version

* source gitlab: update merge request commits stream schema

* #23541 update expected records
 2023-06-12 14:42:24 +03:00
Evan Tahler
7351b6fff1 Update faker produced tables (#27220) 2023-06-09 11:50:29 -07:00
Artem Inzhyyants
797eb4f427 Source google analytics data api: Improve error messages (#27175) 
* Source Google Analytics v4: refactor error messages

* Source Google Analytics Data API: improve error messages

* Source Google Analytics Data API: Refactor

* Source Google Analytics Data API: bump version + update docs

* Source Google Analytics Data API: fix test config

* Source Google Analytics Data API: update message
 2023-06-09 14:11:44 +02:00
Serhii Lazebnyi
703a70516a 🐛Source Klaviyo: anonymize connection error messages (#27162) 
* Add api token anonymization

* Updated PR number
 2023-06-09 13:44:07 +02:00
Serhii Lazebnyi
da67a60b7c Source Confluence, Source Greenhouse, Source Hubspot, Source Stripe, Source Close com, Source Klaviyo, Source Notion, Source Pinterest, Source Snapchat Marketin, Source S3, Source Airtable and Source Posthog: fix builds (#27135) 
* Fix SAT tests for confluence, greenhouse, hubspot, stripe

* Fix CAT for close, klaviyo, notion, pinterest and snapchat marketing

* Fix CAT for source s3

* Fix CAT for airtable and posthog

* Bump posthog version
 2023-06-09 03:05:44 +02:00
Natalie Kwong
af1535c29f Create additional setup guides for top API sources (#27101) 
* New setup guides

* Remove Google Ads bottom note

* Add "s" for Google Sheets

* Improve headers on Shopify

* Add two streams back
 2023-06-08 19:05:40 -04:00
Sherif A. Nada
40c36a4657 redshift source docs: mention incremental is now supported (#27145) 2023-06-08 15:49:57 -04:00
Mal Hancock
0fc11c5119 🐛 Source Notion: fix typo in blocks stream (#27170) 
* fix typo in block stream

* update docs
 2023-06-08 11:53:25 -07:00
Gaëtan Podevijn
eb14b968d8 ✨ Destination Databricks: connector supports schema evolution (schemaMerge) #26658 (#26942) 
* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector (#1)

* Ssdp 165/enable schema evolution in the airbyte databricks connector (#4)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Ssdp 165/add doc (#5)

* https://prima-assicurazioni-spa.myjetbrains.com/youtrack/issue/SSDP-165/Enable-schema-evolution-in-the-Airbyte-Databricks-connector

* bump minor version

* bump minor version

* Edit connector doc
 2023-06-08 14:56:34 -03:00
Serhii Lazebnyi
0bdd8445cf Remove debug mode for pytest config (#27157) 
* Deleted pytest log level

* Force log level for smart open to error

* Bump version

* Bump version

* Delete extra space
 2023-06-08 19:17:15 +02:00
Denys Davydov
083667aeed 🐛 Source Gitlab: improve connectivity check (#27147) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #1275 source Gitlab: improve connection check

* source gitlab: update changelog

* #1275 source gitlab: rm debug code
 2023-06-08 18:11:08 +03:00
Augustin
c2b7043f3f connectors-ci: make source-file testable in airbyte-ci (#27107) 2023-06-08 15:03:59 +00:00
Denys Davydov
a3c75e7339 🐛 Source Gitlab: fail on extra columns (#27150) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #24555 source gitlab: fail on extra columns

* source gitlab: update stream schemas
 2023-06-08 17:42:23 +03:00
Denys Davydov
f225cea974 🐛 Source Quickbooks: update spec (#27148) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* Source Quickbooks: update spec.json

* source quickbooks: update changelog
 2023-06-08 17:42:01 +03:00
Arsen Losenko
fa3e0a6bed ✨ Source Facebook Marketing: migrate to advancedAuth (#26941) 
* Source Facebook Marketing: migrate to advancedAuth

* Update changelog

* Update spec generation to match previous changes in spec

* Update files after flakeCheck
 2023-06-08 14:49:44 +03:00
Denys Davydov
87f2e4eb29 🐛 Source google analytics v4 deprecate auth specification (#26885) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26231 source GA-v4: deprecate authSpecification

* #26885 update changelog
 2023-06-08 13:24:50 +03:00
Denys Davydov
2d8abbf896 ✨ Source Facebok Pages: add advancedAuth (#26939) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26228 source fb pages: add advancedAuth

* source facebook pages: update changelog

* source fb pages: add empty dict to advanced oauth spec
 2023-06-08 12:06:56 +03:00
Jhonatas Kleinkauff
715c595812 Source Jira: add expand on lead field (#26920) 
* expand on lead field

* bumping connector version

* bump connector version on metadata file

* update docs

* update docs

* bump version

* update tests added in last source-jira pr

* fix expcted records

* fix doc

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-06-07 16:42:16 -03:00
Artem Inzhyyants
f78e2e51c7 Source Notion: skip streams with invalid_start_cursor error (#27062) 
* Source Notion: skip streams with invalid_start_cursor error

* Source Notion: update docs

* Source Stripe: bump version
 2023-06-07 17:31:11 +02:00
Daryna Ishchenko
83b968ad45 :bug:Source Notion: added handing empty results in response (#27073) 
* added handing empty results in response

* added changelog
 2023-06-07 18:25:08 +03:00
Pedro S. Lopez
471568a9b9 🐛 source smartsheets: fix error getting optional metadata_fields on existing configs (#27096) 
* fix accessing optional `metadata_fiels` config property

* update metadata

* bump version in dockerfile

* update changelog
 2023-06-07 10:36:36 -04:00
Joe Reuter
f41b3e15da Update CDK for source-xero (#27007) 
* wip

* Automated Commit - Formatting Changes

* add documentation

* tests and fixes

* fix tests

* more documentation

* revert

* update xero

* update documentation

* update version

---------

Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-06-07 15:14:10 +02:00
Joe Reuter
e19c498b00 Remove lowcode SingleUseRefreshTokenOauthAuthenticator (#27053) 
* wip

* Automated Commit - Formatting Changes

* add documentation

* tests and fixes

* fix tests

* more documentation

* revert

* changes as discussed

* fix case

* add docstring

* add details to schema

* format

* remove old singleuserefreshtokenauthenticator from lowcode

* prepare quickbooks connector

* format

---------

Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-06-07 15:07:50 +02:00
Daryna Ishchenko
6defead33c 🐛 Source Notion: added skipping 404 error for steam bloks (#27060) 
* added skipping 404 error for steam bloks

* added changelog
 2023-06-07 10:59:22 +03:00
Pedro S. Lopez
69b89820eb 📄 docs: add deprecation note for Google Analytics (Universal Analytics) (#27044) 
* add deprecation note for GA:UA

* add deprecation note for oauth and contributions
 2023-06-06 19:42:24 -04:00
Natalie Kwong
e462fced7b Update in-app docs for select API sources (#26781) 
* Update in-app docs

* Update docs/integrations/sources/github.inapp.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Improve verbiage for Amazon Ads

* Amazon Ads Lookback window update

* Resolve conflict

---------

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2023-06-06 16:16:51 -04:00