jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-10 09:04:48 -05:00
Code Issues Packages Projects Releases Wiki Activity
11,968 Commits 5,238 Branches 518 Tags
9f6963ccfcddd7a573c4ca0ff94de41ce6175cc0
Commit Graph

5267 Commits

Author SHA1 Message Date
Baz
14dbfe88c1 🐛 Source Hubspot: fix then state has explicit empty str state value (#26719) 2023-05-29 22:31:58 +03:00
Denys Davydov
0714656e77 🐛 Source Intercom: migrate to advancedAuth (#26571) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26238 source intercom: migrate to advancedAuth

* source intercom: upd changelog

* source intercom: resolve conflicts

* revert leverhiring changes
 2023-05-29 21:44:25 +03:00
Denys Davydov
e9f57c5f35 🐛 Source Instagram: migrate to advanced auth (#26656) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26237 source instagram - migrate to advancedAuth

* source instagram: upd changelog

* #26237: source instagram: upd exepcted spec
 2023-05-29 21:43:46 +03:00
Denys Davydov
dcd2067904 🐛 Source Harvest: migrate to advanced auth (#26714) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26235 source harvest: migrate to advancedAuth

* source harvest: upd changelog
 2023-05-29 18:42:21 +03:00
Denys Davydov
9b8f9dfd59 🐛 Source Square migrate auth spec to advanced auth (#26485) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26247 Source Square: migrate authSpec to advancedAuth

* #26485 source square: upd changelog

* source square: upd CAT config to fix build
 2023-05-29 18:42:06 +03:00
Denys Davydov
5d4d71b7f3 🐛 Source Lever-hiring: migrate to advancedAuth (#26564) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26239 source Quickbooks: migrate from authSpecification to advancedAuth
 2023-05-29 10:41:29 +03:00
Ben Church
1dabc6208e Metadata: add tags field (#26320) 
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
 2023-05-26 16:13:09 -07:00
Artem Inzhyyants
c5d7961e0b Source Instagram: handle AuthError (#26599) 
* Source Instagram: handle AuthError:
Media posted before business account conversion

* Source Instagram: bump version

* Source Instagram: update docs
 2023-05-26 22:45:45 +02:00
Baz
25f07db459 📝 Source Intercom: add 0.2.0 changes to changelog (#26681) 2023-05-26 22:36:53 +03:00
Baz
80c1dce186 🐛 Source Jira: fix bug when board doesn't support sprints (#26652) 2023-05-26 22:34:28 +03:00
Tyler B
ae1c5443e3 Update pinterest Start Date to 90 days back (#26680) 2023-05-26 12:16:27 -07:00
Ben Church
13c630022c Ensure headings are properly nested (#26638) 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
 2023-05-26 09:38:30 -07:00
Baz
94219befbd 🐛 Source TikTok Marrketing: fix syncs with Advertiser ID (#26569) 2023-05-26 19:29:34 +03:00
Marcos Marx
e94f3b034f 🐛 Source Aha: fix schemas and integration test (#26666) 
* fix schemas

* bump connector version
 2023-05-26 13:02:07 -03:00
Daryna Ishchenko
3443438de7 🐛Source Youtube Analytics: migrated to advancedAuth (#26420) 
* migrated to advancedAuth

* added changelog

* Automated Change

* removed auth_type

---------

Co-authored-by: darynaishchenko <darynaishchenko@users.noreply.github.com>
 2023-05-26 17:48:52 +03:00
Denys Davydov
0e8da0ca08 🐛 Source LinkedIn-Ads: migrate to advancedAuth (#26512) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26240 Source LinkedIn ads: migrate to advancedAuth

* source linkedin-ads: upd changelog
 2023-05-26 11:46:05 +03:00
Denys Davydov
1f1683a160 Source Qualaroo: drop auth spec (#26491) 
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #26244 source Qualaroo: remove authSpec

* #26244 source qualaroo: update stream schema

* source qualaroo: upda changelog
 2023-05-26 11:44:42 +03:00
Reid Beels
ea7bd028ac 🐛 Fix URL pattern regex in Google PageSpeed Insights connector (#22287) 
* Fix URL pattern regex in Google PageSpeed Insights connector

Without this `[` escaped, setting up a new source results in `java.util.regex.PatternSyntaxException: Unclosed character class`

* Bump source-google-pagespeed-insights version to 0.1.1

* fix: correct validation errors in acceptance-test-config.yml

* docs: bump metadata.yml file and update connector changelog

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
 2023-05-26 01:26:28 -04:00
Artur Siepietowski
89326841b1 🚨🚨 ✨ Source Google Search Console: adding data_state parameter (#26452) 
* feat: adding  parameter

* bump dockerfile and metadata.yaml

* docs: update google-search-console readme with new changelog

* @lazebnyi code review suggestion applied

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
 2023-05-26 01:25:28 -04:00
Edward Gao
bbdb3be868 Destination Redshift: Install normalization (#26165) 
* do things in-connector

* Automated Change

* version bumps + changelog

* remove unnecessary yum package

* derp

* also build.gradle

* Automated Change

---------

Co-authored-by: edgao <edgao@users.noreply.github.com>
 2023-05-25 23:40:48 +00:00
Augustin
42f3d4559f connectors-ci: re-upload spec if image exists + fix pre-release (#26604) 
* connectors-ci: fix pre-release

* fix edge case

* Automated Change

---------

Co-authored-by: alafanechere <alafanechere@users.noreply.github.com>
 2023-05-25 21:53:51 +02:00
btkcodedev
a26da0b5b1 ✨ Source Stripe: New Streams - Application Fee Refunds & Application Fees (#25893) 
* add new stream schemas

* Add new streams to source, add tests

* update docs

* update version

* fix: remove source_definitions and source_spec.yaml files

* bump dockerfile and metadata.yaml

* fix: correct accidental removal of bank_accounts stream from empty_streams

---------

Co-authored-by: sajarin <sajarindider@gmail.com>
 2023-05-25 15:07:00 -04:00
Shishir Rajmohan Verma
26c5cc0d6d 🐛 Source Amazon Ads: Add missing reporting metrics to the source connector (#25412) 
* Add missing reporting metrics to source connector for Amazon Ads

* update changelog

* correct version
 2023-05-25 15:57:21 -03:00
Marcos Marx
87f277f41b remove old testing docs (#26605) 2023-05-25 15:22:52 -03:00
Edward Gao
cf2ded2bbb Destination Bigquery: small tweak to clarify logs (#26585) 
* make logs less misleading

* version bumps + changelog

* tweak wording
 2023-05-25 18:20:40 +00:00
Artem Inzhyyants
4b26835dbb Source TikTok Marketing: Spec changes (#26565) 
* Source TikTok Marketing: Spec changes;
Change default value for `attribution window` to 3 days; add min/max validation

* Source TikTok Marketing: update docs
 2023-05-25 20:14:57 +02:00
Brent Souza
01b1673ad1 🎉Source Gitlab: preserve data in records with flattened keys (#22293) 
* Use get instead of pop to preserve object in dict

* update unit tests and schemas

* update schemas, fix tests, update version

* update version

* update expcted records

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-05-25 14:38:55 -03:00
Subodh Kant Chaturvedi
9b9809b006 fix(cdc): limit queue size to lower memory consumption (#26473) 
* fix(cdc): limit queue size to lower memory consumption

* add queue size attribute in spec

* disable retries

* fix log

* review comments

* add validation test for queue size

* update expected spec

* bump version + changelog

* update metadata files

---------

Co-authored-by: Ben Church <ben@airbyte.io>
 2023-05-25 22:34:40 +05:30
Daryna Ishchenko
2a1d7f37e2 🐛Source File: added parser error handling (#26275) 
* added parser error handling

* updated versions, added changelog

* Automated Change

---------

Co-authored-by: darynaishchenko <darynaishchenko@users.noreply.github.com>
 2023-05-25 19:02:57 +03:00
Anatolii Yatsuk
44c23d1104 🐛Source GitLab: Fix syncing branches for the project with Repository feature disabled (#26422) 
Add handling blocked repository for branches stream
 2023-05-25 18:58:49 +03:00
hehe
8f35bc45c7 docs: remove extra space in sources/s3.md (#26527) 2023-05-25 07:25:09 -05:00
Sherif A. Nada
cd9ea77eca Hubspot Docs: remove mention of API keys, improve various wordings (#26533) 2023-05-25 01:28:51 -07:00
Baz
5e2f16ecf1 🐛 Source Slack: fix lookback window value range limits (#26497) 2023-05-25 08:54:08 +03:00
Sherif A. Nada
45c506c516 docs: remove outdated note about oauth being disabled on cloud for asana (#26516) 2023-05-24 19:35:38 -07:00
Alexandre Girard
27160be511 Update docs (#26502) 2023-05-24 12:40:17 -07:00
btkcodedev
5280e3ce5e ✨Source Zendesk Support: New Stream - Audit Logs (#26347) 
* Initial commit

* EOF

* add audit_logs to empty streams and bump number of streams

* docs: make a note that audit logs is only available on enterprise accounts

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
 2023-05-24 15:28:55 -04:00
keurcien
e12daa7e06 🐛 Source Braintree: catch client initialization error in check_connection method (#26340) 
* Update acceptance-test-config to conform to new schema

* Catch client initialization error in check_connection method

* iterate version
 2023-05-24 11:31:54 -07:00
Sherif A. Nada
63f7fc0f14 Docs: mention custom objects in hubspot docs (#26507) 2023-05-24 10:40:19 -07:00
Emma Forman Ling
360e2f9261 🐛 Update Convex destination connector to fix overwrite sync mode (#26103) 
* auto-generated destination connector template

* add config and health check

* support full_refresh overwrite

* support full refresh overwrite, full refresh append, and incremental append

* write works!

* lint

* update readme

* add test messages

* list destination??

* surface error messages

* add integration test

* add destination docs

* update source docs

* change integration test to unit test

* add check unit test

* use a map for streams

* make compatible with API changes

* add indexes for primary keys

* poll for indexes to be backfilled

* simplified stream API

* support append_dedup sync mode

* cleanup

* add changelog

* fix changelog

* use indexes ready endpoint

* update types

* rename to include primary key in API, handle namespaces

* fix types

* update docs

* add better test cases

* fix docs link

* update API and headers

* fix formatting

* update API name to streaming_import

* improve request exception and add a test for error formatting

* remove secret config

* use /replace_tables endpoint instead of /clear_tables

* partial revert of replace_tables

* fix

* formatting and fix table names

* update docs

* update metadata and dockerfile

---------

Co-authored-by: Lee Danilek <lee@convex.dev>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-05-24 12:12:35 -03:00
Rodi Reich Zilberman
804087a052 Don't convert a string to binary base64 unnecessarily (#25586) 
* Don't convert a string to binary base64 unnecessarily

* update doc

* update doc
 2023-05-24 14:33:20 +00:00
btkcodedev
ec4cf8d37e 🎉Source Stripe: New Stream - Early Fraud Warnings (#22859) 
* feat: New Strea: Early Fraud Warnings

* Fixes formatting errors.

* Updates the number of streams to assert in unit test.

* Fixes error in TestBasicRead::test_read[inputs2] due to early_fraud_warnings stream being empty.'

* rebase to master, fix schema

* fix schema, tests

* add as empty stream, fix sample file

* fix tests, update docs, update version

* add additional_properties

* Update airbyte-integrations/connectors/source-stripe/Dockerfile

Co-authored-by: Augustin <augustin@airbyte.io>

* Resolve conflicts

* Bump version, Resolve comments

* remove incr for stream early_fraud

* fix configured catalogs

* fix unit test

---------

Co-authored-by: Nataly Merezhuk <65251165+natalyjazzviolin@users.noreply.github.com>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-05-24 09:03:11 -03:00
Serhii Chvaliuk
df79780cb8 Source Github: deprecate "page size" input parameter (#25838) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-05-24 12:20:08 +03:00
Joe Reuter
5b5fa23607 adjust documentation (#26036) 2023-05-24 04:36:58 -04:00
Marcos Marx
92cdfc794e ✨ Source auth0: add client stream (#26445) 
* New Stream Clients for Auth0

* remove prints

* Update changelog for 0.2.0

* Update changelog for 0.2.0

* fix docs

* Automated Change

* remove additional eof

* Delete oss_registry.json

---------

Co-authored-by: Vasilis Gavriilidis <vasilis.gavriilidis@orfium.com>
 2023-05-23 22:01:09 -03:00
Daemonxiao
1e1bdac65d TiDB Destination: add append_dedup mode (#19109) 
* TiDB Destination: add append_dedup mode

* update Dockerfile

* update docs and metadata file

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-05-23 15:28:58 -03:00
Daniele Dapuzzo
4e86231e7f 🎉 Source Amazon Seller Partner: enable stream attribute customisation from Source configuration (#22503) 
* feat: add new field and fix tests to accept it

* renamed to advanced_stream_options

* add implementation with test

* feat: add new field and fix tests to accept it

* renamed to advanced_stream_options

* add implementation with test

* update specs

* fix lint errors

* increment Dockerfile version

* Add missing field for spec validation

* add doc and update mtdt

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-05-23 14:40:44 -03:00
btkcodedev
53d66be1ac 🎉Source Twilio: New stream Trunks (#25781) 
* Add new stream trunks

* fix expected records

* bump mtdt file

* add allowed host and bump metadata version

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-05-23 14:34:27 -03:00
btkcodedev
928cc09f0f 🎉Source Twilio: New streams Roles and Services (#25783) 
* Add stream roles and services

* schema fix

* Update docs/integrations/sources/twilio.md

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>

* Update airbyte-integrations/connectors/source-twilio/source_twilio/streams.py

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>

* Bump metadata.yaml

* add expected records

* add chat to allowed hosts

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-05-23 13:41:05 -03:00
Baz
b9d9cafc93 🐛 Source Zendesk-Support: fix empty JSON error (#26414) 2023-05-23 17:28:19 +03:00
igsaf2
c29668715a 🐛 Source Monday: fix pagination for the items stream (#25881) 
* source monday: fix pagination for the items stream

* source monday: refactor item pagination strategy

* source monday: update pagination strategy docstring

* formatting fixes and update version

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-05-23 10:42:10 -03:00