1
0
mirror of synced 2026-01-04 09:04:47 -05:00
Commit Graph

2841 Commits

Author SHA1 Message Date
Dick Tang
7696b30f1c 📝 Source Google Search Console: update documentation (#22295)
* update docs for Google Search Console integration

* update connector version

* bump connector version to 0.1.22

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-21 09:44:48 -03:00
Baz
775f203e0c 🎉 Source YoutubeAnalyticsBusiness Demo: remove the source-youtube-analytics-business from OSS part 2/3 (#24148) 2023-03-21 13:10:59 +02:00
Denys Davydov
6c434c885e Source zendesk support: validate datetime on check (#24252)
* #1683 source zendesk support: validate datetime on check

* #1683 source zendesk support: upd changelog

* Automated Change

* rm extra files

* auto-bump connector version

---------

Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-21 10:48:07 +02:00
Yevhen Sukhomud
7ae1de24af Destination Databricks: Support managed tables (#23965)
* 23036 Destination Databricks: support managed tables

* 23036 Destination Databricks: Update Databricks version to 1.0.0

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-21 10:51:08 +07:00
Praty Sharma
0cf36ed5d3 Source Slack: Increase page_size/limit param for API calls (#24126)
* Update page size for slack requests to 999

Slack APIs are heavily rate limited, and this minor change improves the performance of this connector by 10x with no impact to quality.

* update page_size limit to 1000

* bump connector version

* auto-bump connector version

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 21:09:04 -03:00
Artem Inzhyyants
6f98a68e28 Source Yandex Metrica: certify to beta (#24188)
* Source Yandex: http -> https

* Source Yandex: fix schema

* Source Yandex: bump to latest version

* Source Yandex: Ref Clean Job

* Source Yandex: Ref

* Source Yandex: update schemas; ref

* Source Yandex: refactor

* Source Yandex: refactor; add tests

* Source Yandex: bump version; update setup; update docs

* Source Yandex Metrica: fix tests

* Source Yandex Metrica: add allowed hosts; change releaseStage

* Source Yandex Metrica: fix docs

* Source Yandex Metrica: fix docs

* Automated Change

* Source Yandex Metrica: update docs

* Source Yandex Metrica: update docs

* Source Yandex Metrica: add expected_records for views stream

* auto-bump connector version

* Automated Commit - Formatting Changes

* Source Yandex Metrica: empty commit

---------

Co-authored-by: artem1205 <artem1205@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 21:26:21 +01:00
Serhii Chvaliuk
b588a52bbd Source Xero: Certify to Beta (#24217)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-03-20 21:28:43 +02:00
Brandon Beidel
db388a5cea Docs: update twitter.md (#24241)
fix spelling errors; documentation
2023-03-20 14:19:08 -03:00
Daryna Ishchenko
edf5b19ef1 Source Instagram: decrease give up rate (#23671)
* updated spec and added more specific error message

* added change log

* refactored error handling

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 17:19:36 +02:00
Koji Matsumoto
73eb77f2a5 🎉 New Source: Firebase Realtime Database (#18029)
* implement check for source-firebase-realtime-database

* implement discover

* support only one stream

* implement read and tests

* add docs

* remove unnecessary file

* add pr number

* fix sat

* add bootstrap.md

* add badge in builds.md

* fix acceptance.py

* add supported_sync_modes in configured_catalog

* add database_name description and example

* add info about required role for service account

* remove abnormal_state.json

* fill catalog.json with values for testing

* loosen requirements

* Update Dockerfile

* auto-bump connector version

* readd firebase to seed file

* fix build gradle for firebase

---------

Co-authored-by: Tuan Nguyen <anhtuan.nguyen@me.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-03-20 11:42:02 -03:00
VitaliiMaltsev
e5f96a3678 MySQL Source : support different table structure during "DESCRIBE" query (#24147)
* MySQL Source : support different table structure during "DESCRIBE" query

* bump version

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 14:28:29 +00:00
Arsen Losenko
508de0fb9c Source Github: Mark datefields in spec as dates (#22993)
* Source Github: Mark datefields in spec as dates

* Update changelog

* Update Dockerfile

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 16:21:23 +02:00
Arsen Losenko
550fe10591 Source Google Search Console: Mark datefields in spec as dates (#22984)
* Source Google Search Console: Mark datefields in spec as dates

* Update changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 16:20:24 +02:00
Artem Inzhyyants
4eb896bf0c Source Airtable: make stream name unique; add id to names (#22704)
* Source Airtable: make stream name unique; add id to names

* Source Airtable: update docs

* Source Airtable: fix test

* Source Airtable: fix test

* Source Airtable: update version

* Source Airtable: update version

* Source Airtable: disable backward_compatibility_tests

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 14:08:26 +01:00
Arsen Losenko
27de42eff6 Source Google Ads: Mark datefields in spec as dates (#22985)
* Source Google Ads: Mark datefields in spec as dates

* Update changelog

* Update Dockerfile

* Update Dockerfile

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 15:05:19 +02:00
Joe Reuter
0d93fff47f Fix spec orders for yugabyte, sftp-bulk, gnews (#24180)
* fix spec orders

* Update yugabytedb.md

* Update gnews.md

* Update yugabytedb.md

* Update gnews.md

* Update sftp-bulk.md

* auto-bump connector version

* Update seed file

* fix gnews

* rollback gnews changes

* remove accidental commit

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-20 10:35:51 +01:00
midavadim
f2ba0873f3 🎉 Source ZohoCRM - enable in cloud (#23906)
* Fixed authentication to support latest CDK, fixed SAT, updated expected record, enabled high strictness

* updated docs and connector version

* updated format of abnormal state

* updated version is seed

* merged

* updated connector version

* fixed SAT

* fixed SAT

* added empty streams

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-19 23:24:50 +02:00
Lake Mossman
2d3c48da8d Revert "Simplify postgres and GitHub forms (#24127)" (#24219)
This reverts commit fcc80cb5be.
2023-03-18 19:22:38 -07:00
Eugene
c4fbc8c9a5 S3-Parquet: added handler to process null values in arrays (#23788)
* [22807] Parquet - added handler to null values in arrays
2023-03-18 08:52:37 +00:00
Lake Mossman
fcc80cb5be Simplify postgres and GitHub forms (#24127)
* add grouping and collapsing fields to postgres source

* add auth group to github source connector

* revert postgres field order changes and adjust group of schemas field

* inject group into ssh tunnel spec for postgres only, through overloaded methods

* Automated Change

* bump Dockerfile versions and update changelogs

* bump strict encrypt version as well

* fix postgres acceptance test

* fix acceptance test again

---------

Co-authored-by: lmossman <lmossman@users.noreply.github.com>
2023-03-17 23:02:03 +00:00
Baz
c3247d3f7c 🐛 Source Freshsales: update CAT before Enable in Cloud (#24155) 2023-03-17 23:23:36 +02:00
Serhii Chvaliuk
f06be037a5 Source Trello: Certify to Beta (#24141)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-03-17 20:47:50 +02:00
Denys Davydov
6a88625cca Source s3: fix datetime conversion (#24178)
* #1669 source s3: fix datetime conversion

* #1669 source s3: review fixes

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-17 20:14:08 +02:00
Nikolay Shebanov
3b0a710d25 Update the warning on stripe full-refresh-overwrite (#21007)
This commit fixes the warning message in the stripe source doc. The previous message wasn't specific enough and could be interpreted as if all the data older than 30 days will be deleted.

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-03-17 15:04:27 -03:00
sandip-baidya
d4d9f569f6 Updated Braintree connector docs (#21447)
* Updated Braintree connector docs

Hi,
Followed Amruta's youTube video's reference to edit Braintree's connector docs. This is my first open source contribution!
1. Added prerequisites section
2. consistent header sizes
3. Added set up guide (similar to freshdesk and greenhouse)

Following are some of the areas I did not touch because there was ambiguity there and I did not want to change anything around because of my limited knowledge of both Airbyte and Braintree:-
1. The sentence "creating read-only key specifically for Airbyte access" could do well with specifying what key are we talking about exactly because there are two keys; public and private and I couldn't really find that out on my own either from google. (So, perhaps someone can edit that in the future)
2. Sync Overview (I was not sure about whether all 4 kinds of syncs are being supported for braintree from what was originally written in the docs, so I let the original sentence be as is; did not modify it one bit)
3. Data type mapping (Again, I was not sure what data mapping truly meant here, so I let it be, as is)

Thanks.

* Incorporated the suggested changes

---------

Co-authored-by: sandip <sandip@FC-IN-FVFJ3M5FQ6LR.local>
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
2023-03-17 14:55:48 -03:00
Julian
3e81c9b306 Docs: Information to setup source GA4 #21670 (#22416)
* Added: Information to setup source #21670

* Changed: Added PR number to changelog entry

* Removed: Version bump as per change request

* Update google-analytics-v4.md

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-03-17 14:54:17 -03:00
Leo Schick
325599bd2a fix trustpilot changelog date #24009 (#24189) 2023-03-17 14:41:37 -03:00
Denys Davydov
29587dc623 Source stripe: safe get customer's attributes (#24179)
* #1663 source stripe: safe get customer's attributes

* #1663 source stripe: upd changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-17 16:21:08 +02:00
Carlo Nuccio
f9f57ac421 🎉 Source Facebook Marketing: Added level into custom ads insights (#19141)
* Source Facebook Marketing - Added Level to Custom Ads Insights

* Added Row to changelog

* added level to integration tests

* edited spec.json

* edited to array

* added TODO in spec.py

* converted to type=string with pattern

* removed Literal from import

* Level with type string and enum list

* delete unused LEVEL_PATTERN

* deleted todo

* deleted level variable

* bump connector version

* solve conflict in doc

* auto-bump connector version

---------

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-17 10:24:57 -03:00
Denys Davydov
db45f05814 Source S3: fix discovery issues (#24157)
* #1652 #1664 Source S3: fix discovery issues

* #1652 #1664 source s3: upd changelog

* #1652 #1664 source s3: review comments

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 22:39:29 +02:00
Leo Schick
a36dc23bac 🎉 New Source: Trustpilot (#24009)
* add source Trustpilot

* add airbyte_secret to `client_secret` config

* add primary key to BusinessUnits, refactor state_cursor_field naming

* refactoring, various fixes, integration tests passed

* improve code

* fix incremental unit test

* fix class naming

* fix unit tests

* fix pflake8 issues

* add source spec into seed file

* auto-bump connector version

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 16:43:48 -03:00
Marcos Marx
0391c0bcb6 🐛 🚨🚨 Source LinkedIn Pages: fixed failing connection checks (#24161)
* fixed issue with the org id not being an integer and deleted duplicate streams

* bumped version to 0.1.1

* Update source_definitions.yaml

* Update acceptance-test-config.yml

* Update linkedin-pages.md

* black formatting for python

* fix tests

* update acceptance test file

* change break spec - backward compt.

* fix changelog

* auto-bump connector version

---------

Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
Co-authored-by: Vincent Koc <25068+koconder@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 16:43:22 -03:00
Artem Inzhyyants
326387b69c 🐛 Source Onesignal: Update connectors spec; fix incremental sync (#24076)
* Source Onesignal: Update connectors spec; fix incremental sync

* Source Onesignal: Update connectors spec; fix incremental sync

* Source Onesignal: fix unit tests

* Source Onesignal: fix tests

* Source Onesignal: update config

* Source Onesignal: update schemas

* Source Onesignal: add order

* Source Onesignal: update docs

* Source Onesignal: bump version

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 20:03:27 +01:00
Marcelo Castro
60322fa0c4 🐛 Source Microsoft Dataverse: Fixed deduped not working correctly (#22805)
* Fixed dedupeot working correctly

Due to delete only containing id, the deduped dbt could not work
properly, so we also fill the cursor field with the current date
so it does have a properly end

* bump connector version

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-03-16 16:01:29 -03:00
Oliver Meyer
5975c323d8 🐛 Source S3: fix datetime format string in FileStream (#23195)
* Fix datetime format string in FileStream

* Update changelog

* Fix integration tests

* Localize datetime objects

* Bump Dockerfile version

* auto-bump connector version

---------

Co-authored-by: Nataly Merezhuk <65251165+natalyjazzviolin@users.noreply.github.com>
Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 11:40:31 -07:00
Arsen Losenko
13bdee013b Source Salesforce: update regex pattern, specify format to date-time (#24071)
* Source Salesforce: remove regex pattern, specify format to date-time

* Update changelog

* Automated Change

* Add updated regex pattern for additional validation

* Automated Change

* auto-bump connector version

---------

Co-authored-by: arsenlosenko <arsenlosenko@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 17:38:03 +02:00
Arsen Losenko
417304f4e9 Destination Typesense: add icon, prepare for Cloud (#24139)
* Destination Typesense: add icon

* Update docs

* Automated Change

---------

Co-authored-by: arsenlosenko <arsenlosenko@users.noreply.github.com>
2023-03-16 17:02:16 +02:00
Artem Inzhyyants
3e812513b0 Source Google Analytics v4: certify to GA (#23872)
* Source Google Analytics v4: check custom reports; remove date as required field

* Source Google Analytics: fix unit tests

* Source Google Analytics: fix unit tests

* Source Google Analytics: update to latest cdk

* Source Google Analytics: http -> https

* Source Google Analytics: add allowed hosts

* Source Google Analytics: docs update

* Apply suggestions from code review

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Source Google Analytics: docs update

* Source Google Analytics: add expected records

* auto-bump connector version

---------

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 15:41:29 +01:00
Serhii Chvaliuk
62757c9d4f Source Xero: Enable in Cloud (#24005)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-03-16 14:09:28 +02:00
Daryna Ishchenko
a1da244d3c Source Paystack: enable in cloud (#24085)
* made needed changes for enabling in cloud

* added changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 13:45:19 +02:00
Denys Davydov
cd16cc8cf5 #1526 source google search console: update docs (#24133) 2023-03-16 13:03:34 +02:00
Denys Davydov
d534751ce7 Source Salesloft: certify to beta (#23937)
* #19217 Source Salesloft: certify to beta

* #19217 source salesloft: update docs

* #19217 source salesloft: upd changelog

* #19217 source salesloft: upd expected records

* #19217 source salesloft: upd expected records

* #19217 source salesloft: upd expected records

* #19217 source salesloft: upd CAT config

* #19217 source salesloft: fix CAT config

* #19217 source salesloft: remove advanced_oauth

* Automated Change

* auto-bump connector version

---------

Co-authored-by: davydov-d <davydov-d@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 12:03:28 +02:00
Adam Schmidt
98f0080b2a 🎉 New Source: OpsGenie [python cdk] (#16768)
* feat: Opsgenie connector

* fix: PR feedback

* Update acceptance-test-config.yml

* chore: patch tests

* chore: added empty_streams

* Delete .dccache

* Update setup.py

* task: fix up unittests

* Update acceptance-test-config.yml

* Update acceptance-test-config.yml

* Update source_definitions.yaml

* Update source_specs.yaml

* run config seed

---------

Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
Co-authored-by: Vincent Koc <koconder@gmail.com>
Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Sunny <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-03-16 01:42:09 +00:00
Zaza Javakhishvili
1119e6dc8c 🎉 Source Amazon Seller Partner - add Belgium marketplace (#24098)
* amazon spadd belgium marketplace

* amazon spadd belgium marketplace

* amazon spadd belgium marketplace

* fix unit test spec

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-15 22:18:47 -03:00
Duy Nguyen
2e85c94c74 #23949 Remove check() from read() method for sources Cockroach DB and Postgres (#24000)
* Removed extraneous read on the check() method for CockroachDB and Postgres
* Bumped dockerfile version for relevant conenctors
* Bumped versions for strick-encrypt tests
* Removed withoutPublication and withoutReplicationSlot tests for postgres cdc
* Automated Change
* Updated sources docs
* Update incorrect year in change logs doc for Cockroach and Postgres
* Removed read override method from cockroachDB
* Removed read method override for source-postgres
* auto-bump connector version

---------

Co-authored-by: nguyenaiden <nguyenaiden@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-15 23:23:36 +00:00
John Aitchison
6bc96b514e Source Intercom: extend Contacts schema with opted_out_subscription_types (#22095)
* new contacts prop, opted_out_subscription_types

* bump intercom version

* update changelog

* fix typo in changelog

* update connectors.md

---------

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-03-15 17:44:20 -03:00
VitaliiMaltsev
9e94126fd6 MySQL/MsSQL sources fixed NPE during cursor values validation (#24082)
* MySQL/MsSQL sources  fixed NPE during cursor values validation

* added logging

* bump versions

* auto-bump connector version

* manually update mssql definitions

* Automated Change

* Automated Commit - Formatting Changes

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: VitaliiMaltsev <VitaliiMaltsev@users.noreply.github.com>
2023-03-15 19:27:31 +00:00
Marcos Marx
133077797d Source Mailchimp - Add Reports stream #23464 (#24112)
* init commit

* update doc

* add reports stream

* Bump mailchimps connector docker image

* fix tests

* update abnormal stream state for report mailchimp

* add mailchimp allowedHosts

* run config seed files

---------

Co-authored-by: Haithem Souala <haithem.souala@melting-point.fr>
Co-authored-by: Haithem Souala <haithem.souala@woopit.fr>
2023-03-15 16:27:19 -03:00
Denys Davydov
3a63e66e42 Source Airtable: update spec and doc (#24093)
* #1651 source airtable: update spec and doc

* #1651 source airtable: upd changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-15 21:19:24 +02:00
Sophia Wiley
b19998eeb7 edited links in docs (#24108) 2023-03-15 19:57:54 +01:00