1
0
mirror of synced 2026-01-26 04:01:39 -05:00
Commit Graph

2043 Commits

Author SHA1 Message Date
Denys Davydov
6ea207d297 #17506 source snapchat marketing: retry failed request for refreshing access token (#17596)
* #17506 source snapchat marketing: improve error msg

* #17506 source snapchat marketing: improve error msg

* #17506 source snapchat-marketing: use CDK authenticator because the custom one is buggy

* #17506 source snapchat-marketing: retry 429 and 5xx when refreshing access token

* #17506 debug

* #17506 reformat code

* #17506 source snapchat: change max_tries to max_time

* #17506 rm debug code

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-07 14:53:19 +03:00
VitaliiMaltsev
84f02995ba MongoDb Source: Increase performance of discover (#17614)
* MongoDb Source: Increase performance of discover

* bump version

* fixed tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-07 14:18:29 +03:00
Liren Tu
bd5fb351ea 📝 Postgres source: document occasional full refresh under cdc mode (#17705)
* Update postgres doc about full refresh in cdc mode

* Update format
2022-10-06 15:26:05 -07:00
Marcos Marx
53f68f4666 Source Bamboo-HR: change Name to name as returned from the API (#17684)
* change Name to name as returned from the API

* udpate doc

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-06 16:08:49 -03:00
Akash Kulkarni
4b990d0797 🚨 Add ability to enforce SSL in MongoDB source connector (#17590)
* Check and test for if we are disabling SSL/TLS in source-mongodb-strict-encrypt

* Update docs

* Address comments

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-06 11:57:36 -07:00
Artem Inzhyyants
00d1f0d9e1 Source Iterable: Add permission check for stream (#17602)
* Source Iterable: Add permission check for stream

* Source Iterable: docs update

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-06 12:52:57 +02:00
Amruta Ranade
4c7002ec05 Updated GA4 status 2022-10-05 15:52:10 -04:00
Arsen Losenko
99cdb405bb Source Recharge: skip stream if 403 received (#17608)
* Source Recharge: skip stream if 403 received

* Refactor should_retry method

* Add logging message for clarity

* Update changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-05 20:26:53 +03:00
Denys Davydov
5ba79894f2 Source Iterable: use optional end_date for SATs (#17573)
* #17506 source iterable: use optional end_date for SATs

* source iterable: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-05 09:20:08 +03:00
Serhii Chvaliuk
8b4f65de9e Source Github: Skip repository if got HTTP 500 for WorkflowRuns stream (#17555)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-04 21:50:20 +03:00
Denys Davydov
60628608f1 Source Slack, Source Tiktok-marketing - fix builds (#17557)
* #17506 Source Slack, Source Tiktok-marketing - fix builds

* source tiktok marketing: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-04 21:07:13 +03:00
Serhii Chvaliuk
f8987a0f2c Source Facebook Marketing: Add cursor_field for custom_insights stream schema (#17551)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-04 20:29:39 +03:00
Roman Yermilov [GL]
5568dd60ad Source paypal transaction typeerror (#17554)
* Source Paypal Transaction: fix source config accordion to specification

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-04 20:01:49 +04:00
Artem Inzhyyants
7126f8ab14 Source Iterable: Docs update (prerequisites and setup) (#17533) 2022-10-04 14:16:37 +02:00
Rodi Reich Zilberman
d8b0563723 Match entry in client cert keystore to hardcoded postgres driver value (#17515)
* Match entry in client cert keystore to hardcoded postgres driver value

* Match entry in client cert keystore to hardcoded postgres driver value

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-03 19:02:38 -07:00
Ryan Fu
7a7091e2dc Updated s3.md changelog to include changes for enforcing TLS (#17545) 2022-10-03 17:54:52 -07:00
Serhii Lazebnyi
06186d2596 🐛Source Hubspot: Fixed 403 error validation (#16914)
* Fixed 403 error validation

* Updated PR number

* Updated after review

* Updated after review

* Updated version

* Add ignoredd fields

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-04 01:07:36 +02:00
Serhii Lazebnyi
f94185efc9 🐛Source Amplitude: fix start date validation (#17320)
* Fix start date validation

* Add unittests

* Updated to review

* Delteed print

* Updated version

* Updated version

* Updated to SAT

* Updated to unittest

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-04 01:00:06 +02:00
Amruta Ranade
14f778ce50 fixed link 2022-10-03 18:34:31 -04:00
Yowan Ramchoreeter
dc605889a6 Added note about OAuth (#17405)
Adding this note to get help from the community to solve OAuth issues with this connector
2022-10-03 14:03:48 -07:00
Ryan Fu
1d956df434 🚨 Add SSL documentation and check logic for S3 Destination 🚨 (#17340)
* Adds logic to fail upon non-deterministic custom S3 endpoint and documentation for insecure settings

* Reused config factory settings to a single static variable

* Updated error message and example in the spec.json to match expectation of secured endpoint

* Added validation check within the base s3

* Integrated AdaptiveDestinationRunner with S3Destination

* Reduced visibility for testing and fixed AdaptiveDestinationRunner issue

* Adds speicifc secure protocol with S3 and empty endpoint check

* Bumps docker version and adds comments and clearer string methods

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-03 13:56:58 -07:00
Akash Kulkarni
bb6dff5749 🎉 MySQL Source : Make initial cdc timeout configurable for MySQL source (#17170)
- Implement logic + update spec
- Fix tests
- Bump dockerfile

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-03 13:49:56 -07:00
Amalia Advincula-Roye
7319762416 Add workspace ownership requirement (#17418) 2022-10-03 12:40:04 -04:00
Amalia Advincula-Roye
7b4b3782c1 Update IP list to require all to be whitelisted (#17288) 2022-10-03 12:37:39 -04:00
Sunny
0b8997a5c5 Update Google Analytics V4 doc (#17254)
Role names appear to have changed, instead of Read & Analyze the role is now called Viewer
2022-10-03 12:37:28 -04:00
Sophia Wiley
5aa48559cb Small formatting change to Bing Ads doc (#17471)
I was looking at this doc again and I realized that "The Bing Ads source connector supports the following streams. For more information, see the [Bing Ads API](https://docs.microsoft.com/en-us/advertising/guides/?view=bingads-13)." should go underneath ##Supported streams.
2022-10-03 09:27:28 -07:00
Baz
8c4b61c13b 🐛 Source File: add data presence validation for HTTPS for check_connection (#17504) 2022-10-03 18:44:56 +03:00
Serhii Chvaliuk
c1884d6d51 Source Bing Ads: Fix: limit cache size for ServiceClient (#17505)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-03 18:26:57 +03:00
roisinbolt
8afaaaac21 Source bigcommerce: add channel and store stream (#16647)
* add bigcommerce channels stream

* add bigcommerce store stream

* update bigcommerce store.json

* remove logger from testing

* update dockerimagetag

* add store url

* update catalog

* resolve test_core integration test

* update store abnormal_state

* remove full refresh store stream from integration test state jsons

* Update source_definitions.yaml

* Update source_specs.yaml

* fix: bigcommerce unit tests

* Update sample_state.json

* fixed all the schemas and unit tests

* auto-bump connector version [ci skip]

Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-03 10:27:52 -04:00
Ganpat Agarwal
454f84d3ed 🎉 Source Amazon Ads : Add attribution reports (#16342)
* use data field for json response

* add attribution reports

* update changelog

* add atrribution report integration test

* clean up expected_records
add empty streams to acceptance test config

* handle exception for profile

* update tests

Co-authored-by: Yiyang Li <yiyangli2010@gmail.com>
Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
2022-10-03 10:24:33 -04:00
Simon Späti
8a74d39ac3 📖 Removing existing Glossary of Terms and link to new Data Glossary (#17313) 2022-10-03 12:37:34 +02:00
Augustin
3c8cf78382 source-sentry: migrate to per-stream states (#17466) 2022-10-03 08:23:26 +02:00
Greg Solovyev
5f25d2d069 Greg/clickhouse polishing (#17483)
* add icon for clickhouse in destination folder

* use http port only in clickhouse

* declare driver: http for dbt explicitly

* bump destination clickhouse version

Co-authored-by: restrry <restrry@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-01 12:40:19 -07:00
Subodh Kant Chaturvedi
0c1823d9aa upgrade debezium version to 1.9.6 (#17459)
* upgrade debezium version to 1.9.6

* test override not required

* bump version

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-01 15:08:42 +05:30
Artem Inzhyyants
aaa94f1cbc 🐛 Source Twilio: Lookback_window config (#17478)
* 🐛 Source Twilio: Lookback_window config

* 🐛 Source Twilio: update docs

* 🐛 Source Twilio: update specs

* 🐛 Source Twilio: test fix backward compatibility

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-01 01:07:33 +02:00
Artem Inzhyyants
5edf4ce8a0 🐛 Source Salesforce: filter out objects not supported by the Bulk API (#17453)
* 🐛 Source Salesforce: filter out objects not supported by the Bulk API

* 🐛 Source Salesforce: Docs update & Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-30 21:30:48 +02:00
Denys Davydov
6f1736133f Source Marketo: certify GA (#17445)
* Source Marketo: certify GA

* source marketo: upd changelog

* auto-bump connector version [ci skip]

* #238 source marketo: do not use temp files to optimize memory consumption

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-30 22:14:06 +03:00
Nataly Merezhuk
7bc911ef2a 📖 Removes $ from terminal commands to allow direct copying. (#17467)
* Removes $ from terminal commands to allow direct copying.

* Fixes build by adding missing link.
2022-09-30 11:54:50 -04:00
Augustin
7ab162a869 migrate source GA connectors to per-stream states (2) (#17410) 2022-09-30 16:44:11 +02:00
Pedro S. Lopez
1dc1d54210 Source Klaviyo: bump CDK dependency (#17422) 2022-09-30 10:32:33 -04:00
Arsen Losenko
6c94e30bd9 Source Pinterest: Set start_date dynamically based on API restrictions for lookup (#17387)
* Set start_date dynamically based on API restrictions for lookup

* Update changelog and bump connector version

* Parse start_date from config

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-30 16:55:15 +03:00
Serhii Chvaliuk
a338df1040 🐛 Source Github: bugfix WorkflowJobs stream (#17287)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-30 14:45:25 +03:00
Serhii Chvaliuk
f0f60dcebf Source Mixpanel: disable stream "cohort_members" on discover if no access (#17415)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-30 11:17:00 +03:00
Serhii Chvaliuk
434833cad2 Source Bing Ads: Fix: limit cache size for ReportingServiceManager instances (#17403)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-29 23:52:05 +03:00
Denys Davydov
03b93b787c Source Google Ads: install latest CDK version (#17412) 2022-09-29 21:33:39 +02:00
Augustin
99955ce248 source-bing-ads: migrate to per-stream state (#17386) 2022-09-29 21:03:31 +02:00
Baz
e6c2cb7e13 🐛 Source YouTube Analytics: fix check_connection 403 error (#17399) 2022-09-29 21:23:04 +03:00
Greg Solovyev
da5df45afe Spec and doc fixes to prepare MySQL Source for Beta (#17164)
* Fix URL of MySqlSourceDatatypeTest.java

* Fix naming of JDBC URL parameters field to match Postgres

* Fix a typo in JDBC params description

* Bump version to 1.0.0 for beta

* replace e.g. with example

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-29 10:17:59 -07:00
Serhii Chvaliuk
7271bcaeed Source Facebook Marketing: CustomConversions enable_deleted=False (#17371)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-29 19:25:04 +03:00
midavadim
034b922938 🎉 Source zendesk talk to ga (#17362)
* use the latest cdk version, changes order in spec params

* updated doc, bumped connector version

* updated version in source_definitions.yaml

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-29 18:07:48 +03:00