1
0
mirror of synced 2026-01-06 06:04:16 -05:00
Commit Graph

1541 Commits

Author SHA1 Message Date
Evan Tahler
0562e9558c Bump faker to test publication flow (#13298)
* Bump faker to test publication flow

* Add PR link

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 19:19:44 -07:00
Evan Tahler
40d1dc1421 Faker source gains purchases and products (#13248)
* Faker source gains purchases and products

* ranges start at 1

* fix nits

* lint

* user_ids start at 1

* v0.1.3

* fix IDs in test output recods

* auto-bump connector version

* lint

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 16:14:59 -07:00
Yurii Bidiuk
fed651ba7c Source Posgres: [CDC] allow null values for columns (#13016)
* [cdc] source postgres: add optional to schema fields

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 13:45:18 -07:00
Serhii Chvaliuk
c10a268bde 🐛 Source Github: add incremental for WorkflowRuns (#13115)
* add incremental for `workflowruns`

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-27 21:01:28 +03:00
Evan Tahler
e3cb566f79 Bump faker version to test M1 Connector builds (#13235)
* Bump faker version to test M1 Connector builds

* add PR link to changelog

* Remove birhtday, it  doesn't obey seed

* bump readme

* more birthday to remove

* remove image specificity in publish-command

* Set AMI for testing.

* test with including buildx emulators

* auto-bump connector version

* add TODO comment

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-27 10:36:05 -07:00
Amruta Ranade
5aeae3b2e1 update Amazon Ads cloud availability (#13249) 2022-05-26 21:22:17 -04:00
alex-magno
43483b7f93 🎉 New Source: Talkdesk Explore (#10164)
* add source files

* add docs

* update spec params to lowercase

* update should_retry docstring

* add check for failed reports

* format files

* add talkdesk spec

* run format

* run format

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-05-26 15:08:33 -03:00
Pedro S. Lopez
d2aedc7aa2 🐛 Source Intercom: fix conversation_parts stream schema (#13204)
* fix conversation_parts schema

* bump version, update changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-25 18:44:21 -04:00
Topher Lubaway
3a64c25073 Fixes all broken links and enforces no broken (#13152)
* Fixes all broken links and enforces no broken

* Addresses peter's comments

removes unused summary.md: an artifact of gitbook
2022-05-25 15:59:29 -05:00
Amruta Ranade
4a9d9296d2 updated connector catalog based on the May 25 changelog (#13190) 2022-05-25 15:06:22 -04:00
Alexander Tsukanov
5371f87ee6 🐛 Destination Redshift: Fix DATs blind spot - connection check (#13090)
* airbyte-12459: Removed RedshiftDataTmpTableMode.java as not needed enum. Code refactoring and clean-up.

* airbyte-12459: Removed RedshiftDataTmpTableMode.java as not needed enum. Code refactoring and clean-up.

* airbyte-12459: Merged master.

* airbyte-12459: Merged master.

* auto-bump connector version

Co-authored-by: Oleksandr Sheheda <alexandr-shegeda@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-25 19:14:10 +03:00
LiRen Tu
868ed76212 Patch for mssql source cdc update (#13168)
* MSSQL CDC feature to capture only changes option added

* MSSQL CDC feature to capture only changes option added

* added option to disable snapshot 

snapshot isolation setting is hardcode and I modified as user option

* recommitting

* docker version change

docker version change

* resolve conflict

* review 1 added

* review 1 added

* removed extra space

removed extra space

* Update spec.json

* Format java code

* Update doc and version

* Update is-cdc method and add test

* Update spec

* Update doc

* Update snapshot isolation check

* Add helper method to check snapshot level

* Introduce enums

* Format code

* Remove empty constant class

* Update expected spec

* Update spec

* Prevent npe

* Update changelog

* Use a different field name

* Fix missing return statement

Co-authored-by: Sivakumar Ramaswamy <sivakumar.ramaswamy@zip.co>
Co-authored-by: sivankumar86 <sivankumar86@users.noreply.github.com>
Co-authored-by: sivankumar86 <sivankumar86@gmail.com>
2022-05-25 08:06:44 -07:00
sivankumar86
90b757b229 🎉 Source MSSQL: add option to disable initial snapshot and change snapshot isolation level (#12759)
* MSSQL CDC feature to capture only changes option added

* MSSQL CDC feature to capture only changes option added

* added option to disable snapshot 

snapshot isolation setting is hardcode and I modified as user option

* recommitting

* docker version change

docker version change

* resolve conflict

* review 1 added

* review 1 added

* removed extra space

removed extra space
2022-05-25 07:58:39 -07:00
Daniel Diamond
4bfd3293e0 🐛 Source Qualaroo: Fix start_date & custom survey_ids (#13121)
* Fix survey_ids schema, fix epoch time start_date, add stream_slices

* Formatting

* Bump version

* Update tests

* Formatting

* Remove unused imports

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-05-25 15:42:47 +05:30
Roman
46d56fac3e Fix of documentation links (#13164) 2022-05-25 12:59:44 +03:00
RobertoBonnet
15950dfdb2 Source Zendesk Chat: passing timeout in request to prevent a stuck connection (#12883)
* setting a timeout in client side

* upgraded version

* upgraded pendulum lib

* fix spec like docs

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-05-25 15:28:43 +05:30
Daniel Diamond
fb9d2bc450 🐛 Update Survey Monkey Incremental Streams (#13046)
* Update get_updated_state

* Bump Dockerfile version and update docs

* Fix updated_state

* Fix bug in response incremental stream

* Include incremental stream in integration tests configured catalog

* Formatting

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-05-25 15:20:09 +05:30
Denis Davydov
a3f6a1884d #12486 and #49 from alpha-beta-issues fixes (#12914)
* #12486 and #49 from alpha-beta-issues fixes

* test updates for #airbyte/12486 and #alpha-beta-issues/49

* #12486 #49-alpha-beta-issues PR comment fixes

* #12486 doc upd: add note on use of custom queries

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-25 10:13:45 +03:00
Harshith Mullapudi
073bbbccca fix: integration tests are failing for tiktok-marketing (#13127)
* fix: integration tests are failing for tiktok-marketing

* fix: integration tests are failing for tiktok-marketing

* chore: publish new version

* chore: update seed file
2022-05-25 01:38:29 +05:30
Baz
7b0a541040 🎉 Destination Google Sheets: update docs (#13151) 2022-05-24 22:44:23 +03:00
Eugene
d6f4ef4d38 [9964] destination-mqtt: fixed build tests failures (#13099)
* [9964] destination-mqtt: fixed build tests failures
2022-05-24 16:44:20 +03:00
Oleksandr Sheheda
44a43f0338 Improve check connection performance for all JDBC-related DBs (#12820)
* removed redundant read permission check for destination

* bump docker image versions, update definitions and changelog

* bump docker image versions, update definitions and changelog

* update changelog

* fix for MSSQL and Oracle tests

* fix for MSSQL strict encrypt

* fixed conflicts

* revert versions that were not published
2022-05-24 16:06:01 +03:00
Serhii Chvaliuk
4c283d7daa Source Facebook marketing: Fix duplicating records during insights lookback period (#13047)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-23 22:03:12 +03:00
Baz
e56922f09d 🎉 Source Bing Ads: implement OAuth2.0 support, remove redirect_uri, change Account ID to User ID in spec (#12937)
* implemented oauth support

* bumped version

* added changelog

* changed releaseStage to beta

* removed redirect_uri from spec

* removed user_id, customer_id from spec

* fixed invalid_config

* fixed flakeCheck

* fixed broken schema for account stream

* added old config support

* added new unit test to increase test coverage to 91%

* removed unneccessary tests

* formated code

* updated after review

* added oauth implementation java test

* updated spec

* updated after review

* updated docs

* auto-bump connector version

Co-authored-by: Vadym Ratniuk <midavadim@yahoo.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-23 21:22:16 +03:00
Serhii Lazebnyi
643ddfc286 Refactored docs to teamplate (#13033) 2022-05-23 20:29:11 +03:00
Serhii Lazebnyi
3528985b8c 🎉Source Google Search Console: increase unit test coverage at least 90% (#13037)
* Added unitetsts and updated docs

* Fix typo

* Increased to 90
2022-05-23 20:04:43 +03:00
Zawar Khan
120f118271 End date configuration for tiktok (#12838)
* added end date configuration.

* restore and added stream_test in unit test

* updated spec.json

* updated with master

* spec.json updated

* updated streams_test.py

* updated spec.json with new end date

* updated in unit test file

* stream test updated

* fix: formatting and spec

* chore: updated the source-pipedrive version

* fix: formatting and spec

* fix: formatting and spec

* fix: formatting and spec

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-05-23 22:19:35 +05:30
Baz
f791295b29 🐛 Source Amplitude: time offset causes a lot of duplicates (#13074) 2022-05-23 18:45:22 +03:00
Daniel Diamond
153b26464b 🐛 Source Qualaroo: Update Spec (#13042)
* Update spec

* Update object null spec

* Bump Dockerfile version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-23 08:42:19 -04:00
mcn
bbfc949bc5 Source Amazon Seller Partner: Add GET_XML_BROWSE_TREE_DATA report (#12663) 2022-05-23 13:51:54 +02:00
Harshith Mullapudi
92c0530289 Harshith/test pr 12806 (#13082)
* 🐛 Source(Pipedrive): remove date-time format from schemas

Pipedrive doesn't work with ISO format of date times. Example of format by Pipedrive: 2020-04-15 12:58:48

* chore: update changelog

* chore: updated the source-pipedrive version

* chore: update seed file

Co-authored-by: Joël Luijmes <me@joell.dev>
2022-05-23 16:31:09 +05:30
Serhii Lazebnyi
91326749d9 🎉Source Amazon S3: increase unit test coverage at least 90% (#11967)
* Increased unittest coverage

* #11676 test coverage 85%

* #11676 unit tests 90%

* #11676 two more unit tests

* #11676 bump version

* auto-bump connector version

Co-authored-by: Denys Davydov <denys.i.davydov@globallogic.com>
Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-23 13:37:27 +03:00
Harshith Mullapudi
34cd942530 Harshith/test pr 12280 (#13079)
* full stream coverage

* update integration tests with new streams

* fix: tests

* chore: updated the source-typeform version

* chore: updated the source-typeform version

* chore: update seed file

Co-authored-by: itaseski <ivica.taseski94@gmail.com>
2022-05-23 16:01:45 +05:30
Pedro Calleja
a1b1c1cb8c source-amazon-seller-partner: read the rate limit for retry waiting time in Orders stream (#12946) 2022-05-20 16:31:29 -04:00
Tuhai Maksym
70d48fa874 Destination-S3: Remove configurable part size (#13043)
* Destination-S3: Remove configurable part size

* Changelog updated

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-20 22:48:55 +03:00
Adam
9e31d026c8 Destination Redshift: Fixed maximum record size for SUPER type (#12940)
* fix #12680: use correct max size for SUPER type

* address review comments

* docs: add changelog entry

* bump version

* test: make large record actually too big

* fix: use a method instead of member variable for correct override

* fix: if overall object is invalid, don't check individual elements

* feat: add unit test for isValidData

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-20 10:32:21 -04:00
Baz
bb139ecc00 🐛 Source Zendesk-Support: fixed ticket_audits stream schema + fixed broken unit_test (#13055) 2022-05-20 17:13:55 +03:00
Niccolo Salvini
1c94cebafe Update smartsheets.md (#13050)
fixed typo
2022-05-20 10:11:51 -04:00
Erica Struthers
e542a4bd73 Update README.md (#12891) 2022-05-19 11:43:06 -04:00
Chun-Sheng, Li
2c409ffaad Docs: Remove useless column (#13013) 2022-05-19 11:29:18 -04:00
Serhii Chvaliuk
735b51ba8c Source Facebook Marketing - Update CDK to v0.1.58 avoid crashing on incorrect stream schemas (#13008)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-19 10:52:36 +03:00
Evan Tahler
a5f1366363 Quote and comma-separate Pokemon examples to clarify help text (#12942)
* Quote and comma-separate Pokemon examples to clarify help text

Closes #12792

* Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-18 16:59:45 -07:00
LiRen Tu
5ddef8639a 📝 Databricks destination: clarify server hostname in the doc (#12943) 2022-05-17 20:37:07 -07:00
Mohit Reddy
58f20c455b Destination Kafka: Allow configuring PLAIN SASL (#12876)
* airbyte: Allow configuring PLAIN SASL mechanism for Kafka dest connector through WebApp

* bump up the version of kafka dest connector

* bump up the image tag for kafka destination connector in defs

* update _specs for kafka destination connector to match defs; SeedConnectorSpecs did not update it automatically
2022-05-17 12:27:52 -04:00
Eugene
c85e131d92 🎉Source-postgres: added custom JDBC parameters (jdbc_url_params) field (#12840)
* [10729] source-postgres: added custom JDBC parameters field
2022-05-17 15:51:13 +03:00
LiRen Tu
d6f8c2627b 📝 Update bigquery doc about hmac key troubleshooting (#12895) 2022-05-16 15:37:07 -07:00
LiRen Tu
7c35b03595 🎉 Databricks destination: use new jdbc driver and open source the connector (#12861)
* Migrate to public databricks jdbc driver

* Update documentation

* Bump version

* Format code

* Check in databricks in seed file

* Check in databricks 0.2.0

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-16 14:48:52 -07:00
VitaliiMaltsev
4804f746dc Destination Redshift fixed NPE in S3 staging (#12869)
* Destination Snowflake fixed npe in S3 staging

* removed star imports

* updated changelog

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-16 16:37:28 +03:00
LiRen Tu
e00f487d98 📝 Destination bigquery: mark service account as required for cloud (#12768)
* Update spec

* Update doc

* Bump version and update changelog

* Modify wording

* Add sample service account key json

* Add screenshots and common permission issues

* Refactor service account helper method

* Update log message

* Update version date in changelog

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-15 01:28:36 -07:00
Serhii Chvaliuk
8c394b3734 🐛 Source Github: add incremental for repositories, workflows, pull_request_comment_reactions, issue_reactions, issue_comment_reactions, commit_comment_reactions (#12294)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-13 21:18:24 +03:00