1
0
mirror of synced 2026-01-16 18:06:29 -05:00
Commit Graph

3508 Commits

Author SHA1 Message Date
Ryan Fu
8c780bd3aa Publishes Postgres, MySQL, MSSQL source with changes from #18041 (#18086)
* Publishes Postgres, MySQL, MSSQL source with changes from #18041

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 21:53:30 -07:00
Delena Malan
3b12a585ec Docs: Fix backoff stategy docs (#18143)
* Fix backoff strategy docs

* Update config_component_schema.json
2022-10-18 16:28:38 -07:00
Zachary Heller
d9a48c9449 🐛 Destination GCS: Fix error logs to log 'Gcs' rather than 'AWS' (#17901)
* Fix error logs to log 'Gcs' rather than 'AWS'

* update connector version

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 20:21:37 -03:00
Yowan Ramchoreeter
d016ef11c9 doc_update_oath_issue_gsc (#17967)
* doc_update_oath_issue_gsc

We are currently blocked on some GCS OAuth workflows and we are adding a note to inform our customers.

* Updated wording

* Fixed wording for this connector

Approved and good to go
2022-10-18 14:26:07 -04:00
Marcos Marx
70dd9a85cf 🎉 Source Zendesk Chat: engagements data fix infinity looping + gradlew format (#18121)
* fix infinity looping in chats

* added more meaninful to variable name

* bump docker version

* auto-bump connector version

* run format

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 15:14:02 -03:00
JC (Jonathan Chen)
7cb01a76e6 docs: clarify language (#18090) 2022-10-18 12:08:43 -04:00
Augustin
4db2364a67 source-e2e-test: update changelog with 0.1.2 (#18108) 2022-10-18 17:40:39 +02:00
Tyler B
40896d00c0 Re-direct Postgres guide to active page, current link is 404'd (#18103)
The current  "Refer to this guide..." link goes to a 404 page on postgres. The new link i put in is the equivalent of the old site. It can be compared using the wayback machine: https://web.archive.org/web/20220121223117/https://jdbc.postgresql.org/documentation/head/connect.html
2022-10-18 10:47:39 -04:00
Denys Davydov
475df69a66 Source facebook-marketing: remove pixel from custom conversions stream (#18045)
* #744 source facebook-marketing: rm pixel from custom conversions stream

* #744 source fb marketing: upd changelog

* #744 source facebook-marketing - add custom_conversions to the test catalog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 13:22:41 +03:00
Artem Inzhyyants
fc8be13d33 🎉 Source Shopify: Add metafield streams (#17962)
* 🎉 Source Shopify: Add metafield streams

* Source Shopify: fix unittest

* Source Shopify: docs update

* Source Shopify: fix backward compatibility test

* Source Shopify: fix schemas

* Source Shopify: fix state filter

* Source Shopify: refactor & optimize

* Source Shopify: fix test privileges

* Source Shopify: fix stream filter

* Source Shopify: fix streams

* Source Shopify: update abnormal state

* Source Shopify: fix abnormal state streams

* Source Shopify: fix streams

* updated methods, formated code

* Source Shopify: typo fix

* auto-bump connector version

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-17 23:01:10 +02:00
Octavia Squidington III
a5a0409ad5 Bump Airbyte version from 0.40.14 to 0.40.15 (#17970)
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
2022-10-17 13:33:20 -07:00
Amruta Ranade
8560f19022 Updated connector catalog page (#18076) 2022-10-17 15:41:50 -04:00
Yevhen Sukhomud
ee2e2b5b1f 16250 Destination Redis: Add SSH support (#17951)
* 16250 Destination Redis: Add SSH support

* 16250 Resolve port issue

* 11679 Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 02:00:51 +07:00
Amin
3f2af7d8e1 Update 4-reading-data.md (#18037) 2022-10-17 09:37:47 -03:00
Arsen Losenko
a28836e0c8 Source File: Handle UnicodeDecodeError in case of incorrect filetype (#17994)
* Handle UnicodeDecodeError in case of incorrect filetype

* Update changelog and Dockerfile

* Update changelog with PR number

* Move try/except close to the end of method

* Add test and test files
2022-10-17 12:20:03 +03:00
Michael Siega
e079761509 ensure workspace webhook configs can be persisted correctly (#18034)
* ensure workspace webhook configs can be correctly passed between API and persistence layers

* remove unnecessary logging

* add unit tests to workspace webhook config handling

* additional testing and style cleanup around workspace webhook config handling
2022-10-17 01:23:29 +02:00
Liren Tu
c872042a6b Databricks destination: ensure encrypted JDBC connection (#18032)
* Add ssl=1 to databricks jdbc url

* Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 14:10:48 -07:00
Evan Tahler
c81ea485ce Faster Faker (#18021)
* Faster Faker

* unit tests

* tests passing

* update pr link

* guard against small ranges

* Fixup product timezones

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 13:31:12 -07:00
Ashley Baer (PTC)
1b134d866f 🎉 Destination Databricks: Support Azure storage (#15140) (#15329)
* 🎉 Destination Databricks: Support Azure storage (#15140)

* Update docs and version.

* Revert unintentional change to S3 config parsing.

* Revert unnecessary additional table property.

* change spec.json

* Ignore azure integration test

* Add issue link

* auto-bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-15 01:37:08 -07:00
Greg Solovyev
a73ae2b09d Add SSH tunneling to Elastic Search Destination (#17805)
* Add support for using URL in tunneled config
* Add support for SSH tunneling to destination-elasticsearch and destination-elasticsearch-strict-encrypt
2022-10-14 16:12:16 -07:00
Michael Siega
359b560de9 Introduce webhook operations to the operations API and persistence (#17984)
* introduce webhook operations to the operations API and persistence

* add unit tests for webhooks in operations endpoint handler

* fixes and additional testing in webhook operations handler

* cleanup refactor around operations handling to reduce duplicate code
2022-10-14 23:08:12 +02:00
Michael Siega
d8e9f512d6 Fix multiple breakages in the platform build (#18011)
* Revert "🎉 New Destination: bit.io (#15821)"

This reverts commit c05135b336.

* Fix broken acceptance tests
2022-10-14 22:23:43 +02:00
Digambar Tupurwadi
6039e6fa5f Source Chargebee: altered docs for chargebee connector (#18007) 2022-10-14 15:42:31 -03:00
Adam Fletcher
c05135b336 🎉 New Destination: bit.io (#15821)
* tests pass

* solve conflict

* Add readme

* add bootstrap.md

* solve doc conflict

* update spec

* fix spec test

* add bitdotio icon

* change dockerfile version

* add releaseStage for tidb

* fix icon name

* correct conflict

* remove dest def for bit.io

* run config process seed

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2022-10-14 14:14:28 -03:00
Rachel Rizk
cdb8052db3 🐛 Source Bing Ads - Fix Campaigns stream misses Audience and Shopping (#17873) 2022-10-14 15:38:11 +02:00
Denys Davydov
5aa25a1e1a Source S3 - fix schema inference (#17991)
* #678 oncall. Source S3 - fix schema inference

* source s3: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-14 14:53:39 +03:00
Liren Tu
888347a0d0 🎉 JDBC sources: store cursor record count in db state (#15535)
* Add cursor_record_count to db stream state

* Add cursor record count to cursor info

* Emit max cursor record count

* Add original cursor record count

* Unify logging format

* Add backward compatible methods

* Update unit tests for state decorating iterator

* Update test (not done yet)

* Fix one more unit test

* Change where clause operator according to record count

* Add branch for null cursor

* Skip saving record count when it is 0

* Fix log wording

* Set mock record count in test

* Check cursor value instead of cursor info

* Fix source jdbc test

* Read record count from state

* Fix tests

* Add an acceptance test case

* Fix npe

* Change record count from int to long to avoid type conversion

* Fix references

* Fix oracle container

* Use uppercase for snowflake

* Use uppercase for db2

* Fix and use uppercase

* Update test case to include the edge case

* Format code

* Remove extra assertion in clickhouse

* Merge ms sql incremental query method

* Log query for debugging

* Clean up name_and_timestamp table

* Fix db2 tests

* Fix mssql tests

* Fix oracle tests

* Fix oracle tests

* Fix cockroachdb tests

* Fix snowflake tests

* Add changelog

* Fix mssql tests

* Fix db2-strict-encrypt tests

* Fix oracle-strict-encrypt tests

* Bump postgres version

* Fix oracle-strict-encrypt tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-14 01:09:12 -07:00
Michael Siega
6a48da9226 Introduce webhook configs into workspace api and persistence (#17950)
* wip

* handle webhook configs in workspaces endpoint and split/hydrate secrets

* style improvements to documentation around webhook configs

* Clarify documentation around webhook auth tokens

* More documentation clarification around webhook configs

* Format.

* unit test coverage for webhook config handling

* use common json parsing libraries around webhook configs

* clean up around testing webhook operation configs

Co-authored-by: Davin Chia <davinchia@gmail.com>
2022-10-14 02:59:02 +02:00
Delena Malan
289a065401 Use page_token_option instead of page_token (#17892) 2022-10-13 19:00:20 -03:00
Delena Malan
6eb3893f14 Remove typo line from incremental reads docs (#17920) 2022-10-13 13:07:56 -03:00
Subham Sahu
2247038a52 DocS: Update authentication.md (#17931) 2022-10-13 13:07:35 -03:00
Amruta Ranade
d9d2261fdf fixed links (#17949) 2022-10-13 09:31:51 -05:00
Amruta Ranade
57571ee94f Fixed broken links 2022-10-13 09:11:57 -05:00
Denys Davydov
234089e479 Source google-analytics-v4: fix pagination (#17943)
* #787 oncall - source google-analytics: fix pagination

* source google-analytics-v4: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-13 15:28:00 +03:00
Denys Davydov
c2415415bd Source google-anlytics-v4: do not retry exceeded daily quota (#17905)
* source google-anlytics-v4: do not retry exceeded daily quota

* source google analytics: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-13 11:31:10 +03:00
Serhii Chvaliuk
981190a005 🐛 Source Salesforce: make paging work, if cursor_field is not changed inside one page (#17615)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-13 09:05:19 +03:00
Edward Gao
bd0c2388df Destination Clickhouse: Publish normalization after removing native port (#17896)
* bump version for publish

* add link for publish pr
2022-10-12 13:51:55 -07:00
Krisjan O
07e5e35855 Google Analytics v4: Added support for segments and filters (#16920)
* Google Analytics v4: Added support for segments and filters

* Bumped version to 0.1.26 and updated docs

* Fix connection test

* Fix merge conflict (connector version)
2022-10-12 13:20:05 -04:00
Yowan Ramchoreeter
67d146ae41 Minor nit: Removing extra Note (#17572) 2022-10-12 12:08:19 -05:00
Akash Kulkarni
e1701c97eb 🎉 MySQL Source : Expose serverTimezone debezium option via MySQL Source spec for CDC (#17815)
* Expose serverTimezone debezium option via MySQL Source spec for CDC

* Fix tests

* Bump dockerfile version

* Update Dockerfile

* Update mysql.md

* Update mysql.md

* Documentation

* Code Review Comments

* Addressing comments

* Addressing comments

* Addressing comments

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-12 09:53:25 -07:00
Tyler B
de8895b8ef Changes Checkout Streams to Checkout Sessions (#17796)
I noticed a discrepancy in title of the "Checkout Streams" and "Checkout Streams Line Items" where the actual name of the streams are "Checkout Sessions" and "Checkout Sessions Line Items"
2022-10-12 11:51:25 -05:00
Serhii Chvaliuk
6a8b053fb5 Use locally-installed qemu rather than docker-installed version (2) (#17889)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-12 17:46:24 +03:00
Serhii Lazebnyi
f21f34559c Source Amplitude: Add empty series validation (#17854)
* Add seriaes validation

* Updated PR number

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-12 16:07:40 +02:00
Serhii Lazebnyi
5df66cd572 Source S3: Connector does not enforce SSL/TLS for non-S3 endpoints (#17800)
* Deleted ssl/tsl flag from config

* Updated PR number

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-12 16:07:22 +02:00
Baz
c04d317e45 🐛 Source Shopify: fix 404 for configured streams, fix missing cursor error for old records (#17777) 2022-10-12 15:16:09 +03:00
Serhii Chvaliuk
8e6fb793bb Source Github: Use default behaviour, retry on 429 and all 5XX errors (#17852)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-12 11:35:42 +03:00
Serhii Chvaliuk
f1c0c555c0 Source Facebook Marketing: remove "format" from optional datetime "end_date" field (#17869)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-10-12 11:30:41 +03:00
Subodh Kant Chaturvedi
4652173311 postgres-source: handle 24:00:00 value for time column (#17782)
* postgres-source: handle 24:00:00 value for time column

* address review comment

* fix test + use LocalTime.MAX

* bump version

* update alloy db as well

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-12 03:33:35 +05:30
Liren Tu
a8461a54c3 🐞 Source google sheets: fix nonetype exception when no spreadsheet id is found (#17766)
* Check if the match is not none

* Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-11 12:14:28 -07:00
Augustin
e4d1da5948 source-recharge: do not parse json in should_retry (#17822) 2022-10-11 21:08:55 +02:00