jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-16 18:06:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
8,013 Commits 5,335 Branches 518 Tags
8b683088dfdb5ae5cd197b0e00a84ca47d8b2973
Commit Graph

2095 Commits

Author SHA1 Message Date
Ryan Fu
8c780bd3aa Publishes Postgres, MySQL, MSSQL source with changes from #18041 (#18086) 
* Publishes Postgres, MySQL, MSSQL source with changes from #18041

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 21:53:30 -07:00
Zachary Heller
d9a48c9449 🐛 Destination GCS: Fix error logs to log 'Gcs' rather than 'AWS' (#17901) 
* Fix error logs to log 'Gcs' rather than 'AWS'

* update connector version

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 20:21:37 -03:00
Yowan Ramchoreeter
d016ef11c9 doc_update_oath_issue_gsc (#17967) 
* doc_update_oath_issue_gsc

We are currently blocked on some GCS OAuth workflows and we are adding a note to inform our customers.

* Updated wording

* Fixed wording for this connector

Approved and good to go
 2022-10-18 14:26:07 -04:00
Marcos Marx
70dd9a85cf 🎉 Source Zendesk Chat: engagements data fix infinity looping + gradlew format (#18121) 
* fix infinity looping in chats

* added more meaninful to variable name

* bump docker version

* auto-bump connector version

* run format

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 15:14:02 -03:00
Augustin
4db2364a67 source-e2e-test: update changelog with 0.1.2 (#18108) 2022-10-18 17:40:39 +02:00
Tyler B
40896d00c0 Re-direct Postgres guide to active page, current link is 404'd (#18103) 
The current  "Refer to this guide..." link goes to a 404 page on postgres. The new link i put in is the equivalent of the old site. It can be compared using the wayback machine: https://web.archive.org/web/20220121223117/https://jdbc.postgresql.org/documentation/head/connect.html
 2022-10-18 10:47:39 -04:00
Denys Davydov
475df69a66 Source facebook-marketing: remove pixel from custom conversions stream (#18045) 
* #744 source facebook-marketing: rm pixel from custom conversions stream

* #744 source fb marketing: upd changelog

* #744 source facebook-marketing - add custom_conversions to the test catalog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 13:22:41 +03:00
Artem Inzhyyants
fc8be13d33 🎉 Source Shopify: Add metafield streams (#17962) 
* 🎉 Source Shopify: Add metafield streams

* Source Shopify: fix unittest

* Source Shopify: docs update

* Source Shopify: fix backward compatibility test

* Source Shopify: fix schemas

* Source Shopify: fix state filter

* Source Shopify: refactor & optimize

* Source Shopify: fix test privileges

* Source Shopify: fix stream filter

* Source Shopify: fix streams

* Source Shopify: update abnormal state

* Source Shopify: fix abnormal state streams

* Source Shopify: fix streams

* updated methods, formated code

* Source Shopify: typo fix

* auto-bump connector version

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-17 23:01:10 +02:00
Amruta Ranade
8560f19022 Updated connector catalog page (#18076) 2022-10-17 15:41:50 -04:00
Yevhen Sukhomud
ee2e2b5b1f 16250 Destination Redis: Add SSH support (#17951) 
* 16250 Destination Redis: Add SSH support

* 16250 Resolve port issue

* 11679 Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 02:00:51 +07:00
Arsen Losenko
a28836e0c8 Source File: Handle UnicodeDecodeError in case of incorrect filetype (#17994) 
* Handle UnicodeDecodeError in case of incorrect filetype

* Update changelog and Dockerfile

* Update changelog with PR number

* Move try/except close to the end of method

* Add test and test files
 2022-10-17 12:20:03 +03:00
Liren Tu
c872042a6b Databricks destination: ensure encrypted JDBC connection (#18032) 
* Add ssl=1 to databricks jdbc url

* Bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-15 14:10:48 -07:00
Evan Tahler
c81ea485ce Faster Faker (#18021) 
* Faster Faker

* unit tests

* tests passing

* update pr link

* guard against small ranges

* Fixup product timezones

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-15 13:31:12 -07:00
Ashley Baer (PTC)
1b134d866f 🎉 Destination Databricks: Support Azure storage (#15140) (#15329) 
* 🎉 Destination Databricks: Support Azure storage (#15140)

* Update docs and version.

* Revert unintentional change to S3 config parsing.

* Revert unnecessary additional table property.

* change spec.json

* Ignore azure integration test

* Add issue link

* auto-bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Liren Tu <tuliren@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-15 01:37:08 -07:00
Greg Solovyev
a73ae2b09d Add SSH tunneling to Elastic Search Destination (#17805) 
* Add support for using URL in tunneled config
* Add support for SSH tunneling to destination-elasticsearch and destination-elasticsearch-strict-encrypt
 2022-10-14 16:12:16 -07:00
Michael Siega
d8e9f512d6 Fix multiple breakages in the platform build (#18011) 
* Revert "🎉 New Destination: bit.io (#15821)"

This reverts commit c05135b336.

* Fix broken acceptance tests
 2022-10-14 22:23:43 +02:00
Digambar Tupurwadi
6039e6fa5f Source Chargebee: altered docs for chargebee connector (#18007) 2022-10-14 15:42:31 -03:00
Adam Fletcher
c05135b336 🎉 New Destination: bit.io (#15821) 
* tests pass

* solve conflict

* Add readme

* add bootstrap.md

* solve doc conflict

* update spec

* fix spec test

* add bitdotio icon

* change dockerfile version

* add releaseStage for tidb

* fix icon name

* correct conflict

* remove dest def for bit.io

* run config process seed

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-10-14 14:14:28 -03:00
Rachel Rizk
cdb8052db3 🐛 Source Bing Ads - Fix Campaigns stream misses Audience and Shopping (#17873) 2022-10-14 15:38:11 +02:00
Denys Davydov
5aa25a1e1a Source S3 - fix schema inference (#17991) 
* #678 oncall. Source S3 - fix schema inference

* source s3: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-14 14:53:39 +03:00
Liren Tu
888347a0d0 🎉 JDBC sources: store cursor record count in db state (#15535) 
* Add cursor_record_count to db stream state

* Add cursor record count to cursor info

* Emit max cursor record count

* Add original cursor record count

* Unify logging format

* Add backward compatible methods

* Update unit tests for state decorating iterator

* Update test (not done yet)

* Fix one more unit test

* Change where clause operator according to record count

* Add branch for null cursor

* Skip saving record count when it is 0

* Fix log wording

* Set mock record count in test

* Check cursor value instead of cursor info

* Fix source jdbc test

* Read record count from state

* Fix tests

* Add an acceptance test case

* Fix npe

* Change record count from int to long to avoid type conversion

* Fix references

* Fix oracle container

* Use uppercase for snowflake

* Use uppercase for db2

* Fix and use uppercase

* Update test case to include the edge case

* Format code

* Remove extra assertion in clickhouse

* Merge ms sql incremental query method

* Log query for debugging

* Clean up name_and_timestamp table

* Fix db2 tests

* Fix mssql tests

* Fix oracle tests

* Fix oracle tests

* Fix cockroachdb tests

* Fix snowflake tests

* Add changelog

* Fix mssql tests

* Fix db2-strict-encrypt tests

* Fix oracle-strict-encrypt tests

* Bump postgres version

* Fix oracle-strict-encrypt tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-14 01:09:12 -07:00
Amruta Ranade
d9d2261fdf fixed links (#17949) 2022-10-13 09:31:51 -05:00
Denys Davydov
234089e479 Source google-analytics-v4: fix pagination (#17943) 
* #787 oncall - source google-analytics: fix pagination

* source google-analytics-v4: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-13 15:28:00 +03:00
Denys Davydov
c2415415bd Source google-anlytics-v4: do not retry exceeded daily quota (#17905) 
* source google-anlytics-v4: do not retry exceeded daily quota

* source google analytics: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-13 11:31:10 +03:00
Serhii Chvaliuk
981190a005 🐛 Source Salesforce: make paging work, if cursor_field is not changed inside one page (#17615) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-13 09:05:19 +03:00
Krisjan O
07e5e35855 Google Analytics v4: Added support for segments and filters (#16920) 
* Google Analytics v4: Added support for segments and filters

* Bumped version to 0.1.26 and updated docs

* Fix connection test

* Fix merge conflict (connector version)
 2022-10-12 13:20:05 -04:00
Yowan Ramchoreeter
67d146ae41 Minor nit: Removing extra Note (#17572) 2022-10-12 12:08:19 -05:00
Akash Kulkarni
e1701c97eb 🎉 MySQL Source : Expose serverTimezone debezium option via MySQL Source spec for CDC (#17815) 
* Expose serverTimezone debezium option via MySQL Source spec for CDC

* Fix tests

* Bump dockerfile version

* Update Dockerfile

* Update mysql.md

* Update mysql.md

* Documentation

* Code Review Comments

* Addressing comments

* Addressing comments

* Addressing comments

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 09:53:25 -07:00
Tyler B
de8895b8ef Changes Checkout Streams to Checkout Sessions (#17796) 
I noticed a discrepancy in title of the "Checkout Streams" and "Checkout Streams Line Items" where the actual name of the streams are "Checkout Sessions" and "Checkout Sessions Line Items"
 2022-10-12 11:51:25 -05:00
Serhii Chvaliuk
6a8b053fb5 Use locally-installed qemu rather than docker-installed version (2) (#17889) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-12 17:46:24 +03:00
Serhii Lazebnyi
f21f34559c Source Amplitude: Add empty series validation (#17854) 
* Add seriaes validation

* Updated PR number

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 16:07:40 +02:00
Serhii Lazebnyi
5df66cd572 Source S3: Connector does not enforce SSL/TLS for non-S3 endpoints (#17800) 
* Deleted ssl/tsl flag from config

* Updated PR number

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 16:07:22 +02:00
Baz
c04d317e45 🐛 Source Shopify: fix 404 for configured streams, fix missing cursor error for old records (#17777) 2022-10-12 15:16:09 +03:00
Serhii Chvaliuk
8e6fb793bb Source Github: Use default behaviour, retry on 429 and all 5XX errors (#17852) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-12 11:35:42 +03:00
Serhii Chvaliuk
f1c0c555c0 Source Facebook Marketing: remove "format" from optional datetime "end_date" field (#17869) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-12 11:30:41 +03:00
Subodh Kant Chaturvedi
4652173311 postgres-source: handle 24:00:00 value for time column (#17782) 
* postgres-source: handle 24:00:00 value for time column

* address review comment

* fix test + use LocalTime.MAX

* bump version

* update alloy db as well

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 03:33:35 +05:30
Liren Tu
a8461a54c3 🐞 Source google sheets: fix nonetype exception when no spreadsheet id is found (#17766) 
* Check if the match is not none

* Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-11 12:14:28 -07:00
Augustin
e4d1da5948 source-recharge: do not parse json in should_retry (#17822) 2022-10-11 21:08:55 +02:00
Augustin
1a36074818 source-salesforce: add EventWhoRelation to UNSUPPORTED_BULK_API_SALESFORCE_OBJECTS (#17778) 2022-10-11 21:08:35 +02:00
Christophe Duong
6e42afb735 Update and publish source-orb (#17838) 
* Update docs for source-orb

* auto-bump connector version [ci skip]

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-11 11:57:53 -07:00
Evan Tahler
2d049f18cf Use locally-installed qemu rather than docker-installed version (#17848) 
* Use locally-installed qemu rather than docker-installed version

* Bump faker for test

* Update docs/integrations/sources/faker.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

* auto-bump connector version [ci skip]

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-11 10:32:57 -07:00
Yashkumar Makwana
834ea961cd Documentation Update for Timely (#17755) 
* Updating timely.md

* Documentation update for Timely source connector.

* Updated timely.md

* Updated Timely.md

* Timely Readme.md Update
 2022-10-11 13:48:24 -03:00
Anushree Agrawal
bec1ecf264 🐛 Source Orb: Fix bug to enrich multiple events with the same event_id (#17761) 
* Update source Orb to handle multiple events with the same event_id

* Documentation

* Update documentation
 2022-10-11 15:22:54 +02:00
Serhii Chvaliuk
0da8d7bcab Source Google Search Console: improve config validation - site_urls (#17751) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-11 14:20:44 +03:00
Artem Inzhyyants
96f70ec6f2 Source Iterable to GA (docs update) (#17810) 2022-10-11 10:39:30 +02:00
Sophia Wiley
c53a204797 Edited Instagram Connector doc (#17693) 
* edited_doc

* deleted table and edited wording
 2022-10-07 09:30:46 -07:00
midavadim
4a74740b77 🎉 Source Youtube analytics - added custom backoff logic (#17454) 
* added custom backoff logic based on youtube analytics limits

* updated docs

* updated docs

* bumped connector version

* added configuration option for test purpose only

* added comments

* added unittest

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 18:54:05 +03:00
Augustin
e57693f819 source-google-analytics-v4: use hits metric for check (#17717) 2022-10-07 16:38:09 +02:00
Denys Davydov
18e35c5d70 Source linkedin-ads: retry 429/5xx when refreshing access token (#17724) 
* #17506 source linkedin-ads: retry 429/5xx when refreshing access token

* source linkedin-ads: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 17:17:14 +03:00
Marcos Marx
c4f6cbeff4 🐛 Source Mixpanel: solve cursor field none expected array (#17699) 
* solve cursor field none expected array

* update doc

* correct cursor_field

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 10:34:53 -03:00