jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-25 10:01:49 -05:00
Code Issues Packages Projects Releases Wiki Activity
8,013 Commits 5,386 Branches 518 Tags
8b683088dfdb5ae5cd197b0e00a84ca47d8b2973
Commit Graph

1672 Commits

Author SHA1 Message Date
Ryan Fu
8c780bd3aa Publishes Postgres, MySQL, MSSQL source with changes from #18041 (#18086) 
* Publishes Postgres, MySQL, MSSQL source with changes from #18041

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 21:53:30 -07:00
Yowan Ramchoreeter
d016ef11c9 doc_update_oath_issue_gsc (#17967) 
* doc_update_oath_issue_gsc

We are currently blocked on some GCS OAuth workflows and we are adding a note to inform our customers.

* Updated wording

* Fixed wording for this connector

Approved and good to go
 2022-10-18 14:26:07 -04:00
Marcos Marx
70dd9a85cf 🎉 Source Zendesk Chat: engagements data fix infinity looping + gradlew format (#18121) 
* fix infinity looping in chats

* added more meaninful to variable name

* bump docker version

* auto-bump connector version

* run format

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 15:14:02 -03:00
Augustin
4db2364a67 source-e2e-test: update changelog with 0.1.2 (#18108) 2022-10-18 17:40:39 +02:00
Denys Davydov
475df69a66 Source facebook-marketing: remove pixel from custom conversions stream (#18045) 
* #744 source facebook-marketing: rm pixel from custom conversions stream

* #744 source fb marketing: upd changelog

* #744 source facebook-marketing - add custom_conversions to the test catalog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-18 13:22:41 +03:00
Artem Inzhyyants
fc8be13d33 🎉 Source Shopify: Add metafield streams (#17962) 
* 🎉 Source Shopify: Add metafield streams

* Source Shopify: fix unittest

* Source Shopify: docs update

* Source Shopify: fix backward compatibility test

* Source Shopify: fix schemas

* Source Shopify: fix state filter

* Source Shopify: refactor & optimize

* Source Shopify: fix test privileges

* Source Shopify: fix stream filter

* Source Shopify: fix streams

* Source Shopify: update abnormal state

* Source Shopify: fix abnormal state streams

* Source Shopify: fix streams

* updated methods, formated code

* Source Shopify: typo fix

* auto-bump connector version

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-17 23:01:10 +02:00
Arsen Losenko
a28836e0c8 Source File: Handle UnicodeDecodeError in case of incorrect filetype (#17994) 
* Handle UnicodeDecodeError in case of incorrect filetype

* Update changelog and Dockerfile

* Update changelog with PR number

* Move try/except close to the end of method

* Add test and test files
 2022-10-17 12:20:03 +03:00
Evan Tahler
c81ea485ce Faster Faker (#18021) 
* Faster Faker

* unit tests

* tests passing

* update pr link

* guard against small ranges

* Fixup product timezones

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-15 13:31:12 -07:00
Digambar Tupurwadi
6039e6fa5f Source Chargebee: altered docs for chargebee connector (#18007) 2022-10-14 15:42:31 -03:00
Rachel Rizk
cdb8052db3 🐛 Source Bing Ads - Fix Campaigns stream misses Audience and Shopping (#17873) 2022-10-14 15:38:11 +02:00
Denys Davydov
5aa25a1e1a Source S3 - fix schema inference (#17991) 
* #678 oncall. Source S3 - fix schema inference

* source s3: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-14 14:53:39 +03:00
Liren Tu
888347a0d0 🎉 JDBC sources: store cursor record count in db state (#15535) 
* Add cursor_record_count to db stream state

* Add cursor record count to cursor info

* Emit max cursor record count

* Add original cursor record count

* Unify logging format

* Add backward compatible methods

* Update unit tests for state decorating iterator

* Update test (not done yet)

* Fix one more unit test

* Change where clause operator according to record count

* Add branch for null cursor

* Skip saving record count when it is 0

* Fix log wording

* Set mock record count in test

* Check cursor value instead of cursor info

* Fix source jdbc test

* Read record count from state

* Fix tests

* Add an acceptance test case

* Fix npe

* Change record count from int to long to avoid type conversion

* Fix references

* Fix oracle container

* Use uppercase for snowflake

* Use uppercase for db2

* Fix and use uppercase

* Update test case to include the edge case

* Format code

* Remove extra assertion in clickhouse

* Merge ms sql incremental query method

* Log query for debugging

* Clean up name_and_timestamp table

* Fix db2 tests

* Fix mssql tests

* Fix oracle tests

* Fix oracle tests

* Fix cockroachdb tests

* Fix snowflake tests

* Add changelog

* Fix mssql tests

* Fix db2-strict-encrypt tests

* Fix oracle-strict-encrypt tests

* Bump postgres version

* Fix oracle-strict-encrypt tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-14 01:09:12 -07:00
Amruta Ranade
d9d2261fdf fixed links (#17949) 2022-10-13 09:31:51 -05:00
Denys Davydov
234089e479 Source google-analytics-v4: fix pagination (#17943) 
* #787 oncall - source google-analytics: fix pagination

* source google-analytics-v4: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-13 15:28:00 +03:00
Denys Davydov
c2415415bd Source google-anlytics-v4: do not retry exceeded daily quota (#17905) 
* source google-anlytics-v4: do not retry exceeded daily quota

* source google analytics: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-13 11:31:10 +03:00
Serhii Chvaliuk
981190a005 🐛 Source Salesforce: make paging work, if cursor_field is not changed inside one page (#17615) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-13 09:05:19 +03:00
Krisjan O
07e5e35855 Google Analytics v4: Added support for segments and filters (#16920) 
* Google Analytics v4: Added support for segments and filters

* Bumped version to 0.1.26 and updated docs

* Fix connection test

* Fix merge conflict (connector version)
 2022-10-12 13:20:05 -04:00
Yowan Ramchoreeter
67d146ae41 Minor nit: Removing extra Note (#17572) 2022-10-12 12:08:19 -05:00
Akash Kulkarni
e1701c97eb 🎉 MySQL Source : Expose serverTimezone debezium option via MySQL Source spec for CDC (#17815) 
* Expose serverTimezone debezium option via MySQL Source spec for CDC

* Fix tests

* Bump dockerfile version

* Update Dockerfile

* Update mysql.md

* Update mysql.md

* Documentation

* Code Review Comments

* Addressing comments

* Addressing comments

* Addressing comments

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 09:53:25 -07:00
Tyler B
de8895b8ef Changes Checkout Streams to Checkout Sessions (#17796) 
I noticed a discrepancy in title of the "Checkout Streams" and "Checkout Streams Line Items" where the actual name of the streams are "Checkout Sessions" and "Checkout Sessions Line Items"
 2022-10-12 11:51:25 -05:00
Serhii Chvaliuk
6a8b053fb5 Use locally-installed qemu rather than docker-installed version (2) (#17889) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-12 17:46:24 +03:00
Serhii Lazebnyi
f21f34559c Source Amplitude: Add empty series validation (#17854) 
* Add seriaes validation

* Updated PR number

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 16:07:40 +02:00
Serhii Lazebnyi
5df66cd572 Source S3: Connector does not enforce SSL/TLS for non-S3 endpoints (#17800) 
* Deleted ssl/tsl flag from config

* Updated PR number

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 16:07:22 +02:00
Baz
c04d317e45 🐛 Source Shopify: fix 404 for configured streams, fix missing cursor error for old records (#17777) 2022-10-12 15:16:09 +03:00
Serhii Chvaliuk
8e6fb793bb Source Github: Use default behaviour, retry on 429 and all 5XX errors (#17852) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-12 11:35:42 +03:00
Serhii Chvaliuk
f1c0c555c0 Source Facebook Marketing: remove "format" from optional datetime "end_date" field (#17869) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-12 11:30:41 +03:00
Subodh Kant Chaturvedi
4652173311 postgres-source: handle 24:00:00 value for time column (#17782) 
* postgres-source: handle 24:00:00 value for time column

* address review comment

* fix test + use LocalTime.MAX

* bump version

* update alloy db as well

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-12 03:33:35 +05:30
Liren Tu
a8461a54c3 🐞 Source google sheets: fix nonetype exception when no spreadsheet id is found (#17766) 
* Check if the match is not none

* Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-11 12:14:28 -07:00
Augustin
e4d1da5948 source-recharge: do not parse json in should_retry (#17822) 2022-10-11 21:08:55 +02:00
Augustin
1a36074818 source-salesforce: add EventWhoRelation to UNSUPPORTED_BULK_API_SALESFORCE_OBJECTS (#17778) 2022-10-11 21:08:35 +02:00
Christophe Duong
6e42afb735 Update and publish source-orb (#17838) 
* Update docs for source-orb

* auto-bump connector version [ci skip]

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-11 11:57:53 -07:00
Evan Tahler
2d049f18cf Use locally-installed qemu rather than docker-installed version (#17848) 
* Use locally-installed qemu rather than docker-installed version

* Bump faker for test

* Update docs/integrations/sources/faker.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

* auto-bump connector version [ci skip]

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-11 10:32:57 -07:00
Yashkumar Makwana
834ea961cd Documentation Update for Timely (#17755) 
* Updating timely.md

* Documentation update for Timely source connector.

* Updated timely.md

* Updated Timely.md

* Timely Readme.md Update
 2022-10-11 13:48:24 -03:00
Anushree Agrawal
bec1ecf264 🐛 Source Orb: Fix bug to enrich multiple events with the same event_id (#17761) 
* Update source Orb to handle multiple events with the same event_id

* Documentation

* Update documentation
 2022-10-11 15:22:54 +02:00
Serhii Chvaliuk
0da8d7bcab Source Google Search Console: improve config validation - site_urls (#17751) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-11 14:20:44 +03:00
Artem Inzhyyants
96f70ec6f2 Source Iterable to GA (docs update) (#17810) 2022-10-11 10:39:30 +02:00
Sophia Wiley
c53a204797 Edited Instagram Connector doc (#17693) 
* edited_doc

* deleted table and edited wording
 2022-10-07 09:30:46 -07:00
midavadim
4a74740b77 🎉 Source Youtube analytics - added custom backoff logic (#17454) 
* added custom backoff logic based on youtube analytics limits

* updated docs

* updated docs

* bumped connector version

* added configuration option for test purpose only

* added comments

* added unittest

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 18:54:05 +03:00
Augustin
e57693f819 source-google-analytics-v4: use hits metric for check (#17717) 2022-10-07 16:38:09 +02:00
Denys Davydov
18e35c5d70 Source linkedin-ads: retry 429/5xx when refreshing access token (#17724) 
* #17506 source linkedin-ads: retry 429/5xx when refreshing access token

* source linkedin-ads: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 17:17:14 +03:00
Marcos Marx
c4f6cbeff4 🐛 Source Mixpanel: solve cursor field none expected array (#17699) 
* solve cursor field none expected array

* update doc

* correct cursor_field

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 10:34:53 -03:00
Yevhen Sukhomud
3501abe888 🎉 8890 Source MySql: Fix large table issue by fetch size (#17236) 
* 8890 Fix large table issue by fetch size

* 8890 Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 20:25:56 +07:00
Serhii Chvaliuk
f4374530e5 Source Github: improve 502 handling for comments stream (#17715) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-07 14:58:31 +03:00
Denys Davydov
6ea207d297 #17506 source snapchat marketing: retry failed request for refreshing access token (#17596) 
* #17506 source snapchat marketing: improve error msg

* #17506 source snapchat marketing: improve error msg

* #17506 source snapchat-marketing: use CDK authenticator because the custom one is buggy

* #17506 source snapchat-marketing: retry 429 and 5xx when refreshing access token

* #17506 debug

* #17506 reformat code

* #17506 source snapchat: change max_tries to max_time

* #17506 rm debug code

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 14:53:19 +03:00
VitaliiMaltsev
84f02995ba MongoDb Source: Increase performance of discover (#17614) 
* MongoDb Source: Increase performance of discover

* bump version

* fixed tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-07 14:18:29 +03:00
Liren Tu
bd5fb351ea 📝 Postgres source: document occasional full refresh under cdc mode (#17705) 
* Update postgres doc about full refresh in cdc mode

* Update format
 2022-10-06 15:26:05 -07:00
Marcos Marx
53f68f4666 Source Bamboo-HR: change Name to name as returned from the API (#17684) 
* change Name to name as returned from the API

* udpate doc

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-06 16:08:49 -03:00
Akash Kulkarni
4b990d0797 🚨 Add ability to enforce SSL in MongoDB source connector (#17590) 
* Check and test for if we are disabling SSL/TLS in source-mongodb-strict-encrypt

* Update docs

* Address comments

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-06 11:57:36 -07:00
Artem Inzhyyants
00d1f0d9e1 Source Iterable: Add permission check for stream (#17602) 
* Source Iterable: Add permission check for stream

* Source Iterable: docs update

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-06 12:52:57 +02:00
Arsen Losenko
99cdb405bb Source Recharge: skip stream if 403 received (#17608) 
* Source Recharge: skip stream if 403 received

* Refactor should_retry method

* Add logging message for clarity

* Update changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-05 20:26:53 +03:00