jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-13 18:02:36 -05:00
Code Issues Packages Projects Releases Wiki Activity
9,635 Commits 5,260 Branches 518 Tags
e414595e412d69645f01d577c7b666e0c61686b7
Commit Graph

2052 Commits

Author SHA1 Message Date
Tim Roes
e414595e41 Experiment to use shorter setup guides (#21862) 2023-01-26 14:06:47 +01:00
Roman Yermilov [GL]
795dfe99ac Source Sentry: add state persistence (#21864) 
* Source Sentry: add state persistance

* Source Sentry: bump version

* Source Sentry: update changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-26 13:43:10 +02:00
Joe Reuter
862c9467d1 add note acbout breaking change (#21906) 2023-01-26 10:50:26 +01:00
Serhii Lazebnyi
6801049111 Source Mixpanel: enable high test strictness level in SAT (#21510) 
* Enable high test strictness

* Updated expected_records.jsonl

* Updated expected records

* Increased timeout

* Updated abnormal state

* Updated cursor_path

* Updated acceptance tests config
 2023-01-25 20:34:13 +01:00
Joe Reuter
6e373435f2 Small spec fixes to make sure they work with connector form UI (#21587) 2023-01-25 19:43:26 +01:00
oneshcheret
438c1ebc19 Mysql source: handle ssh timeout exception (#20593) 
* Ssh wrapped source: mark ssh timeout exception as config error.

* Ssh wrapped source: move to single catch block

* Ssh wrapped source: code format

* Source postgres: update display message

* Source mysql: format

* Source mysql: bump versions

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-25 16:26:15 +00:00
Rodi Reich Zilberman
6d0177ae9f Revert back to erroring out on a null cursor value (#21825) 
* revert back to erroring out on a null cursor value

* Update dockerfiles and release notes

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-25 02:01:14 +00:00
Roman Yermilov [GL]
04a77ad3aa Source S3: keep processing but warn if OSError happen (#21604) 
* Source S3: keep processing but warn if OSError happen

* Source S3: bump version and update changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-24 20:00:51 +04:00
Sergio Ropero
3efc6431ea [Doc] Update Postgres documentation (#21652) 
* Update documentation for Postgres:
- Add details if you need CDC sync for some tables and also sync views.
- Reformat tables.

* Update documentation for Postgres:
- Add details if you need CDC sync for some tables and also sync views.
- Reformat tables.

* Make documentation user friendly

* Fix table
 2023-01-24 10:18:42 -05:00
Denys Davydov
06e88849f0 Source Gitlab: fix missing data issue (#21713) 
* #21076 source gitlab: fix missing data issue

* #21076 source gitlab: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-24 09:13:05 +02:00
Artem Inzhyyants
6217c292fe Source Google Ads: Fix multibyte issue (#21705) 
* Source Google Ads: Fix multibyte issue; Bump google-ads package to 19.0.0

* Source Google Ads: update docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-23 23:36:24 +00:00
Yowan Ramchoreeter
e93a463983 Update shopify.md (#21502) 
Adding call to action to Shopify doc to help us land OAuth in Cloud
 2023-01-23 23:53:58 +05:30
Akash Kulkarni
79de89d439 Source Postgres : Fast query for estimate messages (#21683) 
* Source Postgres : Fast query for estimate messages

* Update documentation

* auto-bump connector version

* Update strict-encrypt Dockerfile

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-23 06:33:58 -08:00
Sergio Ropero
dd0706e801 fix: Introduces back the initial_waiting_seconds option for MSSQL source. (#21348) 
Introduces back the `initial_waiting_seconds` option for MSSQL source.
 2023-01-23 14:36:44 +01:00
Denys Davydov
e35dc23600 #1313 source google ads: write less logs (#21517) 
* #1313 source google ads: write less logs

* #1313 source google ads: upd changelog

* #1313 source google ads: fix expected records

* #1313 source google ads: rm unused call to init

* #1313 source google ads: fix expected records

* #1313 source google ads - bump sieve outside the loop

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-23 10:18:45 +02:00
Denys Davydov
b83cd5763e Source Instagram: test strictness level high (#21602) 
* #19049 source instagram: test strictness level high

* #19049 source instagram - upd changelog

* #19049 source instagram: upd expected records

* #19049 sourcte instagram: update expected records

* #19049 source instagram: exclude Media stream from sat

* #19049 source instagram: bypass users stream

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-23 10:18:21 +02:00
Baz
b0e5ea9479 📄 🐛 Source Netsuite: check_connection fix + edited public docs (#21645) 2023-01-21 12:44:36 +02:00
Roman Yermilov [GL]
d1688c7287 Source GitHub: #970 handle 502 Bad Gateway (#21481) 
* Source Github: handle 502 Bad Gateway with proper log message

* Source Github: bump version

* Source Github: update changelog for new 0.3.12 version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-19 19:27:30 +00:00
Baz
b69639e06f 🎉 Source Gitlab: add OAuth2.0 authentication support (#7506) 
* added support of oauth2.0

* added OAuthFlow.java part

* bumped version of the Dockerfile

* corrected SAT

* added unit_test for Oauth java part, added integration-test for java part

* added changelog

* fix java part test

* updated after review

* updated spec.json

* updated after review

* #7480 source gitlab: rm empty files

* #7480 source gitlab: add single use refresh token authenticator

* #7480 source gitlab: upd oauth implementation

* #7480 source gitlab: refactor auth

* #7480 fix oauth: java

* #7480 source gitlab: review fixes

* #7480 source gitlab: upd release stage

* #7480 source gitlab: fix unit tests

* #7480 source gitlab: update expected records

* #7480 source gitlab: upd sats

* #7480 source gitlab: upd expected records

* #7480 source Gitlab: use SingleUseRefreshTokenOauth as is

* #7480 sourcte gitlab: upd expected records

* auto-bump connector version

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-18 19:59:15 +02:00
VitaliiMaltsev
f5f4de2e5f JDBC sources: consolidate date/time values mapping (#20346) 
* JDBC sources: consolidate date/time values mapping

* fixed Snowflake acceptance tests

* fixed TestJdbcUtils

* refactoring

* update setDate for incremental sync

* fixed CockroachDbJdbcSourceAcceptanceTest

* fixed CockroachDbSourceDatatypeTest

* fixed CockroachDbSourceDatatypeTest

* fixed MsSQLSourceDatatypeTest

* fixed MsSQL cdc datatype test

* refactoring

* fixed mssql cdc test

* fixed Redshift tests

* fixed Redshift tests

* updated db2 datatype tests

* fixed DB2 tests

* fixed DB2 strict-encrypt tests

* fixed Oracle strict-encrypt tests

* refactoring

* updated changelog

* refactoring

* removed redundant overrides

* bump versions

* auto-bump connector version

* resolved merge conflicts

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* bump postgres version

* auto-bump connector version

* updated seed definitions

* revert generated definitions for Postgres

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-18 19:21:11 +02:00
Baz
4ade1dad88 🎉 Source Shopify: unblock for all workspaces (#21439) 2023-01-18 16:49:52 +02:00
Akash Kulkarni
63e4482a5f Source Postgres : Emit estimate trace messages for non-CDC mode (#20783) 
* Emit estimate trace messages

* Update PostgresQueryUtils.java

* Remaining merge conflicts

* Code cleanip

* Address comments

* Formatting

* Cleanup

* Addressing comments

* Bump version + documentation

* Update strict-encrypt Dockerfile

* Unpublish

* Merge conflicts

* Update Dockerfile

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-18 13:55:54 +00:00
Denys Davydov
f31d92c3a9 Source Zendesk Support: refactor and debug stuck syncs (#20900) 
* #1231 source zendesk support: remove synchronous sleep, add logging, reduce backoff time

* #1231 source zendesk support: upd changelog

* #1231 source zendesk: reduce sleeps

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-17 18:54:17 +02:00
Baz
5b731d1c8d 🐛 Source Shopify: add discount applications to orders stream (#21461) 2023-01-17 16:49:14 +00:00
Catherine Noll
9b7535e7eb Source Gnews: reorganize inline schema in gnews.yaml (#21322) 2023-01-17 09:27:11 -05:00
Jon Martin
acadee08bc Add instructions for mounting Windows directory. (#21405) 
There're currently no directions as to what a user would need to change to be able to mount a raw directory into the Docker containers to be able to use a file as a source.
 2023-01-17 07:53:59 -03:00
Henri Blancke
3c39e0c01e 🐛 Source Insightly: Fix state date conversion bug (#19356) 
* [FIX] cursor cast

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [UPD] bump version

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* [FIX] add pendulum dependency

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>

* auto-bump connector version

Signed-off-by: Henri Blancke <blanckehenri@gmail.com>
Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
 2023-01-17 03:47:58 -05:00
Mickaël Andrieu
e38baf4997 Docs: highlight the requirement on MongoDB user access levels (#21462) 2023-01-17 07:34:02 +00:00
darynaishchenko
6091b3829f Source Instatus: built in yaml (#21008) 
* added source-instatus

* added changelog

* fixed formatting for schemas, used WaitTimeFromHeader

* added unit test for components, refactored instatus.yaml

* added schema_loader to base stream, removed url from public_data_requester

* added source_definitions.yaml

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
 2023-01-16 11:06:05 +02:00
Artem Inzhyyants
e72cf09ff3 Source Facebook Marketing: Videos stream remove filtering (#21385) 
* Source Facebook Marketing: Videos stream remove filtering

* Source Facebook Marketing: update docs

* Source Facebook Marketing: Ref

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-13 19:34:27 +01:00
Artem Inzhyyants
19b5375090 Source Slack: retry timeout error (#21321) 
* Source Slack: retry timeout error

* Source Slack: update docs

* Source Slack: update retry

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-13 17:32:27 +00:00
midavadim
1b185db434 🎉 Typeform - beta certification (#21145) 
* fixed SAT, fix specs, updated docs

* fix incremental

* fix incremental

* fix incremental

* updated connector version in source_definitions.yaml

* updated version in source_specs.yaml
 2023-01-13 16:37:37 +02:00
Arsen Losenko
00d4c20fd1 🎉 New Source: Dremio (#19912) 2023-01-13 15:11:19 +02:00
Philippe Boyd
f3c8d83170 🐛 Source Jira: check_connection fails if no projects are defined (#20739) 
Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Serhii Chvaliuk <grubberr@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
 2023-01-12 23:39:25 +02:00
Rodi Reich Zilberman
94c84f783a Make schema field in source-snowflake mean a subset of the specified o… (#20465) 
* Make schema field in source-postgres mean a subset of the specified of schema when during discover(). update UI

* Add missing file

* Fix failing acceptance test

* sanity

* update doc

* typo

* version bump and release note

* Fix failing test

* fix format
 2023-01-12 09:30:43 -08:00
Philip Corr
ceadf31444 🎉 Source bigcommerce: add brands and categories streams (#20518) 
* Add product info to the orders stream

* Update docs

* Refactor order_products into its own stream

* formatting

* Update docs and docker version

* remove duplicate field

* Add brands and categories streams to bigcommerce

* remove duplicate state

* remove duplicate source

* update docs

* update docs

* bump docker version

* update markdown

* lint

* auto-bump connector version

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Haithem SOUALA <haithem.souala@woopit.fr>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-12 12:01:53 -05:00
Artem Inzhyyants
0ca60bc083 Source Google Ads: Update docs (#21308) 
* Source Ads: docs

* Source Ads: docs
 2023-01-12 15:17:18 +01:00
Artem Inzhyyants
1c8cbc0060 Source Snapchat Marketing: fix error response (#21267) 
* Source Snapchat Marketing: fix error response

* Source Snapchat Marketing: update docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-11 22:25:18 +01:00
Subodh Kant Chaturvedi
8dffde019d postgres-source-cdc: handle null values for array data types (#21003) 
* postgres-source-cdc:handle null values for array data types

* fix test

* upgrade version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-11 23:41:49 +05:30
Serhii Chvaliuk
59ff2a2f59 Source Google Analytics Data API: slicer updated, unit tests added (#21169) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-01-11 18:26:29 +02:00
Denys Davydov
9d4dd48d9f Source notion: fix schema (#20639) 
* #1047 oncall - Source Notion: fix Pages stream schema

* #1047 oncall - Source Notion: fix Pages stream schema

* #1047 oncall - Source Notion: upd changelog

* #1047 source notion - remove ignored fields

* #1047 source notion: fix SATs

* #1047 source notion: upd expected records

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-11 16:57:15 +02:00
Artem Inzhyyants
31edbd8bae Source S3: update block size for json (#21210) 
* Source S3: update block size for json

* Source S3: update docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-10 19:53:42 +00:00
Artem Inzhyyants
2ea66124cf Source Airtable: fix field names (#21215) 2023-01-10 20:44:31 +01:00
Denys Davydov
58352c99e1 Source google ads: add more logs (#20755) 
* #1148 source google ads: add more logs

* #1148 source google ads: upd changelog

* #1148 source google ads: flake fix

* #1148 source google ads - fix SATs

* #1148 source Google Ads: bump version

* #1148 source google ads: upd expected records

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-10 19:59:05 +02:00
Baz
cb99eab61a 🎉 Source Airtable: update releaseStage to beta (#20935) 2023-01-10 13:09:42 +00:00
Baz
98ee1c2165 🐛 🎉 Source Airtable: migrate to the Metadata API for dynamic schema generation (#20846) 2023-01-09 22:37:34 +01:00
Denys Davydov
86157be611 Source Mailchimp - fix the way request params are built (#20765) 
* 1058 source mailchimp - fix the way request params are built

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-09 22:30:50 +01:00
Artem Inzhyyants
e8c5cff2bb Source Harvest: Skip 403 FORBIDDEN for all streams (#21151) 
* Source Harvest: Skip 403 FORBIDDEN for all streams

* Source Harvest: update docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-09 21:44:31 +01:00
Zaza Javakhishvili
bbf1a5c3e9 Amazon Seller Partner: Validate connections without orders data (#20896) 
* amazon seller partner validate connection without orders data

* amazon seller partner bump version in docs

* amazon seller partner fix redundant if statement

* auto-bump connector version

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-09 14:30:12 -05:00
Artem Inzhyyants
bc93198b78 Source Facebook Marketing: Update schema ad_account (#21149) 
* Source Facebook Marketing: Update schema ad_account

* Source Facebook Marketing: Update docs; bump version

* Source Facebook Marketing: disable backward compatibility

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-09 19:38:45 +01:00