1
0
mirror of synced 2026-01-06 15:03:36 -05:00
Commit Graph

3217 Commits

Author SHA1 Message Date
Amruta Ranade
11692b9b43 updated google analytics docs (#16362) 2022-09-06 12:33:37 -04:00
Luis Gomez
50014742f3 🎉 Source Pinterest: Added backoff strategy for rate-limit errors (#16161) 2022-09-06 17:06:45 +03:00
Pierre Borckmans
ebd0f30141 🐛 Source OpenWeather: Update openweather onecall api to 3.0 (#16136)
* Update openweather onecall api to 3.0

* Bump version and update docs

* correct backwards compatibility spec

* auto-bump connector version [ci skip]

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-06 09:38:45 -03:00
Arsen Losenko
46112cfaa1 Source Pinterest: support OAuth (#16271)
* Source Pinterest: Initial setup of OAuth flow

* Remove previously added class and method for auth

* Update Java part of OAuth flow, update spec

* Update spec and add additional methods to Java OAuth flow

* Add backwards compatibility for old config structure

* Add missing imports

* Revert previous changes in source_specs.yaml

* Cleanup in imports and source_specs

* Add missing imports

* Add missing imports

* Remove 'subdomain' logic from Java OAuth flow

* Update docs

* Update docs accordingly to comments in PR

* Refactor credentials variable

* Fix typo

* Update acceptance-test-config.yml

* Specify integer type for AD_ACCOUNT_ID value in schemas

* updated SAT tests, fixed Max Rate Limit error handling

* updated unit_tests

* updated schemas, added caching for Boards and AdAccounts stream to reduce API Calls for child streams, commented out Incremental and Full refresh SAT tests

* auto-bump connector version [ci skip]

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-06 13:16:19 +03:00
Pedro S. Lopez
ec70b322f3 Source: Instagram - Use latest CDK version (#16340) 2022-09-05 20:46:00 -04:00
Denys Davydov
8b5362ef11 Source Greenhouse: support incremental syncs (#16338)
* #1386 Source Greenhouse: support incremental syncs - first try

* #1386 Source Greenhouse: implement incremental syncs

* #1386 source greenhouse: upd changelog

* Increased unittest to 90

* Updated link in spec

* auto-bump connector version [ci skip]

* Updated release stage

Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-05 23:13:25 +02:00
Bhupesh Varshney
498d70089f Source S3: Doc fix grammar & typo describing parquet file source (#16264) 2022-09-05 17:53:41 -03:00
Vikram G
e1596bcf74 Update README.md (#16312)
Fixed link to Airbyte specification
2022-09-05 17:46:58 -03:00
midavadim
7ae67d1b0d 🎉 Source Iterable - added new events streams (#16067)
* increased unit test coverage

* added additional events streams

* updated tests

* bumped connector version, update changelog

* fixed indentations

* api.py and iterable_streams.py merged into one stream.py file

* Fix unit tests

* updated release stage

* fixed import

* Updated version in seed

* auto-bump connector version [ci skip]

* updated source_specs.yaml

Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-05 23:00:13 +03:00
Serhii Chvaliuk
19f4af8d28 Source Bing Ads: backoff socket.timeout (#16335)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-05 21:48:07 +03:00
Roman Yermilov [GL]
5853d52ff2 Sourse Zendesk Talk: OAuth2.0 and unittests (#15764)
* Sourse Zendesk Talk:

- Oauth2.0 support
- unittest coverage 90%

* Source Zendesk Talk: update documentation

* Source Zendesk Talk: update changelog

* Source Zendesk Talk: update field description

* Source Zendesk Talk: fix documentation caption

* Source Zendesk Talk: fix spec, improve tests

* Source Zendesk Talk: remove Makefile

* Source Zendesk Talk: fix tests

* Source Zendesk Talk: fix tests

* Source Zendesk Talk: acceptance-test-config.yml test commit

* Source Zendesk Talk: acceptance-test-config.yml test commit

* Source Zendesk Talk: fix spec, add config to acceptance tests

* added oauth java test

* auto-bump connector version [ci skip]

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-05 19:14:08 +03:00
oneshcheret
be36bb2e1c Mssql source: add schemas for discovery during set up (#16002)
* Mssql source: add schemas during discovery

* Source mssql: temp changes for testing ci

* Source mssql: update expected version for strict encrypt version

* Source mssql: update order in spec

* Source mssql: added filter by requested schemas

* Source mssql: bump versions

* Source mssql: format

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-05 15:03:11 +03:00
Serhii Chvaliuk
13a238c2d5 🎉 Source Amazon Ads: improve config.start_date validation (#16191)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-05 13:03:35 +03:00
VitaliiMaltsev
e9a8a05267 MySQL Source : Standardize spec.json for DB connectors that support log-based CDC replication (#16216)
* Fixed bucket naming for S3

* removed redundant configs

* MySQL Source : Standardize spec.json for DB connectors that support log-based CDC replication

* fixed strict encrypt tests

* fixed mysql tests

* bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-04 15:30:04 +03:00
VitaliiMaltsev
28a6adde64 MSSQL Source : Standardize spec.json for DB connectors that support log-based CDC replication (#16215)
* Fixed bucket naming for S3

* removed redundant configs

* MSSQL Source : Standardize spec.json for DB connectors that support log-based CDC replication

* bump version

* bump version
2022-09-03 21:55:54 +03:00
Serhii Lazebnyi
e831a71219 Source Google Analytics v4: Re-name google analytics connector (#16306)
* Re-name google analytics cionnectors

* Re-named google analytics v4
2022-09-02 21:59:44 +02:00
Serhii Chvaliuk
89ae9e05e7 🐛 Source Facebook Marketing: remove "end_date" from config if empty value (re-implement #16096) (#16222)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-02 22:55:33 +03:00
Octavia Squidington III
abc01d3c49 Bump Airbyte version from 0.40.3 to 0.40.4 (#16275)
Co-authored-by: timroes <timroes@users.noreply.github.com>
2022-09-02 20:17:00 +02:00
Yurii Bidiuk
31215cb5c8 Destination MongoDB: Remove additionalProperties:false (#16025)
* Remove additionalProperties:false from destination-mongodb

* bumb version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-02 13:25:24 +03:00
Liren Tu
9acc802c71 🎉 MySQL sources: emit state messages more frequently (#16259)
* Emit intermediate state messages from mysql source

* Add pr id

* Try ec2 runner with larger disk

* Revert "Try ec2 runner with larger disk"

This reverts commit fb4d99489d.
2022-09-02 02:47:33 -07:00
Rodi Reich Zilberman
fc13413c9b Enforce secure connection in destination-postgres-strict-encrypt (#16260)
* Enforce secure connection in destination-postgres-strict-encrypt

* bump docker image values and update changelog.

* Typo

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-02 00:47:19 -07:00
Liren Tu
5ad492c074 🎉 MS SQL sources: emit state messages more frequently (#16261)
* Emit more state messages in mssql source [skip ci]

* Add pr id

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-02 00:26:07 -07:00
Liren Tu
29cef6635f 🎉 Redshift & snowflake sources: emit state messages more frequently (#16258)
* Emit more state messages in redshift source

* Emit more state messages in snowflake source

* auto-bump connector version [ci skip]

* Use random schema name in integration test

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 22:57:27 -07:00
Liren Tu
c3f3702522 🎉 Jdbc sources: emit state messages more frequently (#16256)
* Emit intermediate states in clickhouse

* Add pr id

* Emit intermediate states in cockroachdb

* Emit intermediate states in db2

* Emit intermediate states in jdbc source

* Emit intermediate states in tidb

* Revert "Emit intermediate states in jdbc source"

This reverts commit 7a913bbae7.

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 21:44:48 -07:00
Liren Tu
fd547c64d7 🐛 Avro related destinations: fix field name clashing with combined restrict (#16243)
* Add test case for allOf and oneOf

* Bump version

* Add pr id

* Bump gcs version

* Bump dest jdbc

* Bump redshift

* Bump snowflake

* Bump databricks

* Bump bigquery

* Revert "Bump dest jdbc"

This reverts commit f10497e96a.

* Use a new pat to avoid api rate limit

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* Revert databricks bump

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 18:06:27 -07:00
Liren Tu
29ec2617ec Add missing pr id 2022-09-01 15:33:57 -07:00
Davin Chia
c2c276d1a4 Add documentation on how to configure and debug connector resources. (#16204)
* Add documentation on how to configure and debug connector resources.

* Wording.

* Add to sidebar.
2022-09-01 14:48:14 -07:00
Liren Tu
fbac1d3fa5 🎉 Oracle source: emit state messages more frequently (#16238)
* Activate intermediate state emission for oracle

* Bump version

* Use a different pat to avoid api rate limit

* Revert "use a different pat to avoid api rate limit"

This reverts commit aaf4502f83.

* Use a different pat to avoid api rate limit

This reverts commit d9d741e8ee.

* auto-bump connector version [ci skip]

* Revert "Use a different pat to avoid api rate limit"

This reverts commit bb3430bcc5.

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 14:17:44 -07:00
Amruta Ranade
6319c2acff Update Google Analytics GA doc (#16190)
* Initial commits

* more edits

* more edits

* final edits
2022-09-01 15:45:01 -04:00
Alex
4f03c09d48 Add documentation for running the dev image of a connector (#16176)
* add documentation for running the dev image of a connector

* Apply suggestions from code review

Co-authored-by: Augustin <augustin.lafanechere@gmail.com>

* remove unwanted directory from PR

Co-authored-by: Augustin <augustin.lafanechere@gmail.com>
2022-09-01 13:25:36 -05:00
Vinicius Aguiar
c9326170ab doc(fix): update minor typo on helm deploy (#16193) 2022-09-01 15:04:47 -03:00
Jagruti Tiwari
570ceaed29 docs: updated collection metrics doc (#16227)
Co-authored-by: Sajarin <sajarindider@gmail.com>
2022-09-01 15:01:34 -03:00
Usman Ali
bedccd6146 Source Plaid: minimum last updated datetime support added for Capital One items (#15231)
* Minimum last updated datetime added for CapitalOne institute

* Update docs

* Correct docs formatting

* Change additionalProperties value to true

* Update additionalProperties value

* suggested change:

- set min_last_updated_datetime using a named parameter when AccountsBalanceGetRequestOptions is constructed
- use a local variable getRequest to keep the line of client request (slightly) shorter
- re-order the list of changes in plaid.md
- fix the additionalProperties in spec.json, which resolves the backward compatibility test

* auto-bump connector version [ci skip]

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Yiyang Li <yiyangli2010@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-01 13:09:53 -04:00
Serhii Chvaliuk
7efe798b41 🐛 Source Amplitude: Re-release on new airbyte_cdk==0.1.81 (#16185)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-01 15:51:08 +03:00
Yevhen Sukhomud
5773c224bc Destination Redshift: custom JDBC parameters (#16208) 2022-09-01 18:09:04 +07:00
Baz
3611e656c7 🐛 Source Tiktok: unnest cursor and primary key to the root-level (#16137) 2022-09-01 13:35:26 +03:00
Liren Tu
a475235d89 📝 S3 source: update doc about path_prefix + path_pattern (#16206)
* Add more explanation for path_prefix + path_pattern

* Simplify wording

* Update wording
2022-08-31 20:51:00 -07:00
Daemonxiao
d4524032ae 🎉 New Destination: TiDB (#15592)
* Add new destination-tidb

* support sync

* Add normalization-tidb

* fix failed tests

* Add unnest marco

* fmt

* Add new destination-tidb

* support sync

* Add normalization-tidb

* fix failed tests

* Add unnest marco

* fmt

* fmt

* fix integration test

* Update docs/integrations/destinations/tidb.md

Co-authored-by: Xiang Zhang <angwerzx@126.com>

* Update doc

* Update doc

* Update doc

* bump normalization version

* update normalization changelog

* run format

* add dest def

* generat spec

Co-authored-by: Xiang Zhang <angwerzx@126.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-08-31 16:50:27 -03:00
Amruta Ranade
8998bad8c7 Updated connector catalog page (#16181) 2022-08-31 14:32:02 -04:00
Sophia Wiley
86a5f90f2e Edited July Release Notes (#16179)
* Changed August to July in title, file, and sidebar

* deleted extra spaces
2022-08-31 11:07:27 -07:00
Rodi Reich Zilberman
c6f876d618 enforce ssl in strict mysql and postgres source (#16114)
* enforce ssl in strict mysql and postgres source

* Add test to verify tunnel aware strict SSL behavior

* bump version numbers and changelogs

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-31 10:50:01 -07:00
Sophia Wiley
b9bba17153 Fixed release name
Release name should have a dash instead of a period.
2022-08-31 09:31:39 -07:00
Amruta Ranade
bef126939b Update august_2022.md 2022-08-31 11:42:19 -04:00
Sophia Wiley
732ec3ca81 Release Note Documentation (#16148)
* added release notes file

* changed file name

* Added release notes

* Edited formatting and links

* Deleted extra lines and backticks

* Deleted extra spaces

Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
2022-08-31 11:34:53 -04:00
Serhii Chvaliuk
3ed7f75032 🐛 Source Facebook Marketing: remove "end_date" from config if empty value (#16096)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-31 11:24:45 +03:00
Serhii Chvaliuk
aab03770c9 🐛 Source SalesForce: better detect API type (#16086)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-31 01:06:26 +03:00
Brian Lai
184f192bca Revert Sendgrid and Sentry sources to use python CDK instead of low-code (#16112)
* Revert Sendgrid and Sentry sources to use python CDK instead of low-code

* keep yaml configs for future reference

* don't revert additional properties and update changelog w/ PR number

* consistent time formatting in Messages stream and fix the unit test

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-30 17:07:08 -04:00
Liren Tu
0910dd145b 🐞 Postgres source: remove config logging (#16138)
* Remove config logging

* Update pr id

* Fix changelog date

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-30 12:26:34 -07:00
Sophia Wiley
56d19bbc4d Edit Managing Airbyte Cloud doc (#16111)
* Edited headers

* Edited gifs

* Changed a word

* Edited wording for consistency
2022-08-30 09:47:16 -07:00
Sophia Wiley
009f0eb93c Edit metrics formatting (#16105)
* edited code block text

* edited formatting
2022-08-30 09:46:31 -07:00