1
0
mirror of synced 2026-01-08 21:05:13 -05:00
Commit Graph

1746 Commits

Author SHA1 Message Date
Liren Tu
69972d606d Bigquery destination: fix changelog and publish new version (#15409)
* Fix bigquery changelog

* Bump bigquery denormalized

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-08 11:05:23 -07:00
Liren Tu
df99de0a28 Destination azure: bump version (#15412)
* Bump azure version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-08 10:55:49 -07:00
NAjustin
acc38c4452 Docs: Fix incorrect source name under OSS setup (#15324)
Connector name under "For Airbyte OSS" section was listed as "Bing Ads" instead of "Notion"
2022-08-08 14:04:26 -03:00
Ilya Pantsyr
28b3db683f Docs: fix misspelled name in docs (#15392) 2022-08-08 11:52:33 -03:00
Serhii Lazebnyi
0bd94c1323 🎉Source Facebook Marketing: Updated date validation process (#15327)
* Updated date validation process

* Bumped docker version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-08 14:58:01 +03:00
Serhii Lazebnyi
43e7fbb768 🐛Source Harvest: “started_time” being incorrectly cast as datetime field (#15312)
* Increased unit test coverage

* Fixed schema format error

* Updated PR number

* Uncomment connection tests

* Fixed typo

* Fix request_params if stream_slice None

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-08 14:37:46 +03:00
drrest
8d9a3aaa09 🎉 Source Okta: added parameter 'start_date' (#15050)
* Added parameter 'start_date' in Okta source

added: parameter 'start_date' to source Okta
changed: unit tests

* changes: fix in the case of ISSUE: https://github.com/airbytehq/airbyte/issues/14196

* Okta documentation in new format

* changes: fix to use super() instead of instance of stream parent

* changes: additional changes into OKTA documentaton

* changes: switch release to beta

* changed: set dockerImageTag -> 0.1.11

* changed:  source_specs

* ...

* ...

* Rollback releaseStage

* Refactored start date logic

* Deleted microseconds from state

* Add start date to all streams

* Updated to linter

* Fixed unit tests

* Updated unit tests

* auto-bump connector version [ci skip]

Co-authored-by: Serhii <serglazebny@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-08 13:00:47 +03:00
Baz
2d92864217 🎉 Source Freshdesk: fix spec for backward compatibility (#15378) 2022-08-06 13:14:56 +03:00
Serhii Chvaliuk
35125f8846 🎉 Source File: bump setup.py versions (#15269)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-06 12:28:03 +03:00
Greg Solovyev
d8dfcaaa6e 🎉 Postgres source: label the connector as generally available (#15380)
* Label source-postgres to GA

* Correct the PR number

* 📄 Postgres source: fix links in the spec (#15382)

* Add internal anchors back

* Remove internal anchor

* Use links for subtitles

* Remove one more anchor

* auto-bump connector version [ci skip]

Co-authored-by: Liren Tu <tuliren.git@outlook.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 17:52:02 -07:00
Andy
986ae4816a Update spec.json (#15342)
* Update copy in spec.json

Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 14:34:51 -07:00
Baz
9fa4b5ba3a docs updated (#15356) 2022-08-05 21:46:44 +03:00
Amruta Ranade
b9b064fa44 Updated postgres doc and fixed other minor nits (#15297)
* Updated postgres doc and other minor nits

* fixed formatting

* added note about connectTimeout

* added limits to the initial wait time values
2022-08-05 14:24:31 -04:00
Amruta Ranade
1115637b91 Fixed postgres formatting (#15370) 2022-08-05 14:13:59 -04:00
Erica Struthers
cf5d462610 Update hubspot.md (#15369) 2022-08-05 12:31:44 -04:00
Greg Solovyev
95aeb39325 Fix typo in change log (#15343)
* Fix typo in several change logs

Co-authored-by: andrii.leonets <aleonets@gmail.com>
2022-08-05 09:13:24 -07:00
oneshcheret
823a79b69a S3, Databricks and Gcs destinations fix test and publish (#15360)
* Postgres source added items for array data type

* Postgres source updated tests for array data type

* S3 destination fix key pair oauth test

* S3 destination clean code

* S3 destination bump version

* S3 destination bump version

* Databricks and gcs destinations bump versions

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 17:21:56 +03:00
Denys Davydov
2344b460d3 Source Hubspot: fix Deals stream schema (#15354)
* #393 oncall. Source Hubspot: fix Deals stream schema

* #393 source hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 14:34:20 +03:00
Oleksandr Sheheda
ac33e193f1 🎉 Destination DynamoDB: Handle per-stream state (#15350)
* [15304] 🎉 Destination DynamoDB: Handle per-stream state

* [15304] 🎉 Destination DynamoDB: Handle per-stream state

* [15304] 🎉 Destination DynamoDB: Handle per-stream state

* [15304] 🎉 Destination DynamoDB: Handle per-stream state

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 12:24:31 +03:00
Serhii Chvaliuk
a4e52cc564 🐛 Source Amazon Ads: Improve report streams date-range generation (#15031)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-05 10:04:08 +03:00
Ryan Fu
23bdd61b43 Make connectionTimeoutMs configurable (#15226)
* Extract connectionTimeout from jdbc_url_params along with corresponding tests

* Fixed linter issues

* Reverted createDataSourceWithConnectionTimeout and migrated logic to get operation

* Fixed dangling createDataSourceWithConnectionTimeout and linter issues

* Fixed import to use java standard library

* Bump Postgres Source and Postgres Source Strict Encrypt versions

* Fixed import ordering issues

* Bumped the connector version [CI fix] for definitions not generated
2022-08-04 16:30:38 -07:00
sivankumar86
31adaced4d Source-MSSQL : special character support in dbname #14824 #15186 (#15268)
* dot in db name

* doc update

doc update

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-04 15:41:48 -03:00
Le Dinh Cuong
117c34635a Docs: Update google-analytics-v4.md (#15288) 2022-08-04 10:45:58 -03:00
Baz
2eb1d2a318 🐛 Source Zendesk Support: add Subscription Plan check for available streams (#15233) 2022-08-04 13:05:10 +03:00
Liren Tu
ed3ac48055 🐞 Postgres source: fix first record wait time parsing bug (#15273)
* Fix first record wait time parsing bug

* Bump version

* Add connection check for first record waiting time

* Update spec

* Override initial waiting time when it is too short

* Set is_test to true for cdc integration tests

* Fix integration test

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-04 00:51:21 -07:00
Harshith Mullapudi
57c841f467 chore: fixed elasticsearch documentation (#15193) 2022-08-04 09:48:23 +05:30
Baiyue Cao
6c67d80f79 Source Bing Ads adding missing columns (#14862)
* only adding `Conversions` for now to satisfy basic use case, will compelte all fields addition once I get a time to add them https://github.com/airbytehq/airbyte/issues/14637

* Adding cost per conversion rate

* adding CampaignId as part of the primary key

* update primary key for ad performance report

* adding more columns to primary key

* completing campaign_performance_report

* completing account+keyword performance report

* complete ad_group_performance_report

* adding ad_performance_report

* revert to previous logger

* remove logging import

* chore: updated docs

* auto-bump connector version [ci skip]

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-04 09:47:52 +05:30
Benoit Moriceau
a4a5662a0a Fix Mongo dest (#15211)
* Fix Mongo dest

* Update changelog

* auto-bump connector version [ci skip]

* bump strict encrypt version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 17:38:18 -07:00
Subodh Kant Chaturvedi
f4b486300b 🎉 Postgres source: sync data from beginning if lsn is no longer valid in cdc (#15077)
* work in progress

* cleanup

* add test

* introduce tests for state parsing util class

* enable test via feature flag

* review comments

* Bump versions

* auto-bump connector version [ci skip]

Co-authored-by: Liren Tu <tuliren.git@outlook.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 15:15:37 -07:00
Amruta Ranade
d57a6a62f2 Update README.md 2022-08-03 17:49:12 -04:00
Yiyang Li
0bc617fd6c Source Okta: add permission stream under a custom role (#14739)
* Source Okta: add permission stream under a custom role

- it supports full refresh only
- add unit tests

* bump connector version

* bump connector version in Dockerfile

* auto-bump connector version [ci skip]

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 17:15:57 -04:00
Greg Solovyev
d3d60c1067 Align strict encrypt and regular connector versions for destination-mysql (#15258)
* Align strict endrypt and regular connector versions

* Retain changelog for strict encrypt
2022-08-03 13:47:35 -07:00
Greg Solovyev
67aab69a3c Align MS SQL regular and strict encrypt versions (#15260)
* Align MS SQL regular and strict encrypt versions

* Update changelog with the PR number
2022-08-03 13:08:46 -07:00
Yurii Bidiuk
708802d01f 🎉Source Postgres: 13608, 12026, 14590 - Align regular and CDC integration tests and data mappers; improve BCE date handling (#14534)
* 13608 & 12026 - align regular and CDC integration tests and data mappers

* format code

* update int handling

* fix build

* fix PR remarks

* revert changes for money type that are broken by #7338

* bump version

* 🐛 Source Postgres: Improve BCE date handling (#15187)

* 13608 & 12026 - align regular and CDC integration tests and data mappers

* format code

* update int handling

* borked merge - re-delete deleted methods

* enable catalog tests for postgres

* fix build

* fix PR remarks

* revert changes for money type that are broken by #7338

* update BCE handling in JDBC

* reuse existing method

* handle bce dates

* inline methods

* fix JDBC BCE year inconsistency

* use correct data type in test

* format

* Update airbyte-integrations/connectors/source-postgres/src/test-integration/java/io/airbyte/integrations/io/airbyte/integration_tests/sources/AbstractPostgresSourceDatatypeTest.java

Co-authored-by: Edward Gao <edward.gao@airbyte.io>

* pmd fix

* use class.getname()

* fix pmd

* format

* bump version

* handle incremental mode

* clean up diff

* more comments

* unused imports

* format

* versions+changelog

Co-authored-by: Yurii Bidiuk <yura.bidyuk@gmail.com>
Co-authored-by: Yurii Bidiuk <35812734+yurii-bidiuk@users.noreply.github.com>

* auto-bump connector version [ci skip]

Co-authored-by: Edward Gao <edward.gao@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 11:39:09 -07:00
Marcelo Castro
76c4053282 Destination BigQuery: Enabling Application Default Credentials (#14784)
* Enabling different bigquery authentications

Current implementation only accepts Service Accounts. For developers
it is very desirable that we can login with Application Default Credentials
(ADC) https://cloud.google.com/sdk/gcloud/reference/auth/application-default

* bump version and update doc

* auto-bump connector version [ci skip]

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 15:18:34 -03:00
Akul Goel
2a0c57b3ed Source Google Sheets: exposes row batch size config (#15107)
* exposes row batch size config to the connector

* review changes

* bump connector version

* auto-bump connector version [ci skip]

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 15:18:21 -03:00
midavadim
8fe89f5444 🎉 Source SurveyMonkey - to beta (#14998)
* fixed incremental syns for response stream, added unittest, fixed specs, fixed incremental SAT

* removed comments

* updated docs

* updated docs

* bumped connector version

* bumped release stage

* auto-bump connector version [ci skip]

* updated source_specs.yaml

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 20:45:22 +03:00
Xiang Zhang
c05b3f0ceb Docs: Add "External resources" section to TiDB source connector doc (#15238) 2022-08-03 13:45:35 -03:00
Andrii Leonets
e7b9e00949 Fix multiply log bindings (#14801)
* Fix multiply log bindings

* Exclude slf4j-reload4j

* Exclude slf4j-log4j12 for debezium

* Increase version for debezium related sources and json converter related destinations

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

* rebump bigquery versions

* mark destinations s3, gcs as unpublishd

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: subodh <subodh1810@gmail.com>
Co-authored-by: Greg Solovyev <grishick@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
2022-08-03 09:36:30 -07:00
Amruta Ranade
cc7e850a42 Update bigquery.md 2022-08-03 12:08:53 -04:00
Yurii Bidiuk
568e9f5888 🎉 Source Oracle: Use Service Name to connect to database (#14953)
* add service_name as second connection option

* fix test

* merge with master

* bump version

* bump strict-encrypt

* fixed test

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-03 18:40:06 +03:00
Amruta Ranade
b57ec0f7c4 Update README.md 2022-08-03 11:28:02 -04:00
Amruta Ranade
1282193244 Updated connector status page (#15240) 2022-08-03 10:56:28 -04:00
wjwatkinson
7b4f59b8b0 Source Stripe: external account streams (#14357)
* added external account streams

* fix metadata type and formatting

* consolidate types to one line

* fix api docs link

* auto-bump connector version [ci skip]

* format files

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-08-02 15:11:27 -03:00
Benoit Moriceau
8bf5986a0b Fix bq standard mode (#15180)
* Fix

* Add version and changelog

* auto-bump connector version [ci skip]

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-02 10:00:12 -07:00
Baz
bbbd1ad4a1 🐛 Source Okta: fix for failed stream on Json Validation NPE (#15179) 2022-08-02 16:47:03 +03:00
Serhii Chvaliuk
ae58fa52da 🎉 Source Github: PullRequestCommentReactions - re-implemented using GraphQL (#14795)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-08-02 14:57:27 +03:00
Denys Davydov
09d6901498 Source Hubspot: fix 401 for associations (#15156)
* Revert "Source Hubspot: revert v0.1.78 (#15144)"

This reverts commit cbdb897aa1.

* #379 source hubspot: fix 401 when reading associations

* #379 source hubspot: fix 401 when reading associations

* #379 source hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-02 10:34:54 +03:00
Apostol Tego
f7115d1953 🐛 Source shortio: Changing links primary key (#15066)
* Changing primary key in links stream and some small cleanups throughout the source

* Adding unit tests and applied gradle formatting

* update doc

* auto-bump connector version [ci skip]

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-01 17:44:25 -03:00
Edward Gao
b6dd734834 publish source postgres+mysql strict-encrypt (#15176) 2022-08-01 13:41:33 -07:00