1
0
mirror of synced 2026-01-05 12:05:28 -05:00
Commit Graph

1518 Commits

Author SHA1 Message Date
Edward Gao
5f843415db 📚 update MSSQL docs to reflect that we support normalization (#13826) 2022-06-16 08:16:00 -07:00
LiRen Tu
26f462327b 🎉 Postgres source: prepare for removing strict-encrypt variant (#13823)
* Bump postgres version

* Update doc

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-15 18:44:53 -07:00
Amruta Ranade
bc98dc0fd2 Edited Stripe, HubSpot, Intercom docs (#13810)
* Initial edits

* Updated the Stripe connector doc

* Updated the Stripe doc

* Updated HubSpot and Intercom docs

* Minor sidebar edit
2022-06-15 13:07:08 -04:00
Baz
330d32ecca 🐛 Source Zendesk Support: fixed 429 error for TicketMetrics stream (#13757) 2022-06-15 17:35:38 +03:00
Serhii Chvaliuk
dd8aa06664 🎉 Source Github: Fix API sorting, fix get_starting_point caching (#13707)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-15 16:50:42 +03:00
Bastien Gandouet
f015a9df07 🐛 Source Amplitude: Fix an infinite loop (#13638)
* Fix infinite loop when fetching Amplitude data

* Update changelog and version

* Address review

* fix: unit tests were failing

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-06-15 17:32:21 +05:30
LiRen Tu
6964fe2740 📝 Postgres source: add troubleshooting for postgres hot standby (#13784)
* Add troubleshooting section in postgres doc

* Update doc

* Add one more solution
2022-06-14 22:02:42 -07:00
Denis Davydov
81572a9cb2 Source Facebook marketing: fix not syncing any data issue (#13749)
* #253 oncall source fb marketing: fix  issue

* #253 oncall: upd changelog

* Update docs/integrations/sources/facebook-marketing.md

* auto-bump connector version

Co-authored-by: Evan Tahler <evan@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-14 15:28:19 -07:00
Charles
22b727c0ea Update Airbyte Protocol Docs (#13709) 2022-06-14 15:04:38 -07:00
VitaliiMaltsev
f5a6a28211 🐛 Postgres Source: fixed truncated precision if the value of the milliseconds or seconds is 0 (#13549)
* Postgres Source: fixed truncated precision if the value of the millisecond or second is 0

* check CI with 1.15.3 testcontainer

* check CI with 1.15.3 testcontainer

* returned latest version of testcontainer

* fixed checkstyle

* fixed checkstyle

* returned latest testcontainer version

* updated CHANGELOG

* bump version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-14 23:39:01 +03:00
Marcos Marx
669e6ed39d Source Salesforce: fix sync capped streams with more records than page size (#13658)
* change logic for counting records

* update doc

* correct unit test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-14 09:08:38 -03:00
oneshcheret
8e54f4fd6e S3 and GCS destinations: Updating processing data types for Avro/Parquet formats (#13483)
* S3 destination: Updating processing data types for Avro/Parquet formats

* S3 destination: handle comparing data types

* S3 destination: clean code

* S3 destination: clean code

* S3 destination: handle case with unexpected json schema type

* S3 destination: clean code

* S3 destination: Extract the same logic for Avro/Parquet formats to separate parent class

* S3 destination: clean code

* S3 destination: clean code

* GCS destination: Update data types processing for Avro/Parquet formats

* GCS destination: clean redundant code

* S3 destination: handle case with numbers inside array

* S3 destination: clean code

* S3 destination: add unit test

* S3 destination: update unit test cases with number types.

* S3 destination: update unit tests.

* S3 destination: bump version for s3 and gcs

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-14 14:15:58 +03:00
Greg Solovyev
2cd62002be Fallback to parsing datetime and time strings w/ and w/o timezones in case DateTimeParseException is thrown (#13745)
* Fall back to parsing w/ or w/o TZ if parsing a date or a time string fails
* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-13 23:28:46 -07:00
Andy
fe6eda5b37 🎉 Destination databricks: rename to databricks lakehouse (#13722)
* Update Databricks naming

* Update destination_spec

* Update BOOTSTRAP.md

* Update Dockerfile

* Update README.md

* Update spec.json

* Update databricks.md

* Update databricks.md

* Update airbyte-integrations/connectors/destination-databricks/BOOTSTRAP.md

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>

Co-authored-by: LiRen Tu <tuliren.git@outlook.com>
2022-06-13 17:56:01 -07:00
VitaliiMaltsev
a3ca3ab6b2 🐛 Postgres Source: fixed unsupported date-time datatypes during incremental sync (#13655)
* Postgres Source: fixed unsupposted date-time datatypes during incremental sync

* updated CHANGELOG

* add tests for incremental cursor check

* removed star import

* Postgres Source: fixed unsupposted date-time datatypes during incremental sync

* updated CHANGELOG

* add tests for incremental cursor check

* removed star import

* add timestamp datatype test

* Bump version in Dockerfile

* auto-bump connector version

Co-authored-by: grishick <greg@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-13 13:58:26 -07:00
Amruta Ranade
7ecfa13ee0 Updated BigQuery, Google Sheets, Facebook Marketing, Salesforce docs (#13717)
* initial changes

* Edited google Sheets doc

* More edits

* edited the intro and prereqs for BigQuery

* edited the data loading section

* more edits

* Grammatical edits

* Formatting edits
2022-06-13 14:25:41 -04:00
Luis Gomez
f4da234d18 source-notion: Updated docs as per new format (#13708) 2022-06-13 17:51:06 +02:00
Evan Tahler
edb74ec282 Faker Source emits times in proper ISO format (#13695)
* Faker Source emits times in ISO format

* fix product times

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-10 17:21:26 -07:00
Denis Davydov
5df20b7316 Source Hubspot: fix URI too long issue (#13691)
* #268: fix URI too long (HubSpot)

* #268 upd changelog

* #268 oncall: review fix

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-10 22:30:52 +03:00
Simon Späti
93c413c0ed 📚 Destination Databricks: Clarify on Destination Format with Delta-Table (#13396) 2022-06-10 18:06:27 +02:00
Michael Nguyen
a30018b374 source-delighted: since parameter changed from unix to iso timestamp (#13439) 2022-06-10 16:07:14 +02:00
Marcos Marx
862bf36f26 Docs: Destination ElasticSearch remove port from doc requirements (#13665) 2022-06-10 10:29:41 -03:00
Alexander Tsukanov
b45014da6b 🎉 Destination Redshift: Add "Loading Method" option to Redshift Destination spec and UI (#13415)
* airbyte-12709 Add "Loading Method" option to Redshift Destination spec.

* airbyte-12709: Fixed unit tests.

* airbyte-12709: Updated README.md.

* airbyte-12709: change the number of PR in redshift.md.

* airbyte-12709: Added backward compatibility for old json schema.

* airbyte-12709: Fix PR comments.

* airbyte-12709: Removed throwing an exception. Fixed PR comments.

* airbyte-12709: Bump the airbyte version.

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-10 14:47:03 +03:00
Evan Tahler
db67936111 Fix source-google-ads on M1 Macs by pinning protobuf==3.14 (#13624)
* Bump `source-google-ads` to build for both AMD and ARM

* pin protobuf==3.14

* update readme

* #263 oncall: bump google ads version 15.1.1, protobuf 3.20.0

* auto-bump connector version

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-09 11:55:12 -07:00
Marcos Marx
fca7f0144e Source Facebook Marketing: fix tax_id to string canadian has letters (#13317)
* fix tax_id to string canadian has letters

* bump connector version

* auto-bump connector version

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-09 15:32:29 -03:00
Amruta Ranade
1393b4a43d Updated connector catalog 2022-06-09 10:45:22 -04:00
wissevrowl
cc261de932 source Myhours: Udate API schema (#12964) 2022-06-09 14:42:13 +02:00
Denis Davydov
922bf46e8f Source Hubspot: fix for property_history stream (#13596)
* #259 on call: Source Hubspot - fix for the property_history stream which did not emit any records

* #259 Source Hubspot: upd changelog

* #259 oncall: hubspot review fixes

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-09 10:21:08 +03:00
Denis Davydov
60f5f4ce46 Source Google Ads: add missing dependency (#13618)
* Source Google Ads: add missing dependency

* Source Google Ads: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-09 09:12:36 +03:00
Serhii Chvaliuk
9a4582ad7d 🐛 Source Github: enable caching only for parent streams (#13558)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-09 07:21:10 +03:00
LiRen Tu
bb46941867 🎉 Databricks destination: rename to Databricks delta lake (#13630)
* Rename databricks connector

* Rename connector in the seed

* Update changelog with pr id

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-08 18:22:55 -07:00
Serhii Chvaliuk
38fa0fa8b3 🐛 Source Github: improve docs for GA (#13593)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-08 20:19:11 +03:00
Serhii Chvaliuk
5444317513 🐛 Source Github: fix different result from get_starting_point when reading by pages (#13531)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-08 20:06:06 +03:00
Baz
ec6a58c8a2 🐛 Source LinkedIn Ads: fixed issue with normalization on redshift (#13495) 2022-06-08 17:53:40 +03:00
pcsoni89
b4e43c2ddd 🎉 Destination MSSQL: added custom JDBC parameters support. (#13054)
* 🎉 Destination MSSQL: added custom JDBC parameters support.

* 🎉  Destination MSSQL: added custom JDBC parameters support.

* 🎉  Destination MSSQL: added custom JDBC parameters support.

* airbyte-101718: Bumped version.

* auto-bump connector version

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
Co-authored-by: Alexander Tsukanov <alexander.tsukanovvv@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-08 14:55:45 +03:00
LiRen Tu
fd2048da53 🎉 Postgres source: publish new version with JDBC fetch size v2 (#13576)
* Update postgres doc

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 19:01:50 -07:00
LiRen Tu
e996c2c14f 🐛 BigQuery destination: always run GCS destination check for GCS staging method (#13579)
* Run gcs destination check all the time

* Add missing permissions to the status message

* Add more error messages

* Bump bigquery version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 17:52:49 -07:00
LiRen Tu
545a7a3eb6 🎉 JDBC source: adjust fetch size based on max memory and max row size (#13435)
* Switch to measure max row byte size

* Reduce fetch size change logs

* Update unit tests

* Determine jdbc buffer size based on max memory

* Bump postgres version

* Bump postgres version

* Bump mysql version

* Bump mssql version

* Format java code

* Increase hikari connection timeout

* Update data source default parameters

* auto-bump connector version

* Mark postgres 0.4.21 as not published

* Revert "Bump mysql version"

This reverts commit ad9135258c.

* Fix unit test

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 14:29:34 -07:00
Alexandre Girard
f1d79b201f Source Hubspot: report which scopes are missing to user (#13566)
* Report missing scopes

* simplify

* bump

* emit trace message

* remove print

* more careful error handling

* Add typing

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 14:10:03 -07:00
Yurii Bidiuk
d6b50c1ce0 Destination BigQuery: refactored spec and doc (#13424)
* change spec

* refactored readme file for bigquery

* change spec order

* bump version
2022-06-07 18:36:40 +03:00
Ganpat Agarwal
1721827814 🎉 Source Amazon Seller Partner: add financial streams (#13364)
* add new schemas

* add catalog in integration tests

* add streams for ListFinancialEvents and ListFinancialEventGroups

* bump to version 0.2.21

* update docs

* add unit tests

* expand schema up to 2 levels for better normalisation

* fix unit test

* lint fix

* add missing attribute

* chore: bump version in source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-06-07 18:26:51 +05:30
midavadim
0796b35e55 🎉 Source Stripe - to ga (#13449)
* Added incremental sync support (filtering by date - expired_at attr) for CheckourSessions stream and CheckoutSessionsLineItems
Added unittests

* updated docs

* updated connector version

* airbyte config

* auto-bump connector version

* updated connector version in config

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 01:55:09 +03:00
Yurii Bidiuk
4b266c1b7d 🐛 Source Postgres: write hstore as json (#13367)
* src-postgres: write hstore as json

* fix PR remarks

* bump version

* fix PR comments

* add text blocks
2022-06-06 22:25:29 +03:00
Serhii Chvaliuk
7800b52f4d 🐛 Source Hubspot: scope crm.objects.feedback_submissions.read added for feedback_submissions stream (#13475)
* crm.objects.feedback_submissions.read added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* hubspot.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-06 14:11:01 +03:00
Marcos Marx
9aa0220820 revert redshift and json operations (#13465) 2022-06-03 19:44:40 -03:00
Alexandre Girard
1225f80bd8 Source hubspot: filter out streams we don't have access to (#13455)
* filter out streams we don't have access to

* cleanup

* fix associations

* fix for api key auth

* this doesn't need to be a property method

* Bump

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-03 12:06:51 -07:00
Adam
071a8e9dc8 Destination Redshift: fixed array contents verification for SUPER (#13069)
* add array handling to json flatten

* bump version, add changelog entry

* test: add flatten unit tests

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-03 15:46:16 -03:00
Baz
94dc19168c 🐛 Source Amplitude: Fixed JSON Validator date-time validation (#13373) 2022-06-03 17:41:53 +03:00
Luis Gomez
75e4114eb1 🎉 Source Freshdesk: Added new streams (#13332) 2022-06-03 14:55:35 +02:00
Alexandre Girard
19a20f0efc 🐛 Source Google Sheets: Retry on server errors (#13446)
* Retry on server errors

* retry on any 5XX

* bump version

* rename function for clarity

* reset

* delete unused code

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-02 18:28:45 -07:00