1
0
mirror of synced 2026-01-03 06:02:23 -05:00
Commit Graph

1709 Commits

Author SHA1 Message Date
Christophe Duong
b424c1a0e7 🐛 Fix incremental normalization with empty tables (#8394)
* Fix incremental with empty final tables

* upgrade docker images

* Regen SQL

* Bumpversion & format
2021-12-01 23:40:14 +01:00
Jared Rhizor
9266ebb376 Bump Airbyte version from 0.32.9-alpha to 0.32.10-alpha (#8403)
Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>
2021-12-01 11:43:59 -08:00
Baz
96081e19aa 🐛 Source Mixpanel: fix for discovery command takes a very long time (#8381) 2021-12-01 20:42:21 +02:00
Jared Rhizor
d3413fcc90 Bump Airbyte version from 0.32.8-alpha to 0.32.9-alpha (#8391)
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
2021-12-01 09:57:05 -08:00
Serhii Chvaliuk
757650f9de 🐛 Source Hubspot: remove 'skip_dynamic_fields' config param (#8329)
* ignored fields added
* remove 'skip_dynamic_fields'

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-30 23:28:26 +02:00
Harsha Teja Kanna
97594c7b20 Added temporal build script (#8325) 2021-11-30 13:24:31 -08:00
Vadym
f2f224fe08 Update SAT for validate_data_points Test Basic Read option. (#8342) 2021-11-30 21:06:14 +02:00
Baz
a55ef51f48 Source Shopify: fix for missing properties & items in schemas (#7783) 2021-11-30 18:02:06 +02:00
VitaliiMaltsev
065bbf60da 🎉 Destination S3 Support writing timestamps (#7732)
* get date-time format form json schema

* created universal date-time converter

* implemented jsonnode transformation for avro and parquet

* removed unneeded dependency from build.gradle

* fix checkstyle

* add DateTimeUtilsTest

* add AvroRecordHelperTest

* resolve merge conflicts | fix checkstyle

* update LocalTime parsing

* added String type to avro schema for Logical Types, removed date-time conversion

* fix checkstyle

* fix checkstyle

* added static String schema, added comments

* bump version

Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>
2021-11-30 12:08:36 +02:00
Marcos Marx
6787777497 Publish PR 7973: shopify new stream add items (#8320)
* Adds Inventory Items to the source-shopify connector

* fix: rather use updated_at as cursor

* docs: updates the shopify readme changelog

* fix: use Products parent stream to get the inventory item ids

fix: parse response as json object not array

* feat: get inventory items in 1 batch per Product

* fix: remove cusor_field property - already defined in parent

* other: bump shopify source version number anywhere I could find

* correct ci failure

Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
2021-11-30 00:00:49 -03:00
Marcos Marx
8f05f7ffe7 Publish PR 8168: new zendesk support stream TicketMetricEvents (#8316)
* feat: adds stream config for TicketMetricEvents

* other: bumps version numbers

* feat: adds ticket metric events schema file

* fix: sorts out a few small spelling mistakes

* fix: add generated_timestamp in place of updated_at

* fix: remove some extra spaces

* fix: use time instead of generated_timestamp as cursor

* docs: update zendesk support MD file

* fix: remove generated_timestamp refs from TicketMetricEvents

* bump connector version

* run seed config

Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
2021-11-29 18:22:02 -03:00
Serhii Chvaliuk
f781df893f 🎉 Source Google Ads: clarify setup fields (#8178)
* reorder UI fields

* improve title for login_customer_id, custom_queries

* GOOGLE_ADS_TEST_CREDS github secret -> google secret

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-29 23:21:06 +02:00
Jared Rhizor
5aa76c6a0d Bump Airbyte version from 0.32.7-alpha to 0.32.8-alpha (#8317)
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
2021-11-29 12:33:03 -08:00
Serhii Lazebnyi
9428b400d5 🐛 Source Mixpanel: Fix schemas and UI issues (#8256)
* Fixed schemas and ui issues

* Deleted anyOf structure from schema

* Updated PR number

* Added fields with static data types to cohort_members schema

* Add DefaultSchemaNormalization to Engage and CohortMembers streams

* Changed Transformer name

* Checkin specs
2021-11-29 19:33:38 +02:00
Serhii Chvaliuk
a2b31cc418 Source Trello: enable specifying board ids in configuration (bump version) (#8259)
* bump version 0.1.2 -> 0.1.3
* trello.md updated
* fix: 'Start date' -> 'Start Date'
* source_specs.yaml updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-29 19:30:33 +02:00
andriikorotkov
9e087c6f9c 🐛 Source MongoDB - Added Milliseconds to Cursor for mongo date type (#8306)
* Added milliseconds for date format for cursor

* Added milliseconds for date format for cursor

* Added milliseconds for date format for cursor

* updated documentation
2021-11-29 18:36:49 +02:00
Jared Rhizor
375fc557f8 Bump Airbyte version from 0.32.6-alpha to 0.32.7-alpha (#8311)
Co-authored-by: sherifnada <sherifnada@users.noreply.github.com>
2021-11-29 07:47:00 -08:00
Juozas V
afbbd6ef78 Source Linnworks: refactor stream StockLocations (#8169) 2021-11-29 14:59:39 +01:00
LiRen Tu
aeb15cea8f 🐛 Source postgres: fix money type with amount > 1000 (#7995)
* Fix postgres money type > 1000

* Convert money to double

* Bump source postgres version

* Do not bump version in seed yet

* Check type ignoring case

* Test insertion with currency symbol

* Test parsing money string method

* Add test case with currency symbol and negative values

* Update version date

* Bump seed version
2021-11-28 23:46:43 -08:00
Vadym
908be3ff24 Source Iterable: Update iterable.md docs (#8273)
* Update iterable.md docs

* Update docs/integrations/sources/iterable.md

Co-authored-by: oleh.zorenko <19872253+Zirochkaa@users.noreply.github.com>
2021-11-29 09:32:34 +02:00
Serhii Chvaliuk
0d7e69e760 🐛 Source Hubspot: unset 'hs_time_in_*' properties (#8216)
* 'skip_dynamic_fields' added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-26 21:35:31 +02:00
Arthur Galuza
9d62959df2 🐛 Source Google Search Console: set default end_date param value (#7431)
* Set default end_date value

* Upd changelog

* Few updates

* Remove timeout_seconds from SAT config

* Add cursor_paths to SAT configuration

* After rebase fix

* Bump connector's version + update docs

Co-authored-by: oleh <lovemybeard@gmail.com>
2021-11-26 19:25:14 +02:00
Alexander Tsukanov
6e47a8f990 🐛 Source Postgres: views are not listed during schema discovery (#8266)
* airbyte-8254 Source Postgres: views are not listed during schema discovery

* airbyte-8254 Source Postgres: views are not listed during schema discovery

* airbyte-8254 Source Postgres: views are not listed during schema discovery

* airbyte-8254 Remove GRANTEE and PRIVILEGE constants from AbstractJdbcSource.java

* airbyte-8254 Version bumped.

* airbyte-8254 Version bumped.

* airbyte-8254 Version bumped.
2021-11-26 18:22:20 +02:00
Baz
a4a5cb8893 🐛 Source Stripe: Rearrange setup fields (#8250) 2021-11-26 16:06:30 +02:00
Dmytro
12d8757878 Remove insights_export from Facebook Pages field (#8265) 2021-11-26 11:54:16 +02:00
Sherif A. Nada
b94256bf9f publish #8182 (#8246)
Co-authored-by: grkhr <eduardgorkh@gmail.com>
2021-11-24 11:59:24 -07:00
Yevhenii
96581f12af Publish PR #8030 (#8233)
* Source GitHub: define pull_request_stats and reviews streams as pull_request substreams
* Source GitHub: Bump version to 0.2.6
* Source GitHub: Apply PR review suggestions
Co-authored-by: Jérémy Lourenço <jeremy@lourenco.io>
2021-11-24 16:56:25 +02:00
Madison Swain-Bowden
b28f20bb53 🎉 New Destination: SFTP JSON (#4924) 2021-11-24 15:23:21 +01:00
Yevhenii
81d66a6388 Source Salesforce: Handling 400 error when using BULK API (#8206)
* Source Salesforce: Handling 400 error when using BULK API
2021-11-24 15:42:10 +02:00
augan-rymkhan
82775d60d7 Fix check connection for earlier date in Google Analytics (#8087)
* Changed tests for `check_connection` method

* Start reading from the latest date-slice to check the reading permissions in `check_connection`

* Fetch records from start_date up to now for testing case

* Add minimal valid records into response_with_records.json

* Changed version of the connector

* formatted codes

* Override stream_slices in Test stream

* return list of date slices inline

* replace valiation msg to "Cannot retrieve data from that view ID"

* formatted code

* fixed error msg in unit tests

* changed version in seed/ yaml files

Co-authored-by: Auganbay <auganenu@gmail.com>
2021-11-24 15:07:58 +06:00
Andrii Leonets
1417b8e3b7 CockroachDb source: Add only encrypted version for the connector (#7457)
* [6717] Add only encrypted version for the CockroachDb

* format

* Create custom docker for CockroachDB with SSL

* add custom docker + test

* enable container

* set Cockroach version and add container to integration test

* fix docker

* remove test

* fix version

* fix container instancing scope

* left only integration test

* remove ssl from expected spec

* fix urls

* clean import

* chang log + build
2021-11-24 10:46:51 +02:00
Juozas V
0b803184f7 Source Linnworks: add stream ProcessedOrderDetails (#8177) 2021-11-23 19:35:30 +01:00
Koji Matsumoto
694cbed455 🎉 New Destination: MariaDB ColumnStore (#7961) 2021-11-23 19:31:27 +01:00
Augustin
dfa3714895 Consistent WooCommerce naming (#8133) 2021-11-23 18:04:53 +01:00
Sujit Sagar
99ad4e5ec2 🎉 Source ZendeskSupport : Added access_token authorization method (#8058)
* Added access_token authorization method

* Update spec.json

minor correction

* Update spec.json

* Update source_definitions.yaml

* Update 79c1aa37-dae3-42ae-b333-d1c105477715.json

* Update Dockerfile

* Update acceptance-test-config.yml

* Update zendesk-support.md

Co-authored-by: Maksym Pavlenok <antixar@gmail.com>
2021-11-23 16:41:58 +02:00
mkhokh-33
5032addf3e 🐛 Source MySQL: transform binary data base64 format (#8047)
* Source-MySql: transform binary data base64 format, add integration tests

* Source-MySql: fix code style

* Source-MySql: bump versions

* Source-MySql: bump versions in source_specs.yaml

* Source-MySql: added test for stream with binary data for DestinationAbstractTest

* Source-MySql: added format
2021-11-23 16:04:48 +02:00
andriikorotkov
6bf9ebacb2 🐛 Updated source-mondodb-v2 performance and updated cursor for timestamp type (#8161)
* updated source-mongodb-v2 performance

* updated code style

* fixed remarks

* fixed remarks

* fixed remarks

* updated strict encrypt source mongodb version

* updated source mongodb work with empty collections

* updated source mongodb timestamp cursor

* updated mongodb source perfomance

* fix code style

* fix code style

* updated tests and documentation

* updated tests and documentation

* updated tests and documentation

* added vudangngoc changes

* updated code style

* updated code style
2021-11-23 13:56:25 +02:00
Sherif A. Nada
7daa6a3417 Update node js version to 16 2021-11-23 02:54:25 -08:00
Jared Rhizor
e74ef24485 Bump Airbyte version from 0.32.5-alpha to 0.32.6-alpha (#8192)
Co-authored-by: davinchia <davinchia@users.noreply.github.com>
2021-11-23 17:44:12 +08:00
Luis Gomez
4b59fe4382 🎉 New Source: Outreach (#7507)
* Generated connector source code

* Added streams: prospect, sequence, sequenceState

* Updated spec and schemas

* Removed print statement

* Added unit tests

* Updated acceptance test files

* Updated spec

* Ran gradlew format

* Added comments

* Added Outreach source documentation
2021-11-23 10:33:25 +05:30
AlexanderBatoulis
fd90c95e18 🎉 New Source: Zenloop (#7380) 2021-11-22 17:14:43 +01:00
Baz
c790a7f15e 🎉 Source Drift: add OAuth 2.0 authentication option (#7337) 2021-11-22 17:28:49 +02:00
oleh.zorenko
831304eeff 🎉 Source Zendesk Chat: make Chats stream incremental + add tests for all streams (#8166)
* Make `Chats` stream incremental + add tests for all streams

* Update docs

* Bump connector's version + update docs
2021-11-22 16:45:21 +02:00
Dmytro
cf3be4a441 Iterable adjustable stream slices (#8091) 2021-11-22 15:48:17 +02:00
Dmytro
c0cb8f338a Fix Github check connection for organizations with large number of re… (#8170) 2021-11-22 15:34:42 +02:00
Ivica Taseski
0eba52e002 🎉 New destination: Kinesis (#7799)
* add kinesis destination connector

* format code

* add javadoc and general documentation

* fix buffer bug and refactor code

* rename vars to common airbyte usage

* run format

* run format + seed file

* add eof

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-21 23:17:38 -03:00
Adam Dobrawy
519ea2a58a 🎉 New Destination: Google Firestore (#7231)
* destination-firestore: add connector

* destination-firestore: Add connector to indexes in docs

* destination-firestore: fix sync mode spec

* destination-firestore: fix typo after connector rename

* destination-firestore: fix required field in spec

* destination firestore: fix code formatting

* destionation-firestore: add python adnotation for writer

* destination firestore: add all used libraries into the setup file

* destionation-firestore: fix python formatting
2021-11-22 02:20:45 +05:30
Mario Molina
5b0b5840d6 🎉 New Destination: MQTT (#7718)
* MQTT destination

* Reformat code

* Updating readme

* run seed

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-21 14:20:42 -03:00
Tuan Nguyen
141524d8aa 🐛 Source Monday: fix pagination and schema bug (#8016)
* fix bug

* fix schema

* bump version

* format

* run seed

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-20 12:54:31 -03:00
Ivica Taseski
8a957caf14 🎉 New destination: Redis (#7653)
* add redis destination connector

* add redis destination connector

* refactor & docs

* format

* refactor code

* debug checkpoint

* refactor and code cleanup

* format code

* add redis docs

* bump version, docs and run seed:

* correct uuid

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-20 11:26:37 -03:00