Serhii Lazebnyi
279ee455bf
🐛 Source Facebook Marketing: Add new permission to OAuth flow ( #11108 )
...
* Add new permission to oauth flow
* Updated PR number
* Downgrade version to current
2022-03-14 17:47:31 +02:00
VitaliiMaltsev
2f0f0bf3ed
🎉 Destination Snowflake: add Azure Blob Staging ( #10341 )
...
* fix for jdk 17
* Destination Snowflake: add Azure Blob Staging support
* add SAS token authority
* bump fixed issue for big data tables
* removed unused logs
* add CHANGELOG
* updated spec and check methods
* fixed checkstyle
* clean up build.gradle
* add tests
* update azure lib version
* fixed checkstyle
* fixed checkstyle
* updated Azure blob config
* add unit test
* update docs
* removed redundant check if blob exists
* removed redundant check if blob exists
* refactoring
* fixed PR
* resolve merge conflicts
* bump version
* bump destination-jdbc version
Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com >
2022-03-14 15:46:27 +02:00
Greg Solovyev
f48a6a0909
destination-s3: add a test for listObjects permission on destination bucket ( #10856 )
...
* Add a test for listObjects permission to destination-s3 connector
* add testIAMUserHasListObjectPermission method to S3Destination
and call this method from S3Destination::check. Method throws
an exception if IAM user does not have listObjects permission
on the destination bucket
* add a unit test to S3DestinationTest to verify that S3Destination::check
fails if listObjects throws an exception
* add a unit test to S3DestinationTest to verify that S3Destination::check
succeeds if listObjects succeeds
* Add S3DestinationConfigFactory in order to be able to mock S3 client
used in S3Destination::check
* Addressing review comments:
- separate positive and negative unit tests
- fix formatting
- reuse s3 client for both positive and negative tests
* Add information about PR #10856 to the changelog
* Prepare for publishing new version:
* Bump version to 0.2.10 in Dockerfile
* Bump version to 0.2.10 in changelog
* Update destination-s3 version in connector index
* Update seed spec for destination-s3 connector
2022-03-11 15:12:07 -08:00
oneshcheret
7cce8c7e9d
Snowflake destination: added unit tests ( #10699 )
...
* Snowflake destination: added unit tests
* Snowflake destination: randomize sensitive data
* Snowflake destination: revert s3 unit tests
* Snowflake destination: added unit tests
* Snowflake destination: added unit tests
* Snowflake destination: added unit tests
* Snowflake destination: bump version
* Snowflake destination: bump spec version
* Snowflake destination: bump version
* Snowflake destination: bump spec version
2022-03-11 21:17:14 +02:00
Kshitij Grover
01ed0e757e
🎉 Source Orb: support enriching ledger entries with numeric properties ( #10839 )
...
* Modifications to Orb schema
* Docs updates
* docs updates
* Remove deprecated field from connector export
* Add to source_definitions and update Dockerfile
* Update docs + run airbyte-config:init:processResources
2022-03-10 12:01:56 -08:00
Marcos Marx
c72012012f
Docs: add troubleshooting for mysql ( #11012 )
...
* add troubleshooting for mysql
* correct abhi comments
2022-03-10 15:14:34 -03:00
midavadim
a1a4bbca1e
🎉 Source stripe - enhanced performance for streams which run substreams ( #10359 )
...
* enhanced performance for streams which run 1 requests for each main item.
* removed unused types
* moved common code to StripeSubStream
* updated docs, updated docker version
* updated connector version in source_specs.yaml
2022-03-10 18:14:32 +02:00
Serhii Chvaliuk
d19754c169
🐛 Source Github: Fix error handling for 404 streams ( #10878 )
...
* Fix, no error if "Projects" feature is disabled
* improve requests.codes.NOT_FOUND
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2022-03-10 18:02:51 +02:00
Serhii Lazebnyi
c6caf14724
🐛 Source Facebook Marketing: Add temporary OAuth error handling ( #10917 )
...
* Add temporary oauth error handling
* Updated PR number
* Update docs/integrations/sources/facebook-marketing.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
* Updated version and unittests
* Deleted typo
* Updated to linter
* Bumped version
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2022-03-10 14:36:24 +02:00
Serhii Chvaliuk
1bf94704fc
🐛 Source Github: add new stream ProjectCards ( #10766 )
...
* add new stream `Deployments`
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2022-03-10 11:01:51 +02:00
Baz
0c064f1fbe
🐛 Source Shopify: Improve SubStream state handling ( #10915 )
2022-03-09 15:24:21 +02:00
Eugene Kulak
2932039a35
🎉 Source FB Marketing: add time_increment parameter to custom insight streams ( #10531 )
...
* added time_increment parameter
* fix custom insights
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2022-03-08 15:31:41 +01:00
Mohamed Magdy
63af98e3b9
🎉 Recurly Schema Revamp ( #9866 )
...
* Cleanup Recurly connector schemas
* Add more Recurly schemas to the connector
- `billing_infos`
- `shipping_addresses`
- `shipping_methods`
- `subscription_changes`
* Add Recurly `add-on` resouce
* Add Recurly's account notes resource schema
* Add unique coupons to Recurly source
* Add credit payments to Recurly connector
* Add Recurly resources to integration tests configurations
* Bump Recurly source version to `0.4.0`
* Add `line_items` Recurly resource
* Add `line_items` to Recurly documentation
* Add missing `line_items` JSON schema
* Replace Subscription Change Recurly API call with Subscription `pending_changes` field
* Replace Recurly unique coupon codes API call with coupons `unique_coupon` field
To avoid the extra API call to import unique coupon calls
* Revert "Replace Recurly unique coupon codes API call with coupons `unique_coupon` field"
This reverts commit 1c4592d82d
2022-03-08 17:59:47 +05:30
Luis Gomez
d39b63674e
🐛 Source Hubspot: Removed stage history from deals stream ( #10707 )
...
* Removed stage history from Hubspot deal stream
* Fixed stream slices on CrmSearchStream
* Removed unused DealStageHistoryStream class
* Bumped connector version
2022-03-05 09:07:42 +02:00
ksengers
6ea444fc72
🐛 Source Chargebee: fix credit note model ( #10827 )
...
* Source Chargebee: fix credit note model
* fix(airbyte): update version Dockerfile
2022-03-04 21:08:37 -03:00
Baz
21a88446dd
🐛 Source Shopify: Minor specification re-order, fixed links in documentation ( #10794 )
2022-03-04 19:26:21 +02:00
Juan
e661d8aeff
Update integrations README.md ( #10851 )
...
Updated verbiage from grades to stages
Updated connector stages to match cloud stage tags
Added connectors missing on README.md that appear on cloud drop down
2022-03-04 08:25:15 -07:00
Serhii Chvaliuk
b2aa69574c
🐛 Source Github: add new streams Deployments, ProjectColumns, PullRequestCommits ( #10385 )
...
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com >
2022-03-03 21:07:17 +02:00
Christophe Duong
b333f4fc75
🐛 Handle try/catch in BigQuery destination consumers ( #10755 )
...
* Handle try/catch in BigQuery destination consumers
* Remove parallelStream
* Bumpversion of connector
* update changelogs
* update seeds
2022-03-03 16:31:42 +01:00
Titas Skrebe
c81ceb2e5d
🎉 Source Chartmogul: Add CustomerCount stream ( #10756 )
...
* 🎉 Source Chartmogul: Add CustomerCount stream
* Update description
* address comments
* update changelog
* format source file
* run seed file
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2022-03-02 19:09:54 -03:00
ksengers
16dfae0df7
🎉 Source Chargebee: add credit note model ( #10795 )
...
* feat(chargebee) add credit note model
* fix(airbyte): update version Dockerfile
* fix(airbyte): update version Dockerfile v2
2022-03-02 19:04:43 -03:00
Marcos Marx
9737b3b4f5
Destination Snowflake: add missing version in changelog ( #10779 )
2022-03-01 21:28:30 -03:00
Sherif Nada
ed10c700d6
Fix typo in salesforce docs
2022-03-01 14:57:01 -08:00
Sherif Nada
b3546be317
fix salesforce docs markdown formatting
2022-03-01 14:55:36 -08:00
Philip Corr
a8f73653fb
🎉 Source Facebook Marketing: add activities stream ( #10655 )
...
* add facebook marketing activities stream
* update incremental test
* add overrides for activities specific logic
* formatting
* update readme docs
* remove test limitation
* update dockerfile airbyte version
* correct tests
* bump connector version in config module
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2022-03-01 15:57:13 -03:00
Sherif A. Nada
df47987cd6
📕 source salesforce: fix broken page anchor in spec.json & add guide for adding read only user ( #10751 )
2022-03-01 10:42:37 -08:00
Lucas Wiley
a4e8417ec8
Update snowflake destination docs for correct host ( #10673 )
...
* Update snowflake destination docs for correct host
* Update snowflake.md
* Update README.md
* Update spec.json
* Update README.md
* Update spec.json
* Update README.md
* Update snowflake.md
* Update spec.json
* Update spec.json
2022-03-01 15:05:54 -03:00
Augustin
04521d063f
🎉 Source redshift: implement privileges check ( #9744 )
2022-03-01 14:45:04 +01:00
Vadym Hevlich
61ab34cd0a
🎉 Source Zendesk: sync rate improvement ( #9456 )
...
* Update Source Zendesk request execution with future requests.
* Revert "Update Source Zendesk request execution with future requests."
This reverts commit 2a3c1f82b7
2022-03-01 00:41:44 +02:00
girarda
5d8cb41150
Refactor to enable support for optional JDBC parameters for all JDBC destinations ( #10421 )
...
* refactoring to allow testing
* MySQLDestination uses connection property map instead of url arguments
* Update jdbc destinations
* A little more generic
* reset to master
* reset to master
* move to jdbcutils
* Align when multiline
* Align when multiline
* Update postgres to use property map
* Move tests to AbstractJdbcDestinationTest
* clean
* Align when multiline
* return property map
* Add postgres tests
* update clickhouse
* reformat
* reset
* reformat
* fix test
* reformat
* fix bug
* Add mssql tests
* refactor test
* fix oracle destination test
* oracle tests
* fix redshift acceptance test
* Pass string
* Revert "Pass string"
This reverts commit 697821738cee8d75245bc8022c299411a6725eaa213f47acc466822454af
2022-02-28 09:25:04 -08:00
Sherif A. Nada
9e941f3818
Improve note in salesforce docs about creating a RO user
2022-02-27 20:53:40 -08:00
Sherif A. Nada
5691434073
📖 improve salesforce docs & reorder properties in the spec ( #10679 )
2022-02-27 20:08:46 -08:00
Maksym Pavlenok
2bba529803
🎉 Source Salesforce: speed up discovery >20x by leveraging parallel API calls ( #10516 )
2022-02-27 19:03:39 -08:00
Lakshmikant Shrinivas
658efc8d98
🐛 Source CockroachDB: fix connector replication failure due to multiple open portals error ( #10235 )
...
* fix cockroachdb connector replication failure due to multiple open portals error
* bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2022-02-25 08:50:01 -03:00
vitaliizazmic
3a5beb7c9e
🎉 Source Google Ads: add network fields to click view stream
...
* Google Ads #8331 - add network fields to click_view stream schema
* Google Ads #8331 - add segments.ad_network_type to click_view pk according to PR review
* Google Ads #8331 - bump version
* Google Ads #8331 - update definition
2022-02-25 09:10:22 +02:00
Michele Zuccala
bfbacd0b43
🎉 Source Google Workspace Admin Reports: add support for Google Meet Audit Activity Events ( #10244 )
...
* source(google-workspace-admin-reports): add support for Google Meet Audit activity events
Signed-off-by: Michele Zuccala <michele@zuccala.com >
* remove required fields
* bump connector version
* run format
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2022-02-24 17:59:46 -03:00
Aaditya Sinha
b5d637f79d
Source Chargebee: add transaction stream ( #10312 )
...
* added transactions model
* changes
* fix
* few changes
* fix
* added new stream in configured_catalog*.json
* changes
* removed new stream in configured_catalog*.json
* solve small schema issues
* add eof
* bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com >
2022-02-24 15:55:32 -03:00
Marcos Marx
47c4f233f3
🎉 add associations companies to deals, ticket and contacts stream (from PR 9027) ( #10631 )
...
* Added associations to some CRM Object streams in Hubspot connector
* Added associations in the relevant schemas
* fix eof
* bump connector version
Co-authored-by: ksoenandar <kevin.soenandar@gmail.com >
2022-02-24 15:44:04 -03:00
Ronald Fortmann
fd747691bf
Source Pinterest: fix typo in schema fields ( #10223 )
2022-02-24 15:36:37 -03:00
Daniel Diamond
98bbda10ef
🎉 Source Survey Monkey: add option to filter survey IDs ( #8768 )
...
* Add custom survey_ids
* bump version
* Update survey_question schema
* Add changelog
* Allow null objects
* merge master and format
* Make all types safe with NULL and add survey_ids to all streams
* Make additional types safe with NULL
* Make additional types safe with NULL
* One last safe NULL type
* small fixes
* solve conflic
* small fixes
* revert fb wrong commit
* small fb correction
* bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2022-02-24 11:20:35 -03:00
augan-rymkhan
7b3fd6ba4a
Source Hubspot: cast timestamp to date/datetime ( #10576 )
...
* cast timestamp to date
* change test name
* fix corner cases
* fix corner cases 2
* format code
* changed method name
* add return typing
* bump version
* updated spec and def yaml
Co-authored-by: auganbay <auganenu@gmail.com >
2022-02-24 19:09:45 +06:00
Eugene Kulak
6cd20e6879
🐛 Source FB Marketing: fix execute_in_batch when batch is bigger than 50 ( #10588 )
...
* fix execute_in_batch
* add tests
* fix pre-commit config
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com >
Co-authored-by: Sherif A. Nada <snadalive@gmail.com >
2022-02-24 01:22:53 +04:00
Philippe Boyd
10f17ef38b
🐛 Source Shopify: fix wrong field type for tax_exemptions ( #10419 )
...
* fix(shopify): wrong type for tax_exemptions
abandoned_checkouts customer tax_exemptions had the wrong field type
* fix(shopify): wrong type for tax_exemptions
abandoned_checkouts customer tax_exemptions had the wrong field type
* bump connector version
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
2022-02-23 14:38:30 -03:00
bmcgilli
3386cbe9ce
Update redshift.md ( #10567 )
2022-02-22 17:00:31 -08:00
Nahid
fbad2b8c06
Source MongoDb: fix parsing of DBRef objects ( #10276 )
2022-02-22 18:51:46 -03:00
Juozas V
c807d9c9f3
Source Amazon Seller Partner: add stream FbaReplacementsReports ( #9789 )
2022-02-22 18:47:35 -03:00
Serhii Lazebnyi
ca1cf9bf39
🐛 Source Facebook Marketing: Fix backoff trigger with ConnectionError ( #10348 )
...
* Add AdAccount and Images stream implementation
* Update PR number
* Updated docker version
* Updated to linter
* Update to review
* Add comment to AdAccount read_records method
* Bumped version in seed, definitions and specs files
* Fix backoff errors code list
* Deleted empty file
* Updated to linter
* Updated PR number
* Added connection_reset_error to backoff
* Fix unittest
* Fix integration tests
* Bumped seed version
2022-02-22 17:26:03 +02:00
augan-rymkhan
9c9dfb25f1
Source Hubspot: add "format": "date-time" ( #10492 )
...
* add "format": "date-time"
* add "format": "date-time" to feedback_submissions
* add "format": "date-time" to deals
* bump version
* updated spec and def yaml
Co-authored-by: auganbay <auganenu@gmail.com >
2022-02-22 20:46:36 +06:00
andriikorotkov
1d66672fad
🐛 Fixed cursor for old connectors that use non-microsecond format. Now connectors work with both formats ( #10508 )
...
* updated timestamp transformation with microseconds
* updated timestamp transformation with microseconds
* updated mysql datatype tests
* updated mysql datatype tests
* updated mysql datatype tests
* updated mysql datatype tests
* updated mysql datatype tests
* updated mysql tests
* removed extra logs
* fixed cursor for timestamp
* updated test
* updated type transformation
* updated type transformation
* updated type transformation
* updated tests
* updated oracle tests
* updated documentations and connectors versions
* updated documentations and connectors versions
* fix code style
* updated cursor for jdbc sources
* updated cursor for jdbc sources
* updated cursor for jdbc sources
2022-02-22 13:26:10 +02:00
oleh.zorenko
e23c29d3fa
🐛 Source Chargebee: add tests + fix broken coupon stream ( #10366 )
...
* 10192 Fix Chargebee source
Fix `coupon` stream.
Add unit tests.
* 10192 Update tests + update docs
* 10192 Bump connector's version
2022-02-22 10:20:21 +02:00
