1
0
mirror of synced 2026-01-07 18:06:03 -05:00
Commit Graph

1446 Commits

Author SHA1 Message Date
Yevhenii
25110c167d 🎉 Google Directory: Add organizations and phones to users schema (#7167)
* Google Directory: Add organizations and phones to users schema

https://developers.google.com/admin-sdk/directory/v1/guides/manage-users#json-response

* bump version, add changelogs to google-directory.md

Co-authored-by: Xiangxuan Liu <9570112+nauxliu@users.noreply.github.com>
2021-10-19 16:59:00 +03:00
Yevhenii
b18acd6014 🎉 Connector Facebook-Marketing: update insights streams with custom entries for fields, breakdowns and action_breakdowns (#7158)
* Connector Facebook-Marketing: update streams with custom streams

* update: remove custom streams, add new custom insights from config

* update: add new model for InsightConfig, remove old imports

* fix: format to source file and streams file

* update Changelog

* update: add to check a validation to insights entries, update documentation and fix to resolve  in spec schema

* fix: fix import logger from entrypoint, change to python logger

* fix: change error message from check custom insights entries, fix logger import

Co-authored-by: vladimir <vladimir.remar@gmail.com>
2021-10-19 15:08:28 +03:00
Jared Rhizor
2d32df1b20 fix more doc links (#7146) 2021-10-18 18:21:21 -07:00
Jared Rhizor
726c3b909b Bump Airbyte version from 0.30.20-alpha to 0.30.21-alpha (#7145)
Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>
2021-10-18 18:19:49 -07:00
Tuan Nguyen
1de7f4c365 Minor typos in doc (#7106)
* Update google-ads.md

* Update docs/integrations/sources/google-ads.md

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2021-10-18 11:32:34 -03:00
oleh.zorenko
cf04b8bb8e 🎉 Source GitLab: allow all domains to be used as api_url (#7108)
* Remove `pattern` field from `api_url` in spec file

* Bump connector's version + update docs
2021-10-18 16:24:36 +03:00
Maksym Pavlenok
4054d8b45f 🐛 Source Zendesk Support: incorrect spec file (#7097)
* remove oauth settings from spec file

* update changelog

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
2021-10-18 11:56:05 +03:00
oleh.zorenko
f1ddfca1c5 🐛 Source Twilio: update schemas + turn on transformer for all streams (#7034)
* Update schemas + turn on transformer for all streams

* Update docs

* Transform RFC2822 datetime into ISO8601

* Bump connector's version + update `accounts` schema
2021-10-18 07:05:07 +03:00
Samy Pessé
d365f85654 Fix invalid YAML frontmatter (#7088) 2021-10-15 21:25:58 -03:00
Charles
8ddfd90c9c add docs on how to set up ide to automatically add final (#7083) 2021-10-15 16:42:11 -07:00
Maksym Pavlenok
592f7fe2b2 🐛 Source ZenDesk Support: fix 404 responses for the ticket_comments stream (#6513)
* fix 404 responses for the ticket_comments stream

* add unit test

* add unit test

* add oauth2 access token

* Update airbyte-integrations/connectors/source-zendesk-support/source_zendesk_support/streams.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* switching among auth methods

* Update docs/integrations/sources/zendesk-support.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* add log message for 404 errors

* Update docs/integrations/sources/zendesk-support.md

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* Update airbyte-integrations/connectors/source-zendesk-support/source_zendesk_support/streams.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* remove oauth logic from this PR

* remove oauth logic from this PR

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-10-16 01:20:41 +03:00
Charles
d154f8b278 update docs to avoid long run times for formatting (#7064) 2021-10-15 13:04:42 -07:00
Maksym Pavlenok
713fe61efd 🎉 New Source: TikTok Marketing (#5887)
* create a new connector folder

* add base classes

* add schemas

* add ads/ad_groups streams

* update tests and docs

* add a bootstrap file

* update the base domain name for API

* update the base domain name for API

* update Dockerfile libs

* remove unused comments

* Update airbyte-integrations/connectors/source-tiktok-marketing/bootstrap.md

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* Update airbyte-integrations/connectors/source-tiktok-marketing/bootstrap.md

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* fix UI error with input parameters

* fix problem with updated state

* Update airbyte-integrations/connectors/source-tiktok-marketing/source_tiktok_marketing/spec.py

Co-authored-by: Davin Chia <davinchia@gmail.com>

* add an unit test

* update README.md

* bump version

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-10-15 19:24:14 +03:00
Marcos Marx
825e487bb1 enable campaign_metrics stream (#6856) 2021-10-14 21:45:56 -03:00
Baz
cfae84cbb0 🎉 Source Shopify: support oauth flow (#6951) 2021-10-14 22:37:30 +03:00
Arthur Galuza
62826f82fd 🎉 Source Google Analytics v4: add intermediary auth config support (#7020)
* Add intermediary auth config support

* Upd changelog

* Mark spec param as secret
2021-10-14 17:00:11 +03:00
Arthur Galuza
f0debaad32 🎉 Document stream caching (#6846)
* Upd docs: add caching section

* Upd docs

* Update docs/connector-development/cdk-python/http-streams.md

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>

* Remove link to details

* Update docs/connector-development/cdk-python/http-streams.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/connector-development/cdk-python/http-streams.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Add demo snippet

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-14 16:35:29 +03:00
Vadym
409101ad79 🎉 Source Greenhouse: Implement Additional Endpoints Support (#6377)
* Add additional stream support.
Implement nested stream support.
Add new schemas.
Update acceptance test config.

* Update acceptance test config.
Update codestyle and docstrings.

* Update build.gradle

* Update build.gradle config

* Update docs.
Post review fixes.

* Add TODO to fill all streams.

* Update schemas.
Update SAT config.

* Refacor connector to use CDK best practices

* Stream pagination fixed

* Fix acceptance test config.

* Fix setup.py test requirements

* Rename <x>.<y> stream names to <x>_<y> format.
Update next_page_token method.
Fix streams mypy type check.

* Add unit tests for stream core functionality.

* Fix acceptance test config with new stream names.

* Fix acceptance test config with new stream names.

* Add more streams to SAT as non empty.

* Fix broken schemas.

* Comment/delete demographics streams references.
Bump connetor version.
2021-10-14 16:24:01 +03:00
Yevhenii
6c4ae4aac4 Source Hubspot: update SAT config (#6995)
* Update discover method: disable quotes stream when using OAuth config
2021-10-14 13:37:49 +03:00
VitaliiMaltsev
ae9048cfaa 🎉 Redshift Source/Destination SSL Support (#6965)
* add tls option to spec

* Redshift Source add acceptance test

* Redshift Destination add ssl field to spec

* add RedshiftDestinationAcceptanceTestSSL

* fix checkstyle

* added changelog

* update docs

* bump versions of Redshift Source and Destination \ changed default tls to true

Co-authored-by: vmaltsev <vitalii.maltsev@globallogic.com>
2021-10-14 12:29:00 +03:00
Dmytro
2e7ff2e83b Trello source: Add oAuth flow (#6968) 2021-10-14 09:46:47 +03:00
Eugene
05e09aff7d 🎉Destination MySQl - added ssl strict encrypt connector (#6763)
* [6423] Destination MySQl - added ssl strict encrypt connector
2021-10-14 08:28:43 +03:00
andriikorotkov
80c9ed2b02 🐛 AWS S3 Staging COPY is writing records from different table in the same raw table (#6949)
* updated jdbc destination

* updated snowflake and redshift destination version

* updated documentation

* updated documentation

* updated prefix length for snowflake and redshift streams

* fixed remarks

* updated new redshift version
2021-10-14 01:04:54 +03:00
Abhi Vaidyanatha
3841e8a029 Docs Refresh: Amazon Seller Partner (#7023) 2021-10-13 13:40:36 -07:00
Arthur Galuza
bfe865aebf 🎉 Source Google Sheets: Support connecting via oAuth webflow (#6354)
* Add service account support

* Upd oauth support

* Upd auth creds selector
2021-10-13 23:02:22 +03:00
Abhi Vaidyanatha
922bfd08a9 Add recommendation for disk size in GCP/AWS deployment guide. (#7018)
* Add note about Airbyte disk recommendations on GCP.

* Add note for AWS/
2021-10-13 12:49:20 -07:00
maciej-nedza
cb448681b9 Update Keen documentation (#6948) 2021-10-13 12:23:40 -07:00
Abhi Vaidyanatha
08afd9eea0 Add meta description to Shopify source page. (#7017) 2021-10-13 12:12:41 -07:00
Jared Rhizor
72a3368da6 Bump Airbyte version from 0.30.19-alpha to 0.30.20-alpha (#7016)
Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>
2021-10-13 10:41:23 -07:00
vitaliizazmic
74fecdd045 🎉 Source Freshdesk: add start_date parameter to specification from which to start pulling data
* Source Freshdesk #6133 - add update since parameter to spec for tickets stream

* Source Freshdesk #6133 - fixing according to PR

* Source Freshdesk #6133 - fixing according to PR review

* Source Freshdesk #1279 - implement start date for all incremental streams

* Source Freshdesk #1279 - fixing start_date

* Source Freshdesk #1279 - reformat

* Source Freshdesk #1279 - bump and CHANGELOG.md
2021-10-13 18:20:17 +03:00
Denis Sokolov
7aa9341235 Update integrations/amplitude release date (#6997)
An oversight in aaaa6cc5cb.
2021-10-13 12:11:30 -03:00
Artem Astapenko
fea3bf6798 Remove papercups (#6955)
* Remove papercups

* Remove support chat
2021-10-13 15:59:28 +03:00
Jared Rhizor
a42ce27c1a Bump Airbyte version from 0.30.18-alpha to 0.30.19-alpha (#6991)
Co-authored-by: ChristopheDuong <ChristopheDuong@users.noreply.github.com>
2021-10-13 13:36:17 +02:00
Abhi Vaidyanatha
fae6d4719d 📚 Add operator guide to adding Slack Notifications for sync status. (#6888)
* Add operator guide to adding Slack Notifications for sync status.

* Remove newlines.

* Add link to Demo hours video.

* Actually add video.
2021-10-12 10:43:01 -07:00
Marcos Marx
fd025dc9e0 api token warn (#6980) 2021-10-12 14:15:05 -03:00
Oleksandr Sheheda
2b39c11425 🎉 Destination Oracle: implemented connection encryption using N… (#6893)
* #6013 🎉 Destination Oracle: implemented connection encryption using NNE and TLS
2021-10-12 18:20:09 +03:00
Andrii Leonets
a98b3fe414 MySql Source: Fix data processing (#6093)
* move logic from static JdbcUtils to JdbcSourceOperations

* format

* Add methods for all types in order to have possibility rewrite them and use common type mapping.

* Make BigQuery in line impl with JDBC changes

* fix binary type

* add database creations methods with sourceOperations input

* add MySqlSourceOperations

* fix processing

* Fix CDC processing

* format

* add some tests for double and float

* incr version

* #3931 #3932 added zero-date converting to null param "zeroDateTimeBehavior=convertToNull"

* remove old tests covered by data type tests + incr ver

* Update airbyte-integrations/connectors/destination-mysql/src/main/java/io/airbyte/integrations/destination/mysql/MySQLDestination.java

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update docs/integrations/sources/mysql.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* add back comments to the data type mapping

* incr config version

Co-authored-by: Oleksandr Sheheda <alexandrshegeda@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-12 18:08:50 +03:00
Baz
81fd664362 🐛 Source Zuora: fixed minimum value of window_in_days (#6960) 2021-10-12 17:11:17 +03:00
vitaliizazmic
6a28488884 🎉 Source Typeform: support pulling data from a select set of forms
* Source Typeform #6319 - add form_ids to spec for specifying set of forms

* Source Typeform #6319 - improving description in spec, verifying if forms inputted by the user are valid

* Source Typeform #6319 - fixing check connections

* Source Typeform #6319 - improving form ids validation error message

* Source Typeform #6319 - bump and update changelog
2021-10-12 10:43:52 +03:00
oleh.zorenko
51a2e45c50 🐛 Source Gitlab: fix pattern field in spec file, remove unused fields from config files, improve caching mechanism (#6932)
* Fix SAT

Fix how cache is used in this connector.
Fix pattern field in spec file.
Remove unused fields from invalid_config.json and sample_config.json files.

* Update docs

* Use cache from CDK

* Bump connector's version + update docs
2021-10-12 10:39:55 +03:00
Arthur Galuza
24c53b25dd 🐛 Source Amplitude: log error when got 404 (#6541)
* Add test

* Upd error handling

* Update airbyte-integrations/connectors/source-amplitude/source_amplitude/api.py

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>

* Update docs/integrations/sources/amplitude.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update airbyte-integrations/connectors/source-amplitude/source_amplitude/api.py

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-12 10:24:32 +03:00
Arthur Galuza
99b1e91c65 🎉 Source Pipedrive: add oAuth support (#6821)
* Add oauth support

* Upd changelog

* Update airbyte-integrations/connectors/source-pipedrive/source_pipedrive/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-10-12 09:45:46 +03:00
Baz
6fb989feb7 🎉Destination MSSQL: Fix the Acceptance Tests based on Normalization (#6877)
* Enabled Normalization for destination-mssql

* added changelog

* fixed normalization for mssql source

Co-authored-by: ievgeniit <etsybaev@gmail.com>
2021-10-11 21:58:52 +03:00
irynakruk
22c3a9e043 🐛 MongoDb Source: Added filter to avoid MongoDb system collections (#6860)
* Added filter to avoid MongoDb system collections
2021-10-11 13:41:24 -04:00
Serhii Lazebnyi
a12076a6ed 🐛 Source Intercom: Fix pagination for contacts (#6879)
* Fix pagination for contacts

* Changed PR number
2021-10-11 11:21:52 +03:00
Mario Molina
ac2d3073a2 🎉 New search API endpoints for connections, sources, and destinations (#6656)
* Add API endpoints for connections, sources, and destinations

* Updating tests

* Tests for source and destination handlers

* Reformat code

* Update airbyte-server/src/main/java/io/airbyte/server/handlers/helpers/ConnectionMatcher.java

Co-authored-by: LiRen Tu <tuliren@gmail.com>

* Adding tests

* Format code

Co-authored-by: LiRen Tu <tuliren@gmail.com>
2021-10-08 19:11:15 -07:00
Abhi Vaidyanatha
ee18ba11d4 Add High-Level context to Incremental/. (#6919) 2021-10-08 14:42:22 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Jared Rhizor
c8c9905b35 Bump Airbyte version from 0.30.17-alpha to 0.30.18-alpha (#6916)
Co-authored-by: jrhizor <jrhizor@users.noreply.github.com>
2021-10-08 14:14:31 -07:00
Abhi Vaidyanatha
f52b67dec9 Rich embed the CDK Speedrun video. (#6915)
* Rich embed the CDK Speedrun video.

* Fix attempt 1.'

* Remove link.
2021-10-08 14:12:17 -07:00