1
0
mirror of synced 2025-12-21 02:51:29 -05:00
Commit Graph

297 Commits

Author SHA1 Message Date
augan-rymkhan
b22efc03a1 Source Hubspot: fix "quotes" key error exception (#10055)
* check if stream exists in source

* check if stream exists in source, added comment

* test skipping reading quotes stream

* format code

* airbyte-cdk version

* added __init__.py to unit_tests

* fix importing airbyte models

* bump the version

* update spec and def yamls

Co-authored-by: auganbay <auganenu@gmail.com>
2022-02-10 10:39:50 +06:00
Vladimir remar
983d6ae2ba :tada:Source hubspot add new streams for engagements(calls, emails, meetings, notes and tasks) (#9786) 2022-02-04 20:09:29 +01:00
Tino Merl
b40b303638 🎉Source HubSpot: Adds form_submission and property_history streams (#7787)
* Began working on HubSpot Form Submission Connector

* Added Property History Stream

* Added form_guid to as value to form_submissions_stream.

* Finalized the Form Submission Stream

* Added documentation and test config

* Corrected Version Number

* updated version number to 0.1.25

* removed or none worked on tests

* Changed code due to review comments & merges

* readded Propertyhistory after merging

* bump connector version

Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-01-26 00:34:15 -03:00
Vladimir remar
d616279bea Source hubspot: add Feedback Submissions stream and update Ticket Pipelines stream (#9081)
* update: on api.py update url for ticket_pipelines

* update: on client.py add new entries for feedback_submissions streams and ticket_pipelines

* update: add to shchemas feedback_submissions and ticket_pipelines

* update: to integration_tests_abnormal_state add new value for feedback_submissions

* update: in sample_files add new entries for feedback_submissions and ticket_pipelines

* update: bump connector version

* fix: in feedback submission replace timestamp to updatedAt

* update version in source_definitons and Dockerfile

* run format

* config seed

* bump connector version in config file

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-01-24 23:06:27 -03:00
Serhii Chvaliuk
c524e0af64 🎉 Source HubSpot: Add more fields for email_events stream (#9641)
* email_events.json updated
* bugfix: "date-time" -> "date"

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-01-21 19:33:17 +02:00
Luis Gomez
25fb7e7fd7 Source Hubspot: Some incremental CRM objects and engagements (#8887) 2022-01-17 11:54:31 +01:00
gergelylendvai
9cc2560935 Source Hubspot: adding form_submissions stream (#8011)
* Source Hubspot: adding form_submissions stream

* Adding form_id to form_submissions output

* Adding form_id to form_submissions output and schema

* Removing field deletions and id generation

* Adding new line to form_submissions.json

* Fixing form_submissions.json schema

* add form_submissions as empty_stream to run ci airbyte

* add forms_submissions to empty_stream

* bump connector seed version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-01-13 21:06:51 -03:00
Serhii Chvaliuk
9909cd69f2 🎉 Source HubSpot: engagements stream, remove auto-generated properties (#9385)
* extend schemas/engagements.json

* fix unix newlines

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-01-13 16:49:32 +02:00
vitaliizazmic
7c4ae13473 🎉 Source HubSpot: support list memberships in Contacts stream (#9129)
* Source Hubspot #8477 - separate stream for contacts list memberships

* Source Hubspot #8477 - reformat

* Source Hubspot #8477 - fix basic read tests: add contacts_list_memberships to empty streams

* Source Hubspot #8477 - bump version and update documentation
2022-01-10 22:26:25 +02:00
Sherif A. Nada
40db22c2b4 Add a note about the output of the engagements stream in Hubspot docs (#9316) 2022-01-05 09:16:44 -08:00
Serhii Lazebnyi
212c1ff22c 🎉 Source Hubspot: Support incremental sync on all possible streams (#8699)
* Add incremental sync support for companies, contact_lists, contacts, deals, line_items, products, quotes, tickets streams

* Updated PR number

* Fix formating

* Fix typo

* Commented unsupported tests

* Updated to review

* Updated abnormal state file

* Deleted comment

* Updated version in docker

* Updated version in spec yaml and seed
2021-12-17 15:48:47 +02:00
ycherniaiev
2ad4ca1d5c Update fields in source-connectors specifications: drift, harvest, hubspot, intercom, monday, clickhouse, bing-ads, snapchat-marketing, microsoft-teams (#8429)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-12-16 17:52:37 +02:00
Serhii Chvaliuk
cde71578c9 🐛 Source Hubspot: additionalProperties: true (#8658)
* additionalProperties: true in spec

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-12-15 18:38:20 +02:00
Serhii Chvaliuk
757650f9de 🐛 Source Hubspot: remove 'skip_dynamic_fields' config param (#8329)
* ignored fields added
* remove 'skip_dynamic_fields'

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-30 23:28:26 +02:00
Serhii Chvaliuk
0d7e69e760 🐛 Source Hubspot: unset 'hs_time_in_*' properties (#8216)
* 'skip_dynamic_fields' added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-26 21:35:31 +02:00
Serhii Chvaliuk
1b38fc7b79 bugfix 'Hubspot' -> 'HubSpot' (#7683)
* bugfix 'Hubspot' -> 'HubSpot'

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-11-09 20:43:17 +02:00
Dmytro
c918f52f16 Fix Hubspot and Asana oAuth flow. (#7730) 2021-11-08 14:22:20 +02:00
Yevhenii
90451eb075 🎉 Source Hubspot: Migrate Hubspot source to CDK structure (#7562)
* Migrate Hubspot source to CDK structure
2021-11-03 09:57:56 +02:00
Yevhenii
906aa75bc9 🐛 Source Hubspot: hotfix import urllib package (#7405)
* Source Hubspot: hotfix import urllib package
2021-10-27 14:30:27 +03:00
Yevhenii
85851b7e0f 🐛 Hotfix Hubspot: add the length of separator symbol to check (#7393)
* hotfix for split_properties function
2021-10-26 23:27:04 +03:00
Yevhenii
928aa6280c 🐛 Source Hubspot: Fix issue with getting 414 HTTP error for streams (#6954)
* Source Hubspot: Fix issue with getting 414 HTTP error for streams

* update code and schemas

* bump version
2021-10-26 15:37:07 +03:00
Hai To
fae4d00c8f Source Hubspot: Add new marketing emails (with statistics) stream (#5840)
* Add new marketing emails (with statistics) stream

* Update docs and changelog
2021-10-20 20:37:48 -03:00
Yevhenii
6c4ae4aac4 Source Hubspot: update SAT config (#6995)
* Update discover method: disable quotes stream when using OAuth config
2021-10-14 13:37:49 +03:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
276d914a57 Direct to Discourse tagged list instead of specific issues on Troubleshooting. (#6848) 2021-10-07 00:05:56 -07:00
Vadym
351e998394 🎉 Source Hubspot: Support OAuth (#6465)
* Add required scopes to hubspot.md docs

* Update spec with oauth creds.
Update acceptance test config with oauth tests.
Add oauth test creds configs.

* Fix spec.js `oneOf` usage

* Add CDK authenticators usage.
Update source acceptance tests.
Update spec.json.

* Fix source unit tests

* Update hubspot.md scopes docs

* Add spec field titles.
Update comments.

* Update spec.json oauthFlowOutputParameters.

* Update spec.json to pass SAT.
2021-10-04 17:11:34 +03:00
Abhi Vaidyanatha
30a4b6b687 Fix inconsistent H4 Markdown headers. (#6701) 2021-10-04 00:23:38 -07:00
Abhi Vaidyanatha
f3b32e41e9 Docs Refresh: Hubspot Source (#6700) 2021-10-04 00:19:03 -07:00
Yevhenii
aac98b9b9b 🐛 Source Hubspot: Use correct schema for 'owners' stream (#6374)
* Source Hubspot: Use correct schema for 'owners'  stream

* Update builds.md with correct data
2021-09-23 15:03:03 +03:00
Sherif A. Nada
f5c8ce2ebc publish PR 5693 (#6299)
Co-authored-by: vladimir-remar <vladimir.remar@gmail.com>
2021-09-19 18:52:35 -07:00
Yaroslav Dudar
5e3b24ff4e 🐛 Source Hubspot: fix array fields in schema with missed items property (#5834)
fixed array schemas in companies
2021-09-07 22:17:03 +03:00
Dmytro
60fd9d5ab9 🐛 Fix hubspot datetime empty string (#5798)
* Fix hubspot datetime empty string
2021-09-06 10:11:48 +03:00
Marcos Marx
e873129fe4 remove all date-time schemas (#5685) 2021-08-26 21:59:23 -03:00
Baz
bc89f85bd6 🐛 📚 Source Hubspot: Fix fail on reading stream using API Key without required permissions (#5463)
Fix fail on reading stream using `API Key` without required permissions (#5463) https://github.com/airbytehq/airbyte/pull/5463

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-08-18 12:52:27 +03:00
Baz
6f56833473 🐛 Source HubSpot: Fix empty string inside number / float datatype (#5334)
#5293 - Source Hubspot fails in normalization step

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-08-12 18:47:50 +03:00
Sherif A. Nada
8e74551703 🐛 Source hubspot: correctly use logger exception printing (#5250) 2021-08-06 13:41:14 -07:00
Arthur Galuza
25c04db295 🎉 Source Hubspot: update user-defined custom field schema generation (#4913)
* Handle field types, convert unknown to string with warning

* Bump version

* Upd version in source definitions

* Add json field format for date fields

* Add a stub integration test to bypass CI/CD test stage

* Replace cached_property with lru_cache to support Python < v3.8

* Extract the field format converting logic, cover it with a unit test

* Set default field type to `string`

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Upd changelog

* Cleanup

* Fix tests

* Downgrade version tag

* Remove caching for the custom properties field

* Bump version tag

* Add type casting for malformed fields

* Upd schemas

* Disable connection tests

* Fix docs, add custom properties cache

* Upd tests, check failed state

* Disable invalid config test

* Add starte_date param into config

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-08-03 17:52:52 +03:00
Abhi Vaidyanatha
d985fe73f4 Add note about rate limits with the HubSpot API (#4491)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-07-01 23:04:35 -07:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990)
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
2021-04-21 11:35:08 +08:00
John Lafleur
55256d293d GitBook: [master] 55 pages and 36 assets modified 2021-04-05 00:43:26 +00:00
Sherif Nada
77b72dcf5b Revert "Revert "Merge branch 'master' of github.com:airbytehq/airbyte""
This reverts commit de66bf010d.
2021-03-23 15:12:01 -07:00
Sherif Nada
de66bf010d Revert "Merge branch 'master' of github.com:airbytehq/airbyte"
This reverts commit a3a27f2fa2, reversing
changes made to 5917feee28.
2021-03-23 15:09:44 -07:00
Eugene K
0b9b038ca4 🎉 New source: Native Hubspot connector (#2215)
* #2150 Issue: created native connector with schema folder populated

* #2150 Issue: make format code

* first version

* fix few issues

* fix issues

* fix read issue

* format

* docs

* docker tags

* extend configured catalog for testing

* fix source definitions

* format

* fix call rate issue, add backoff for retry after

* add general backoff

* write secrets for new connector

* drop singer connector registration

* refactor streams, resolve properties in schemas at runtime

* replace deprecated endpoint for company contacts

* replace deprecated pipeline endpoint

* update comments

* update docs

* fix typo

* fix stream contact lists

* fix pagination and forms result fetching

* fix health_check

* format and update catalog

* revert changes

* drop singer based hubspot

* fix company contacts substream

* move deals to separate test

* fix deals tests

* remove dynamic fields from records

* move deals to catalog again

* extend CRMObjectStream with associations

* format

* update schemas with updated field, change engagement layout

* fix Campaign stream

* remove custom tests

* remove dependency

* remove oauth

* Source Hubspot: add incremental streams (#2425)

* add incremental

* add incremental

* polishing

* update docs

* fix docstring

* clean up

* fix incremental bookmark access

* fix incremental tests

* clean up

* add custom test for incremental, improve logging

* format

* Update airbyte-integrations/connectors/source-hubspot/source_hubspot/api.py

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Source Hubspot: best practices (#2537)

* fix error reporting and add unit tests

* fix test and refactor cursor fields

* format

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>

* restored configured_catalog.json

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-03-20 06:18:55 -03:00
John Lafleur
2acc3840d0 GitBook: [docs_feature_incremental] 33 pages modified (#1683)
Co-authored-by: John Lafleur <john@dataline.io>
2021-01-17 07:32:24 +11:00
Sherif A. Nada
6b92d1d077 Release incremental sync for hubspot (#1532) 2021-01-05 22:32:42 -08:00
Michel Tricot
89f6ae6e36 Fix many broken links (#798) 2020-11-02 19:19:48 -08:00
Charles
edc49b89d9 Hubspot Source (#732) 2020-10-29 22:05:49 -07:00