1
0
mirror of synced 2025-12-21 02:51:29 -05:00
Commit Graph

297 Commits

Author SHA1 Message Date
Vladimir remar
eb2c7ad60e Source Hubspot: check if it has a state on search streams (#15110)
* check if it has a state

* update version in Dockerfile and docs

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-22 02:28:22 -03:00
Erica Struthers
6519499371 Update hubspot.md (#14545)
Co-authored-by: Amruta Ranade <11484018+Amruta-Ranade@users.noreply.github.com>
2022-08-21 15:20:08 -04:00
Erica Struthers
cf5d462610 Update hubspot.md (#15369) 2022-08-05 12:31:44 -04:00
Denys Davydov
2344b460d3 Source Hubspot: fix Deals stream schema (#15354)
* #393 oncall. Source Hubspot: fix Deals stream schema

* #393 source hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 14:34:20 +03:00
Denys Davydov
09d6901498 Source Hubspot: fix 401 for associations (#15156)
* Revert "Source Hubspot: revert v0.1.78 (#15144)"

This reverts commit cbdb897aa1.

* #379 source hubspot: fix 401 when reading associations

* #379 source hubspot: fix 401 when reading associations

* #379 source hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-02 10:34:54 +03:00
Denys Davydov
cbdb897aa1 Source Hubspot: revert v0.1.78 (#15144)
* Revert "Source Hubspot: implement new stream to read associations in incremental mode (#15099)"

This reverts commit dd109debec.

* #359 rollback

* hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-29 19:47:36 +03:00
Denis Davydov
dd109debec Source Hubspot: implement new stream to read associations in incremental mode (#15099)
* #359 oncall - source hubspot: implement new stream to read associations in incremental mode

* #359 source hubspot: upd changelog

* #359 source hubspot: do not pass identifiers

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-28 22:00:45 +03:00
Denis Davydov
6d812bfee6 Source Hubspot: do not limit reading data to 30 days for property History Stream (#15035)
* #352 source hubspot: do not limit reading data to 30 days for property history stream

* #352 oncall: source hubspot - upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-26 16:53:36 +03:00
Denis Davydov
fefcc22bb7 Source Hubspot: revert v0.1.75 changes (#14999)
* Revert "Source Hubspot: do not override _read_incremental (#14744)"

This reverts commit ae0cf4cb34.

* #14034 source hubspot: revert previous version changes

* #14034 upd changelog

* #14034 do not revert source definitions

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-26 13:13:50 +03:00
Denis Davydov
ae0cf4cb34 Source Hubspot: do not override _read_incremental (#14744)
* #14034 source hubspot: do not override _read_incremental

* #14034 source hubspot: upd changelog

* #14034 source hubspot: flake fix

* #14034 source hubspot: update state after each record and fix incremental reads

* #14034: fix formatting

* #14034 source hubspot: rm unnecessary check

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-18 16:28:56 +03:00
Vladimir remar
2b7a12bfc2 🎉 Source Hubspot: Add private app authentication (#14412)
* add new authentication method

* update connector version in Dockerfile and hubspot.md

* update: check credentials title through constants

* add constant file for credentials title values

* update dockerfile

* add 'API Key Credentials' to constants

* chore: added connector to definitions

* auto-bump connector version

* chore: formatting

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-17 16:52:09 +05:30
Denis Davydov
400f4e6aef Source Hubspot: refactor PropertyHistory stream (#14666)
* #291 oncall. Source Hubspot: disable Incremental mode for PropertyHistory stream and decrease number of http requests made

* #291 oncall: upd changelog

* #291 oncall: rm property_history stream from full_refresh SAT

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-14 10:14:13 +03:00
Bas Beelen
ef49424a07 source-hubspot: change mentioning of Mailchimp into HubSpot doc (#14620) 2022-07-12 17:36:17 +02:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
Denis Davydov
41e88a8dda Source Hubspot: extend error logging (#14054)
* #291 incall - source Hubspot: extend error logging

* huspot: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-24 10:24:08 +03:00
Baz
21b43f56cc 🐛 Source Hubspot: remove AirbyteSentry dependency (#14102)
* fixed

* updated changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-24 08:38:44 +03:00
Amruta Ranade
37b7470139 Edited Amplitude, Mailchimp, and Zendesk Support docs (#13897) 2022-06-17 14:32:30 -04:00
Denis Davydov
723bf660d8 Source Hubspot - fix missing data issue (#13837)
* #278 oncall: source hubspot - fix missing data issue

* #278 oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-16 11:44:46 -07:00
Amruta Ranade
bc98dc0fd2 Edited Stripe, HubSpot, Intercom docs (#13810)
* Initial edits

* Updated the Stripe connector doc

* Updated the Stripe doc

* Updated HubSpot and Intercom docs

* Minor sidebar edit
2022-06-15 13:07:08 -04:00
Denis Davydov
5df20b7316 Source Hubspot: fix URI too long issue (#13691)
* #268: fix URI too long (HubSpot)

* #268 upd changelog

* #268 oncall: review fix

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-10 22:30:52 +03:00
Denis Davydov
922bf46e8f Source Hubspot: fix for property_history stream (#13596)
* #259 on call: Source Hubspot - fix for the property_history stream which did not emit any records

* #259 Source Hubspot: upd changelog

* #259 oncall: hubspot review fixes

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-09 10:21:08 +03:00
Alexandre Girard
f1d79b201f Source Hubspot: report which scopes are missing to user (#13566)
* Report missing scopes

* simplify

* bump

* emit trace message

* remove print

* more careful error handling

* Add typing

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 14:10:03 -07:00
Serhii Chvaliuk
7800b52f4d 🐛 Source Hubspot: scope crm.objects.feedback_submissions.read added for feedback_submissions stream (#13475)
* crm.objects.feedback_submissions.read added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* hubspot.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-06 14:11:01 +03:00
Alexandre Girard
1225f80bd8 Source hubspot: filter out streams we don't have access to (#13455)
* filter out streams we don't have access to

* cleanup

* fix associations

* fix for api key auth

* this doesn't need to be a property method

* Bump

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-03 12:06:51 -07:00
Serhii Chvaliuk
537c9bab0e 🐛 Source HubSpot: Transform contact_lists data to comply with schema (#13218)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-02 23:07:07 +03:00
Serhii Chvaliuk
d0d74ec730 🎉Source Hubspot: Fix connector incremental state handling (#13320)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-02 18:26:55 +03:00
Serhii Lazebnyi
bdf6ba8463 🎉Source Hubspot: Associated line items to deals (#13383)
* Associated line items to deals

* Bumped version

* Bumped version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-02 14:54:27 +03:00
Alexandre Girard
1b6779d619 [OC-252] Hubspot Source: Request optional scopes (#13381)
* Set optional scopes

* update test

* required scopes

* fix

* Add a comment

* try empty scopes

* remove scopes to ensure it fails

* Revert "remove scopes to ensure it fails"

This reverts commit ba65642945.

* reorder

* set at least one required scope

* dont check for authorized scopes

* update docs

* Don't fail on missing scopes

* Revert "Don't fail on missing scopes"

This reverts commit 43ee93af9d.

* bump docker tag

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-01 19:35:06 -07:00
Serhii Chvaliuk
ad1fd2b742 🐛 Source Hubspot: use RFC3339 datetime (#13159)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-30 15:54:13 +03:00
Serhii Lazebnyi
3bddf875a6 Refactored docs (#13306) 2022-05-30 13:13:55 +03:00
Serhii Chvaliuk
1c8b18890d Source Hubspot: ensure all oauth2.0 scopes in "check" command (#12711)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-12 12:50:43 +03:00
Dany Chepenko
4b9ff01d46 Source Hubspot: Added deals associations for quotes (#12198) 2022-05-05 09:00:25 +02:00
Andy
5aed8e2147 Update connector specs (#12482) 2022-05-04 22:44:44 -07:00
Alexandre Girard
ce1936e491 Source Hubspot - Log instructions to update scopes when hitting 403 HTTP error (#12515)
* read workflows

* try except

* Revert "read workflows"

This reverts commit 86db8ff850.

* Check campaigns

* Check by reading data

* Check all streams

* requests_mock.ANY

* mock all http methods

* Try with get and post

* reset to master

* log name

* bump version
2022-05-02 17:45:50 -07:00
Marcos Marx
e0902e6e30 🐛 Source Hubspot: correct createAt and updateAd data type (#12424)
* correct createAt and updateAd data type

* bump connectorversion

* bump connector version again
2022-04-28 13:00:28 -03:00
Jared Rhizor
14dfc1d417 fix parentheses and info/warning/danger formatting in docs (#11981)
* fix parens

* fix formatting for hints

* remove hint from non-docusaurus or gitbook doc
2022-04-13 12:08:34 -07:00
Vladimir remar
06eff7d8ca 🎉 Source Hubspot: Add tickets associations to engagements streams. (#11423) 2022-03-31 18:57:08 +02:00
Serhii Lazebnyi
6528926b12 🐛 Source Hubspot: Fix non exists updated at field error (#11321)
* Fix updated at field non exists issue

* Updated PR number

* Change state default value to self._state

* Bumped seed version
2022-03-24 17:21:49 +02:00
Marcos Marx
f8fc057c54 Hubspot bump connector and update doc (#11332)
* Fixed engagement stream pagination

* Added unit test

* Removed unused import

* Fixed issue if incremental engagements attempts to get more than 10K records

* Fixed comment

* Merged import statement in unit test

* bump connector and update doc

Co-authored-by: lgomezm <luis@calixa.io>
2022-03-22 22:15:00 -03:00
girarda
b74e72e9c1 Improve hubspot documentation (#11218)
* typo

* remove hint block

* Move required scopes to top level header

* Revert "remove hint block"

This reverts commit c7d070abbd.

* update

* anchor link

* update other links too

* reset

* anchor link

* Update doc

* com -> io

* Update docs/integrations/sources/hubspot.md

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* only update doc

* Update changelog

* anchor link

* Bump version

* Update specs

* Capitalize

* link to where to find credentials

* update header level

* Capitalize

* Capitalize

* not all caps

* API Key

* Update cloud setup instructions

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2022-03-18 14:52:24 -07:00
Anna Lvova
fd49f92ebc 🐛 Source Hubspot: fix casting of float numbers (#11105)
* upd documentation

* fix comma in float number

* bump version

* add unit test for float casting

* bump version
2022-03-16 14:44:02 +02:00
girarda
b19f2415a9 🎉 Source HubSpot: Set Primary keys for streams with an identifier (#11121)
* Set partition key on streams with id field

* reset to master

* Update readme with primary key

* This can be incremental

* I think this can also support incremental

* incremental streams

* incremental

* Missing comma

* Everything can be incremental

* set pk

* Add a primary key

* Add missing pk

* format

* Update doc

* Bump version

* Not everything can be incremental

* fix field

* Update pk

* Update source_specs
2022-03-15 15:06:28 -07:00
Marcos Marx
669a1220ef Source Hubspot bump connector version and format files
* Handled search queries that would output more than 10K records

* Getting CRM search objects in ascending chronological ortder

* Fixed stream

* Fixed rebase

* Fixed condition

* Added unit test

* Removed unused import

* Started a new query when reached 10K records

* Moved comment

* bump connector docker version

* bump connector version

* correct dockerfile version

* change doc version

Co-authored-by: lgomezm <luis@calixa.io>
2022-03-14 22:45:43 -03:00
Luis Gomez
d39b63674e 🐛 Source Hubspot: Removed stage history from deals stream (#10707)
* Removed stage history from Hubspot deal stream

* Fixed stream slices on CrmSearchStream

* Removed unused DealStageHistoryStream class

* Bumped connector version
2022-03-05 09:07:42 +02:00
Marcos Marx
47c4f233f3 🎉 add associations companies to deals, ticket and contacts stream (from PR 9027) (#10631)
* Added associations to some CRM Object streams in Hubspot connector

* Added associations in the relevant schemas

* fix eof

* bump connector version

Co-authored-by: ksoenandar <kevin.soenandar@gmail.com>
2022-02-24 15:44:04 -03:00
augan-rymkhan
7b3fd6ba4a Source Hubspot: cast timestamp to date/datetime (#10576)
* cast timestamp to date

* change test name

* fix corner cases

* fix corner cases 2

* format code

* changed method name

* add return typing

* bump version

* updated spec and def yaml

Co-authored-by: auganbay <auganenu@gmail.com>
2022-02-24 19:09:45 +06:00
augan-rymkhan
9c9dfb25f1 Source Hubspot: add "format": "date-time" (#10492)
* add "format": "date-time"

* add "format": "date-time" to feedback_submissions

* add "format": "date-time" to deals

* bump version

* updated spec and def yaml

Co-authored-by: auganbay <auganenu@gmail.com>
2022-02-22 20:46:36 +06:00
augan-rymkhan
2282a4ae02 🎉 Source Hubspot: Migrate to CDK (#10177)
* migrate SourceHubspot to cdk

* refactor discover method

* change method name

* deleted Client class

* remove comment

* added get_updated_state

* fix setting initial state

* fix stream_state dict key

* fix cursor_field

* change check test case status

* refactor streams method

* remove comment

* remove TODOs

* remove comments

* fix get_updated_state

* refactor chunk_read

* override _read_incremental

* fix unit tests

* remove comments

* fix test_check_connection_backoff_on_server_error

* fix test_check_connection_backoff_on_server_error 2

* fix test_check_connection_backoff_on_limit_reached

* fix unit tests

* clear comments

* override read method on Source

* added comments to overriding methods

* some improvements

* reafactor overridden _read_incremental

* format code

* refactor discovery

* remove discover

* format code 2

* added return types

* refactor template stream classes

* remove comments

* remove _name field

* rename api.py to streams.py

* move to HttpStream

* refactor FormSubmissions

* refactor Campaings

* refactor ContactsListMemberships

* CRMSearchStream refactor

* CRMSearchStream refactor 2

* CRMObjectStream refactor

* DealStageHistoryStream refactor

* Deals refactor

* Engagements refactor

* path method refactor

* refactor authentication

* fix check_connection

* fix call parse_response

* fix Engagements stream

* fix CRMSearchStream

* fix CRMObjectIncremental stream

* override _read_incremental

* remove commented codes

* format code

* update cdk version

* fix cursor field

* fix unit tests

* removed client

* clear comments

* clear comments 2

* clear comments 3

* clear comments 4

* override backoff_time

* remove comment

* format code

* backoff_time modified

* refactor backoff_time

* format code

* added return typing

* format code

* removed cursor_paths

* bump version

* updated spec and def yaml

Co-authored-by: auganbay <auganenu@gmail.com>
2022-02-21 22:03:05 +06:00
Vladimir remar
fb647ad1e1 :tada:Source hubspot: add associations to tickets stream. (#10142)
* update: client add associations to tickets stream

* update: tickets json schema add deals and contacts

* bump connector version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-02-15 16:08:24 -03:00