1
0
mirror of synced 2025-12-22 19:38:29 -05:00
Commit Graph

387 Commits

Author SHA1 Message Date
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Arsen Losenko
dfdec6668d Source Hubspot: enable SAT high strictness (#21775)
* Source Hubspot: enable SAT high strictness

* Ignore stream companies for basic read because one of the fields are constantly changing

* Ignore streams that change often

* Remove contacts stream from empty_streams

* Updated expected records

* add not empty streams to expected records

* Updated expacted records

* Added allowedHosts

* Skiped property_history stream for basic read

* Resolve packages dependecy conflict

---------

Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
2023-02-06 23:11:30 +01:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Ella Rohm-Ensing
68bcced15d Turn off default httpavailabilitystrategy for source-hubspot (GA) (#22009)
* Turn off default for source-hubspot (GA)

* Update streams.py

* Update hubspot.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-28 02:18:41 +00:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850)
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
2023-01-03 15:55:36 -08:00
Roman Yermilov [GL]
fd13d43a13 Source Hubspot: remove API Key authentication type (#18546)
* Source Hubspot: remove API Key authentication type

* Source Hubspot: update changelog

* Source Hubspot: update sample files

* Source Hubspot: update integration test

* Update hubspot.md

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-09 16:48:14 +04:00
Artem Inzhyyants
d88a81c291 🐛 Source HubSpot: fix property scopes (#18624)
* 🐛 Source HubSpot: fix property scopes

* 🐛 Source HubSpot: bump version

* 🐛 Source Hubspot: fix properties for auth

* 🐛 Source Hubspot: fix log messages

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-11-07 20:31:04 +01:00
Artem Inzhyyants
b4461d3e23 🐛 Source Hubspot: acceptance fix (#18498) 2022-10-27 10:20:18 +02:00
Artem Inzhyyants
86cb666b93 🐛 Source Hubspot: update CDK; fix expected test result according to 0.2.2 update (#18424) 2022-10-25 16:46:56 +02:00
Brian Lai
3521802545 Update Python Source connectors to use the latest airbyte-cdk minor version (#18261)
* update all connectors currently only adhering to patch versions to pull latest minor version

* also add greenhouse

* fix scaffolds
2022-10-20 16:06:02 -04:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Serhii Lazebnyi
06186d2596 🐛Source Hubspot: Fixed 403 error validation (#16914)
* Fixed 403 error validation

* Updated PR number

* Updated after review

* Updated after review

* Updated version

* Add ignoredd fields

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-04 01:07:36 +02:00
Augustin
0f618f3503 migrate GA source connectors to per-stream state (#17326) 2022-09-29 14:45:35 +02:00
Augustin
34b4821c8c source-hubspot: migrate to per-stream state (#17120) 2022-09-28 16:21:59 +02:00
Denys Davydov
7934eed363 Source Hubspot: remove FeedbackSubmissions stream (#16632)
* #586 source hubspot: rm FeedbackSubmissions stream

* #586 source hubspot: upd changelog

* #586 source hubspot: fix unit tests

* #586 source hubspot: fix SATs

* #586 source hubspot: review fixes

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-13 18:08:51 +03:00
Vladimir remar
30ac38ed3f 🎉 Source Hubspot: Update Tickets, fix missing properties and change how state is updated. (#16214)
* fix: missing properties

* update: change Tickets stream to use SearchStream

* WIP: change how state is update

* fix unit tests

* update docs and dockerfile

* update: docs and add comments to code to explain the new state strategy

* update hubspot.md

* update: redo how state is saved

* fix: unit tests

* remove trivial log

* fix: add safe way to save last_slice

* fix: unit tests

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-09-09 15:14:05 +03:00
Vladimir remar
eb2c7ad60e Source Hubspot: check if it has a state on search streams (#15110)
* check if it has a state

* update version in Dockerfile and docs

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-22 02:28:22 -03:00
Denys Davydov
3dd9e9fe3c source hubspot: fix sat (#15590) 2022-08-12 12:07:00 +03:00
Denys Davydov
2344b460d3 Source Hubspot: fix Deals stream schema (#15354)
* #393 oncall. Source Hubspot: fix Deals stream schema

* #393 source hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-05 14:34:20 +03:00
Denys Davydov
09d6901498 Source Hubspot: fix 401 for associations (#15156)
* Revert "Source Hubspot: revert v0.1.78 (#15144)"

This reverts commit cbdb897aa1.

* #379 source hubspot: fix 401 when reading associations

* #379 source hubspot: fix 401 when reading associations

* #379 source hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-02 10:34:54 +03:00
Denys Davydov
cbdb897aa1 Source Hubspot: revert v0.1.78 (#15144)
* Revert "Source Hubspot: implement new stream to read associations in incremental mode (#15099)"

This reverts commit dd109debec.

* #359 rollback

* hubspot: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-29 19:47:36 +03:00
Denis Davydov
dd109debec Source Hubspot: implement new stream to read associations in incremental mode (#15099)
* #359 oncall - source hubspot: implement new stream to read associations in incremental mode

* #359 source hubspot: upd changelog

* #359 source hubspot: do not pass identifiers

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-28 22:00:45 +03:00
Denis Davydov
6d812bfee6 Source Hubspot: do not limit reading data to 30 days for property History Stream (#15035)
* #352 source hubspot: do not limit reading data to 30 days for property history stream

* #352 oncall: source hubspot - upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-26 16:53:36 +03:00
Denis Davydov
fefcc22bb7 Source Hubspot: revert v0.1.75 changes (#14999)
* Revert "Source Hubspot: do not override _read_incremental (#14744)"

This reverts commit ae0cf4cb34.

* #14034 source hubspot: revert previous version changes

* #14034 upd changelog

* #14034 do not revert source definitions

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-26 13:13:50 +03:00
Denis Davydov
ae0cf4cb34 Source Hubspot: do not override _read_incremental (#14744)
* #14034 source hubspot: do not override _read_incremental

* #14034 source hubspot: upd changelog

* #14034 source hubspot: flake fix

* #14034 source hubspot: update state after each record and fix incremental reads

* #14034: fix formatting

* #14034 source hubspot: rm unnecessary check

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-18 16:28:56 +03:00
Vladimir remar
2b7a12bfc2 🎉 Source Hubspot: Add private app authentication (#14412)
* add new authentication method

* update connector version in Dockerfile and hubspot.md

* update: check credentials title through constants

* add constant file for credentials title values

* update dockerfile

* add 'API Key Credentials' to constants

* chore: added connector to definitions

* auto-bump connector version

* chore: formatting

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-17 16:52:09 +05:30
Denis Davydov
400f4e6aef Source Hubspot: refactor PropertyHistory stream (#14666)
* #291 oncall. Source Hubspot: disable Incremental mode for PropertyHistory stream and decrease number of http requests made

* #291 oncall: upd changelog

* #291 oncall: rm property_history stream from full_refresh SAT

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-14 10:14:13 +03:00
Baz
3ce1ee96df 🐛 Source Hubspot: fixed SAT test, commented out expected_records (#14140) 2022-06-27 12:47:57 +03:00
Denis Davydov
41e88a8dda Source Hubspot: extend error logging (#14054)
* #291 incall - source Hubspot: extend error logging

* huspot: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-24 10:24:08 +03:00
Baz
21b43f56cc 🐛 Source Hubspot: remove AirbyteSentry dependency (#14102)
* fixed

* updated changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-24 08:38:44 +03:00
Denis Davydov
723bf660d8 Source Hubspot - fix missing data issue (#13837)
* #278 oncall: source hubspot - fix missing data issue

* #278 oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-16 11:44:46 -07:00
Denis Davydov
5df20b7316 Source Hubspot: fix URI too long issue (#13691)
* #268: fix URI too long (HubSpot)

* #268 upd changelog

* #268 oncall: review fix

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-10 22:30:52 +03:00
Denis Davydov
922bf46e8f Source Hubspot: fix for property_history stream (#13596)
* #259 on call: Source Hubspot - fix for the property_history stream which did not emit any records

* #259 Source Hubspot: upd changelog

* #259 oncall: hubspot review fixes

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-09 10:21:08 +03:00
Alexandre Girard
f1d79b201f Source Hubspot: report which scopes are missing to user (#13566)
* Report missing scopes

* simplify

* bump

* emit trace message

* remove print

* more careful error handling

* Add typing

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-07 14:10:03 -07:00
Serhii Chvaliuk
7800b52f4d 🐛 Source Hubspot: scope crm.objects.feedback_submissions.read added for feedback_submissions stream (#13475)
* crm.objects.feedback_submissions.read added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* hubspot.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-06 14:11:01 +03:00
Alexandre Girard
1225f80bd8 Source hubspot: filter out streams we don't have access to (#13455)
* filter out streams we don't have access to

* cleanup

* fix associations

* fix for api key auth

* this doesn't need to be a property method

* Bump

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-03 12:06:51 -07:00
Serhii Chvaliuk
537c9bab0e 🐛 Source HubSpot: Transform contact_lists data to comply with schema (#13218)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-02 23:07:07 +03:00
Serhii Chvaliuk
d0d74ec730 🎉Source Hubspot: Fix connector incremental state handling (#13320)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-06-02 18:26:55 +03:00
Serhii Lazebnyi
bdf6ba8463 🎉Source Hubspot: Associated line items to deals (#13383)
* Associated line items to deals

* Bumped version

* Bumped version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-02 14:54:27 +03:00
Alexandre Girard
1b6779d619 [OC-252] Hubspot Source: Request optional scopes (#13381)
* Set optional scopes

* update test

* required scopes

* fix

* Add a comment

* try empty scopes

* remove scopes to ensure it fails

* Revert "remove scopes to ensure it fails"

This reverts commit ba65642945.

* reorder

* set at least one required scope

* dont check for authorized scopes

* update docs

* Don't fail on missing scopes

* Revert "Don't fail on missing scopes"

This reverts commit 43ee93af9d.

* bump docker tag

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-06-01 19:35:06 -07:00
Serhii Chvaliuk
ad1fd2b742 🐛 Source Hubspot: use RFC3339 datetime (#13159)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-30 15:54:13 +03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Serhii Chvaliuk
1c8b18890d Source Hubspot: ensure all oauth2.0 scopes in "check" command (#12711)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-05-12 12:50:43 +03:00
Dany Chepenko
4b9ff01d46 Source Hubspot: Added deals associations for quotes (#12198) 2022-05-05 09:00:25 +02:00
Andy
5aed8e2147 Update connector specs (#12482) 2022-05-04 22:44:44 -07:00
Alexandre Girard
ce1936e491 Source Hubspot - Log instructions to update scopes when hitting 403 HTTP error (#12515)
* read workflows

* try except

* Revert "read workflows"

This reverts commit 86db8ff850.

* Check campaigns

* Check by reading data

* Check all streams

* requests_mock.ANY

* mock all http methods

* Try with get and post

* reset to master

* log name

* bump version
2022-05-02 17:45:50 -07:00
Brian Lai
bb2da42fde source freshdesk, hubspot, mixpanel, paypal-transaction, salesforce, zendesk-support: adding fixtures to mock time.sleep for connectors that explicitly sleep (#12335)
* adding fixtures to mock time.sleep for connectors that explicitly sleep

* bump connector versions

* update changelog doc for each connector

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove version bump for freshdesk because connector tests are in a bad state

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-04-28 12:21:45 -07:00
Marcos Marx
e0902e6e30 🐛 Source Hubspot: correct createAt and updateAd data type (#12424)
* correct createAt and updateAd data type

* bump connectorversion

* bump connector version again
2022-04-28 13:00:28 -03:00
Pedro S. Lopez
aa872d0016 update various connectors to use YAML specs (#12230)
* salesforce uses spec.yaml

* stripe uses spec.yaml

* revert unintended changes

* bump stripe version

* add yaml files to package_data

* hubspot uses a spec.yaml

* use double quotes in yaml files

* google sheets uses spec.yaml

* exhcange-rates uses spec.yaml

* remove usage of default and enum in spec

* bump hubspot cdk requirement

* auto-bump connector version

* auto-bump connector version

* manually bump versions

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-04-20 19:59:05 -07:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00