jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 02:51:29 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

41 Commits

Author SHA1 Message Date
Tope Folorunso
1f696d67b8 ✨Source Hubspot: Add Leads Stream (#44481) 2024-11-15 20:25:29 +02:00
Christo Grabowski
f39f3fc7a9 Source Hubspot (refactor): Remove deprecated state method calls (#39432) 2024-06-19 12:39:04 -04:00
Serhii Lazebnyi
e467d02afe ✨ Source Hubspot: Add contacts form submissions stream (#34829) 2024-02-07 21:59:25 +01:00
Roman Yermilov [GL]
8bd60a946e 🚨🚨Source Hubspot: add property history streams for Deals and Companies (#33266) 2023-12-12 22:29:43 +01:00
Roman Yermilov [GL]
98d57db5e8 Source Hubspot: Web Analytics API (#33042) 
Co-authored-by: roman-yermilov-gl <roman-yermilov-gl@users.noreply.github.com>
 2023-12-08 15:04:18 +01:00
Augustin
9c0a343f2e prettier format json files (#33171) 2023-12-07 18:35:29 +01:00
Roman Yermilov [GL]
3adc81561d Source hubspot dev (#33031) 
Co-authored-by: Christo Grabowski <108154848+ChristoGrab@users.noreply.github.com>
Co-authored-by: Anatolii Yatsuk <35109939+tolik0@users.noreply.github.com>
Co-authored-by: Edward Gao <edward.gao@airbyte.io>
 2023-12-04 15:45:14 +01:00
Arsen Losenko
021a9787dc Source Hubspot: Add OwnersArchived stream (#29249) 
* Source Hubspot: Add OwnersArchived stream

* Update changelog and CAT config

* Update expected records, update schema

* Update unit tests

* Set archived to true explicitly
 2023-08-11 19:08:16 +03:00
Antoine Balliet
ebb84e598c ✨Source HubSpot: New stream for contacts merged audit (#27091) 
* feat: add ContactsMergedAudit stream

* Update hubspot.md

* apply formatting

* Add to source

* Update catalog

* bump version in metadata.yaml

* use vid-to-merge as primary key

* fix format

* add additionalProperties prop in schema

* refactor by creating functions

* More details about API version choices

* Add docstring

* more explicit properties definition

* unit testing

* fix: modify expected_records for contacts_merged_audit stream

* Add abnormal state for contacts_merged_audit stream

* Update README.md

* WIP substream

* Apply formatting

* remove

* fix parent child stream

* remove diff title bar changelog

* fix unit tests

* improve naming

* Remove unused import

* updated schema

* simplify batch creation

* fix stream which doesnt allow incremental

* dockerfile

* fix: updated expected_records for contacts stream

* docs: bump metadata.yml file and update connector changelog

---------

Co-authored-by: Sunny Hashmi <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-07-27 13:29:34 -04:00
Baz
14dbfe88c1 🐛 Source Hubspot: fix then state has explicit empty str state value (#26719) 2023-05-29 22:31:58 +03:00
Luis Gomez
0549bac1ef 🎉 Source Hubspot: Added custom object streams (#16032) 
* Added custom object stream

* Added tests

* Removed unused variable in test

* Updated CDK version

* Removed Quotes (was already removed)

* Applied some feedback

* fix custom object schema reading

* fix expected records

* Update test_streams.py

* add expected records

* add missing line

* fix integration tests

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2023-05-18 22:41:39 -03:00
Gergely Imreh
fa98b67e1f 🎉 Source Hubspot: add Goals stream (#24450) 
* Source Hubspot: add Goals stream

* add tests

* add sample files

* update docs

* bump version

* format schema

* update Hubspot Goals stream to the correct scope

* update required auth scope in the documentation as well

* bump metadata version

* fix unit test

* Update test_source.py

* add expected records and fix abnormal state

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2023-05-18 12:25:08 -03:00
Artem Inzhyyants
52ca19930b Source hubspot: Add new stream DealsArchived (#24980) 
* Source Hubspot: replace whitespace with underscore in properties; fix schema

* Source Hubspot: bump version

* Source Hubspot: add Archived Deals Stream

* Source Hubspot: add docs

* Source Hubspot: fix expected records

* Source Hubspot: bump version; add docs

* Source Hubspot: update tests

* Source Hubspot: update docs

* Source Hubspot: fix unittest

* Source Hubspot: fix Deals Incremental read

* Source Hubspot: fix acceptance tests

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-10 11:44:05 +02:00
Artem Inzhyyants
120cb14bed Source hubspot: add incremental streams (#24711) 
* Source Hubspot: Add incremental sync for streams

* Source Hubspot: Reformat

* Source Hubspot: bump version; + docs

* Source Hubspot: fix abnormal state

* Source Hubspot: fix parsing data with milliseconds

* Source Hubspot: fix date storage in milliseconds

* Source Hubspot: fix backward compatibility

* Source Hubspot: fix tests

* Source Hubspot: fix tests

* Source Hubspot: fix tests

* Source Hubspot: fix tests

* Source Hubspot: update ignored fields

* Source Hubspot: update ignored fields

* Source Hubspot: update expected records

* Source Hubspot: remove disable backward compatibility

* Source Hubspot: add comments; change cursor_value to empty string; add abstract method

* Source Hubspot: update abnormal state

* Source Hubspot: update abnormal state

* Source Hubspot: update expected records

* Source Hubspot: update expected records

* Source Hubspot: Refactored + docs updated

* Source Hubspot: Refactored + add unit tests

* auto-bump connector version

* Automated Change

* Source Hubspot: bump connection version

* Automated Change

* Empty-Commit

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: artem1205 <artem1205@users.noreply.github.com>
 2023-04-06 22:35:00 +02:00
Aazam Thakur
fcfcf490b7 Source Hubspot: new stream Email Subscriptions (#22910) 
* Check connection works

* Fixed reading records and passing unit tests

* Added stream in oauth and full_refresh catalogs

* Check connection works

* Fixed reading records and passing unit tests

* Added stream in oauth and full_refresh catalogs

* updated schema

* updated docs

* updated streams.py

* add additionalProperties to email subscriptions

* add expected records

* auto-bump connector version

---------

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-03 14:31:51 -03:00
Roman Yermilov [GL]
fd13d43a13 Source Hubspot: remove API Key authentication type (#18546) 
* Source Hubspot: remove API Key authentication type

* Source Hubspot: update changelog

* Source Hubspot: update sample files

* Source Hubspot: update integration test

* Update hubspot.md

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-12-09 16:48:14 +04:00
Denys Davydov
7934eed363 Source Hubspot: remove FeedbackSubmissions stream (#16632) 
* #586 source hubspot: rm FeedbackSubmissions stream

* #586 source hubspot: upd changelog

* #586 source hubspot: fix unit tests

* #586 source hubspot: fix SATs

* #586 source hubspot: review fixes

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-13 18:08:51 +03:00
Denis Davydov
400f4e6aef Source Hubspot: refactor PropertyHistory stream (#14666) 
* #291 oncall. Source Hubspot: disable Incremental mode for PropertyHistory stream and decrease number of http requests made

* #291 oncall: upd changelog

* #291 oncall: rm property_history stream from full_refresh SAT

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-07-14 10:14:13 +03:00
Denis Davydov
723bf660d8 Source Hubspot - fix missing data issue (#13837) 
* #278 oncall: source hubspot - fix missing data issue

* #278 oncall: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-06-16 11:44:46 -07:00
Denis Davydov
922bf46e8f Source Hubspot: fix for property_history stream (#13596) 
* #259 on call: Source Hubspot - fix for the property_history stream which did not emit any records

* #259 Source Hubspot: upd changelog

* #259 oncall: hubspot review fixes

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-06-09 10:21:08 +03:00
Davin Chia
5a575e42e0 Format connectors. (#11231) 2022-03-17 19:08:01 +08:00
girarda
b19f2415a9 🎉 Source HubSpot: Set Primary keys for streams with an identifier (#11121) 
* Set partition key on streams with id field

* reset to master

* Update readme with primary key

* This can be incremental

* I think this can also support incremental

* incremental streams

* incremental

* Missing comma

* Everything can be incremental

* set pk

* Add a primary key

* Add missing pk

* format

* Update doc

* Bump version

* Not everything can be incremental

* fix field

* Update pk

* Update source_specs
 2022-03-15 15:06:28 -07:00
Vladimir remar
983d6ae2ba :tada:Source hubspot add new streams for engagements(calls, emails, meetings, notes and tasks) (#9786) 2022-02-04 20:09:29 +01:00
LiRen Tu
a094142825 Format code (#9892) 2022-01-29 19:56:00 -08:00
Tino Merl
b40b303638 🎉Source HubSpot: Adds form_submission and property_history streams (#7787) 
* Began working on HubSpot Form Submission Connector

* Added Property History Stream

* Added form_guid to as value to form_submissions_stream.

* Finalized the Form Submission Stream

* Added documentation and test config

* Corrected Version Number

* updated version number to 0.1.25

* removed or none worked on tests

* Changed code due to review comments & merges

* readded Propertyhistory after merging

* bump connector version

Co-authored-by: Tino Merl <tino.merl@park-sieben.com>
Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2022-01-26 00:34:15 -03:00
Vladimir remar
d616279bea Source hubspot: add Feedback Submissions stream and update Ticket Pipelines stream (#9081) 
* update: on api.py update url for ticket_pipelines

* update: on client.py add new entries for feedback_submissions streams and ticket_pipelines

* update: add to shchemas feedback_submissions and ticket_pipelines

* update: to integration_tests_abnormal_state add new value for feedback_submissions

* update: in sample_files add new entries for feedback_submissions and ticket_pipelines

* update: bump connector version

* fix: in feedback submission replace timestamp to updatedAt

* update version in source_definitons and Dockerfile

* run format

* config seed

* bump connector version in config file

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2022-01-24 23:06:27 -03:00
Luis Gomez
25fb7e7fd7 Source Hubspot: Some incremental CRM objects and engagements (#8887) 2022-01-17 11:54:31 +01:00
gergelylendvai
9cc2560935 Source Hubspot: adding form_submissions stream (#8011) 
* Source Hubspot: adding form_submissions stream

* Adding form_id to form_submissions output

* Adding form_id to form_submissions output and schema

* Removing field deletions and id generation

* Adding new line to form_submissions.json

* Fixing form_submissions.json schema

* add form_submissions as empty_stream to run ci airbyte

* add forms_submissions to empty_stream

* bump connector seed version

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2022-01-13 21:06:51 -03:00
vitaliizazmic
7c4ae13473 🎉 Source HubSpot: support list memberships in Contacts stream (#9129) 
* Source Hubspot #8477 - separate stream for contacts list memberships

* Source Hubspot #8477 - reformat

* Source Hubspot #8477 - fix basic read tests: add contacts_list_memberships to empty streams

* Source Hubspot #8477 - bump version and update documentation
 2022-01-10 22:26:25 +02:00
Baz
102994541a 🎉 Source Fecebook-Marketing: add asset_feed_spec to ad creatives stream (#8962) 2021-12-21 15:46:52 +02:00
Serhii Lazebnyi
212c1ff22c 🎉 Source Hubspot: Support incremental sync on all possible streams (#8699) 
* Add incremental sync support for companies, contact_lists, contacts, deals, line_items, products, quotes, tickets streams

* Updated PR number

* Fix formating

* Fix typo

* Commented unsupported tests

* Updated to review

* Updated abnormal state file

* Deleted comment

* Updated version in docker

* Updated version in spec yaml and seed
 2021-12-17 15:48:47 +02:00
Hai To
fae4d00c8f Source Hubspot: Add new marketing emails (with statistics) stream (#5840) 
* Add new marketing emails (with statistics) stream

* Update docs and changelog
 2021-10-20 20:37:48 -03:00
Yevhenii
6c4ae4aac4 Source Hubspot: update SAT config (#6995) 
* Update discover method: disable quotes stream when using OAuth config
 2021-10-14 13:37:49 +03:00
Yevhenii
5971983004 Source HubSpot: Add dealstage history retrieval to DealStream (#4131) 
* Source HubSpot: Add dealstage history retrieval to DealStream

* Apply code review feedback, handle missing attrs

* Fix URL and updated_at field

* Apply CR feedback: impl _transform to parse nested fields

* Only yield records having a populated dealstage field

* update SAT for hubspot connector

* bump version

* update handling Rate Limiting for Hubspot

* code clean up

Co-authored-by: Jacob Avelino <jacobavelino@berkeley.edu>
Co-authored-by: Jacob Avelino <jacob7227@yahoo.com>
Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-06-16 16:12:35 +03:00
Vadym
cea80b451e Hubspot: Added deals associations for company and contacts (#3850) 
* Added deals associations for company and contacts

* Fixing the format under client.py

Co-authored-by: Vadym <vege1wgw@gmail.com>

* Update deals schema.
Update deals expected records.

Co-authored-by: Stanley Ivan <salexand001@e.ntu.edu.sg>
Co-authored-by: stanleyivan96 <51161692+stanleyivan96@users.noreply.github.com>
 2021-06-07 15:58:30 +03:00
Eugene Kulak
88b77aa9f3 Standard tests: update template (#2937) 
* update template for python sources
* update templates and their docs
* update docs, rename folders, add acceptance script
* adding hooks for custom setup and teardown
+ improve plugin behaviour, enable it explicitly
+ add acceptance.py to run acceptance tests together with integration tests
+ remove helper acceptance-test-python.sh
+ fix gradle command for acceptance tests
+ update docs

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-04-28 18:11:48 -04:00
Eugene Kulak
1755847c5e Standard Tests: create modular standard test suite v2 scaffolding (#2702) 
* Standard Tests: Implement v2 test suites #2181 (#2792)
* rename standard tests (v2) to source_acceptance_test
 2021-04-20 15:26:16 -04:00
Christophe Duong
bc1547f185 Fix integration tests of connectors related to destination_sync_mode and sync_mode being required (#2688) 2021-04-01 09:58:38 +02:00
Sherif Nada
77b72dcf5b Revert "Revert "Merge branch 'master' of github.com:airbytehq/airbyte"" 
This reverts commit de66bf010d.
 2021-03-23 15:12:01 -07:00
Sherif Nada
de66bf010d Revert "Merge branch 'master' of github.com:airbytehq/airbyte" 
This reverts commit a3a27f2fa2, reversing
changes made to 5917feee28.
 2021-03-23 15:09:44 -07:00
Eugene K
0b9b038ca4 🎉 New source: Native Hubspot connector (#2215) 
* #2150 Issue: created native connector with schema folder populated

* #2150 Issue: make format code

* first version

* fix few issues

* fix issues

* fix read issue

* format

* docs

* docker tags

* extend configured catalog for testing

* fix source definitions

* format

* fix call rate issue, add backoff for retry after

* add general backoff

* write secrets for new connector

* drop singer connector registration

* refactor streams, resolve properties in schemas at runtime

* replace deprecated endpoint for company contacts

* replace deprecated pipeline endpoint

* update comments

* update docs

* fix typo

* fix stream contact lists

* fix pagination and forms result fetching

* fix health_check

* format and update catalog

* revert changes

* drop singer based hubspot

* fix company contacts substream

* move deals to separate test

* fix deals tests

* remove dynamic fields from records

* move deals to catalog again

* extend CRMObjectStream with associations

* format

* update schemas with updated field, change engagement layout

* fix Campaign stream

* remove custom tests

* remove dependency

* remove oauth

* Source Hubspot: add incremental streams (#2425)

* add incremental

* add incremental

* polishing

* update docs

* fix docstring

* clean up

* fix incremental bookmark access

* fix incremental tests

* clean up

* add custom test for incremental, improve logging

* format

* Update airbyte-integrations/connectors/source-hubspot/source_hubspot/api.py

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Source Hubspot: best practices (#2537)

* fix error reporting and add unit tests

* fix test and refactor cursor fields

* format

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>

* restored configured_catalog.json

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-03-20 06:18:55 -03:00