1
0
mirror of synced 2026-01-07 18:06:03 -05:00
Commit Graph

58 Commits

Author SHA1 Message Date
Roman Yermilov [GL]
a8a2ba3011 Source Mixpanel: fix start/end date format (#28511) 2023-07-21 13:47:05 +04:00
Denys Davydov
7ae4f8686b 🐛 Source Mixpanel: reimplement backoff strategy (#27752)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* Add stream ShippingRates

* #2363 source mixpanel: reimplement backoff strategy

* #2363 source mixpanel: upd changelog

* #2363 source mixpanel: revert v0.1.32

* rework rate limits

* wait only when running CAT + increase timeouts

* #2363 return backoff time

* code format

* use env variable instead of a hidden field in the config

* review comments

* review fixes

* fix reading env var

* Resolve conflicts, Bump version

* Attempt to bump version to avoid caching

* split test config into to projects

* rollback version

* undo non related changes

* remove non related changes

* revert new line

* fix funnel slice patching

* fix funnel slice patching

* do not use stream state for generating request params!

* fix updating state

* Revert "do not use stream state for generating request params!"

This reverts commit 443781eaa9.

* revert prev commits

* fix timestamp filtering

---------

Co-authored-by: btkcodedev <btk.codedev@gmail.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: maxi297 <maxime@airbyte.io>
2023-07-18 14:02:21 +03:00
Daryna Ishchenko
e9f9c41b17 🐛 Source Mixpanel: add handler for 402 error (#27252)
* added handler for 402 error

* added changelog

* fixed CAT, updated logging

* changed stream in check_connection

* refactored tests

* added check for all streams to avoid 402 error

* added check for all stream for right permissions

* upadated expected records

* updated streams method

* added get_json_schema to streams method

* refactored check_connection method
2023-06-15 21:02:13 +03:00
jeremySrgt
d369fd9c0c Source Mixpanel: add insert_id to export stream schema to have a unique event identifier (#21837)
* Add Mixpanel's property "insert_id" to export schema

* Bump Mixpanel connector version

* Add changelog to source readme

* update version

* Update metadata.yaml

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: Mal Hancock <mhancock@archangelic.space>
Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-06-05 15:25:10 -03:00
Daryna Ishchenko
b973bc8dd3 Source Mixpanel: ConnectionResetError fix (#25543)
* added HttpAvailabilityStrategy and undeclared fields for annotations and export streams

* added extra fields to export stream, updated expected records

* added exponential backoff

* changed testing range days to 10

* updated expected records, added typeTransformer to exports stream

* added changelog

* removed HttpAvailabilityStrategy property

* added null in type for annotations schema

* removed unused imports in base.py

* added retry for sream export when ConnectionResetError occurs

* added changelog

* fixed version in changelog

* bump version in metadata.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-04 09:32:40 +03:00
Daryna Ishchenko
7c36b5fb2f Source Mixpanel: added HttpAvailabilityStrategy and undeclared fields for export and annotations streams (#25056)
* added HttpAvailabilityStrategy and undeclared fields for annotations and export streams

* added extra fields to export stream, updated expected records

* added exponential backoff

* changed testing range days to 10

* updated expected records, added typeTransformer to exports stream

* added changelog

* removed HttpAvailabilityStrategy property

* added null in type for annotations schema

* removed unused imports in base.py

* bump version in metadata.yaml

* updated expected records

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-03 12:13:50 +03:00
Arsen Losenko
b19b0557b3 Source Mixpanel: Mark datefields in spec as dates (#22936)
* Source Mixpanel: Mark datefields in spec as dates

* Update changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-04-06 15:52:11 +03:00
Yowan Ramchoreeter
c6ac02931d Updating a typo: Harvest -> Mixpanel (#24442)
Minor typo: the docs mention Harvest instead of Mixpanel
2023-03-23 20:57:36 -04:00
Sophia Wiley
76df2f240a Docs: Update broken links (#23940)
* updated_links_in_docs

* updated more links

* typo

* removed backticks

* deleted links in deploying on cloud and local deployment
2023-03-13 20:38:25 +01:00
Sophia Wiley
5512befeb1 Docs: updated links from .io to .com (#23652)
* updated links

* edited contributors link

* deleted line about CDK in docs
2023-03-06 17:27:55 +01:00
Ella Rohm-Ensing
57d44e68fc Turn off default httpavailabilitystrategy for source-mixpanel (GA) (#22017)
* Turn off default for source-mixpanel (GA)

* Update base.py

* Update mixpanel.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-01-28 00:48:03 -05:00
Serhii Lazebnyi
6801049111 Source Mixpanel: enable high test strictness level in SAT (#21510)
* Enable high test strictness

* Updated expected_records.jsonl

* Updated expected records

* Increased timeout

* Updated abnormal state

* Updated cursor_path

* Updated acceptance tests config
2023-01-25 20:34:13 +01:00
Serhii Chvaliuk
c01b81bddb Source Mixpanel: "export" stream make line parsing more robust (#18846)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-11-03 19:46:06 +02:00
Amruta Ranade
fbe16d1bef edited connector docs (#18855) 2022-11-02 12:14:37 -04:00
Marcos Marx
c4f6cbeff4 🐛 Source Mixpanel: solve cursor field none expected array (#17699)
* solve cursor field none expected array

* update doc

* correct cursor_field

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-07 10:34:53 -03:00
Serhii Chvaliuk
f0f60dcebf Source Mixpanel: disable stream "cohort_members" on discover if no access (#17415)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-30 11:17:00 +03:00
Augustin
ff4ea3961a Republish connectors using CDK 0.1.88 to 0.1.89 (#17304) 2022-09-28 18:18:59 +02:00
Serhii Chvaliuk
01c8eb1d97 🎉 Source mixpanel - disable streams "export", "engage" on discover if no access (#17145)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-27 09:14:54 +03:00
Serhii Chvaliuk
e3553fea22 🎉 Source mixpanel: Service Accounts added (#16915)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-26 16:34:45 +03:00
Serhii Chvaliuk
a670d45afd 🎉 Source mixpanel: add streaming for export stream :) (#16843)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-18 16:30:10 +03:00
Serhii Chvaliuk
e03f47ef6a 🎉 Source mixpanel: Use "Retry-After" header for backoff (#16770)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-15 15:40:29 +03:00
Serhii Chvaliuk
5edc575333 🎉 Source mixpanel: Improved connector's input configuration validation (#16570)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-09-13 12:12:14 +03:00
Kris Sikora
a4916a4a1b Mixpanel: Filtering out individual items based on datetime in state (#15091)
* Mixpanel: Filtering out individual items based on datetime in state

* Mixpanel: Filtering out individual items based on datetime in state

* Mixpanel: Use where API option to further filter out events

* Fixing unit tests

* Fixing unit test timezone issues

* Version bump + docs

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-23 01:53:43 -03:00
Serhii Lazebnyi
c655e3a4e0 🐛Source Mixpanel: Updated field title and description (#15739)
* Updated field title and description

* Bumped docker version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-19 20:41:28 +02:00
Augustin
13b59c0ab8 non-jdbc source connectors: Remove additional properties from beta/GA specs and schemas (#14924) 2022-07-22 12:20:08 +02:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
Roman
d79b319819 🎉 Source Mixpanel: Beta preparation (#13372)
* Add extra mode to Source, to allow run acceptance tests
* move streams into distinct modules
* Add property name transformation for Export stream for avoiding collisions
* Update doc
* Add `date_window_size`
2022-06-02 13:31:23 +03:00
Michael Nguyen
ab81e4d1a0 Source Mixpanel: Added "end_date" field in specs (#12801)
* Added end_date for source mixpanel

* Update airbyte-integrations/connectors/source-mixpanel/source_mixpanel/spec.json

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

* add end_date

* auto-bump connector version

Co-authored-by: Cheryl0402 <yi.cheryl.chen@gmail.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-05-30 16:40:27 -03:00
Roman
46d56fac3e Fix of documentation links (#13164) 2022-05-25 12:59:44 +03:00
Andy
5aed8e2147 Update connector specs (#12482) 2022-05-04 22:44:44 -07:00
Ivica Taseski
aab4f34ca4 🎉 Source Mixpanel: Enhance streams to incremental (#11501)
* enhance streams to incremental

* revert file structure

* 11501

* add engage

* doc and bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-05-02 19:58:06 -03:00
Brian Lai
bb2da42fde source freshdesk, hubspot, mixpanel, paypal-transaction, salesforce, zendesk-support: adding fixtures to mock time.sleep for connectors that explicitly sleep (#12335)
* adding fixtures to mock time.sleep for connectors that explicitly sleep

* bump connector versions

* update changelog doc for each connector

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove version bump for freshdesk because connector tests are in a bad state

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-04-28 12:21:45 -07:00
Ivica Taseski
e4a55a4fde 🎉 Source Mixpanel: Increase unit test coverage (#11633) 2022-04-15 16:52:43 +02:00
Guillaume Chevalier
df55c9135d 🐛 Source Mixpanel : Fix Export HTTP Response Parsing (#11318)
* Fix Export HTTP Response Parsing

* bump connector version

* bump version in doc

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-04-04 20:19:33 -03:00
Xiangxuan Liu
b67894b39b Source Mixpanel: Fix cohort id always null in the cohort_members stream (#11227) 2022-03-31 22:27:14 +02:00
Baz
37c4a752fa 🐛 Source Mixpanel: bumped version, hot-fix. (#9320) 2022-01-05 21:59:26 +02:00
ycherniaiev
e17fa5b040 Update fields in source-connectors specifications: kustomer-singer, lemlist, linnworks, looker, marketo, mixpanel (#8578) 2021-12-25 13:56:20 +02:00
Baz
96081e19aa 🐛 Source Mixpanel: fix for discovery command takes a very long time (#8381) 2021-12-01 20:42:21 +02:00
Serhii Lazebnyi
9428b400d5 🐛 Source Mixpanel: Fix schemas and UI issues (#8256)
* Fixed schemas and ui issues

* Deleted anyOf structure from schema

* Updated PR number

* Added fields with static data types to cohort_members schema

* Add DefaultSchemaNormalization to Engage and CohortMembers streams

* Changed Transformer name

* Checkin specs
2021-11-29 19:33:38 +02:00
Vadym
504580d833 Remove base-python gradle dependencies in connectors where base-python is not used (#7499)
* Remeve base-python references.

* Add requirements.txt

* Fix requirements.txt blank line

* Fix source-exchange rates to common CDK approach

* Fix source-smartsheets SAT.
Fix source-exchange-rates build.gradle.

* Bump docker version

* Update source-dixa SAT config

* Fix source-exchange-rates SAT config

* Revert bump scaffold sources version

* Fix source-shortio SAT config

* Fix source-square invalid_config.json

* Fix source-us-census invalid_config.json

* Fix source-intercom versioning
2021-11-10 13:12:29 +02:00
oleh.zorenko
618b692798 🎉 Source Mixpanel: Support start_date older than 1 year (#7793)
* Support `start_date` older than 1 year
Add `timeout_seconds` to discovery test

* Set default date for `start_date` as year ago

* Update docs + update spec description

* Bump connector's version + update docs
2021-11-10 04:33:11 +02:00
Jared Rhizor
154ecceda0 improve link checker (#6797)
* improve link checker

* use ref instead of base_ref

* remove base, always compare to master for modified

* add failing to test

* don't do quiet for testing

* switch error to 404 not 403

* yes to both

* turn off verbose mode

* fix

* actually check things

* fix outstanding link problems

* revet change to run for everything

* use new format

* ignore gitbook failures

* switch back to only running on master
2021-11-07 23:01:08 -08:00
midavadim
f2ab450a8d 🐛 source mixpanel: hardcoded 'standard' properties for engage stream (#7505)
* Hardcoded 'standard' properties for engage stream to avoid normalization error (particularly for 'browser_version')

* updated change log message

* bumped connector version, updated change log

* fix table in docs
2021-11-03 12:38:56 +02:00
midavadim
6285d311f9 🐛 source mixpanel: match API limitation of requests rate (#7439)
* Added delay to for all streams, removed logic which increase reqs rate because it does not take into consideration actual number of requests made in previous and next streams.

* Fixed argmument passing

* Increased timeout for SAT

* Increased timeout for SAT

* bump version

* bumped connector version, updated change log

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-02 23:24:10 +02:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Yaroslav Dudar
33a1981c36 🐛 Source MixPanel: allow pulling data from different regions (#6075)
added region option
2021-09-18 17:42:04 +03:00
LiRen Tu
2906ec287a CI: Add action to check broken doc links (#5254)
* Add action to check broken doc links

* Ignore localhost

* Update config

* Fix broken links

* Use quiet mode

* Ignore PR link

* Fix more broken links

* Fix more broken links

* Fix more broken links

* Verify pattern

* Fix more broken links

* Separate full and pr check

* Update pattern

* Test invalid link

* Remove invalid link
2021-08-07 14:28:02 -07:00
midavadim
472857d672 🎉 Source mixpanel: migration to CDK (#4566)
* Mixpanel initiation

* copied schemas and specs file from singer connector

* authentication and a few streams

* Added Funnels + FunnelsList

* Added example of funnel response

* added incremental Funnels stream with tests

* added Annotations, CohortMembers, Engage, Cohorts, Funnels

* added Revenue

* fixed formatting

* fixed variable names

* fixed cohort_members and updated export streams

* moved start_date and date checks into SourceMixpanel class

* added error handling

* added unit test, update docs and ci creds

* fix url base for export stream

* added full and incremental read for export stream

* updated acceptance tests, added limit correction based on number of streams, export cursor is stored in datatime string

* Funnel stream - added complex state which contains state for each funnel

* added attribution windows support and project timezone config

* fixed formatting

* added default timezone

* added dynamic schema generation for Engage and Export streams

* fixed formatting

* fixed ability to pass start_date in datetime format as well

* fixed ability to pass start_date in datetime format as well

* added additional_properties field for dynamic schemas. updates regex for start_date matching to support old config file

* fixed formatting

* export stream - convert all values to default type - string

* added schema ref

* added new properties for funnel stream

* fixed formatting in funnel schema

* added build related files

* update changelog

* fixed and added comments, renamed rate_limit variable

* fixed formatting

* changed normalization for reserved mixpanel attributes like $browser

* alphabetise spec fields

* added description about API limit handling

* updated comment
2021-07-20 02:31:13 +03:00
Marcos Marx
6201100e72 Add entrypoint and bump version for remaining connectors. (#4539)
See the PR descriptions for all the connectors published.
2021-07-07 17:37:22 +08:00