1
0
mirror of synced 2025-12-21 11:01:41 -05:00
Commit Graph

40 Commits

Author SHA1 Message Date
Brian Lai
739ba6e9a1 fix(source-google-analytics-data-api): add dimensionFilters into the request body of custom reports and DimensionFilterConfigTransformation component (#67148)
Fixes https://github.com/airbytehq/oncall/issues/9565

## What

When migrating tolow-code + manifest-only format, we didn't migrate the
dimensionFilter feature, this change adds this back so requests to
Google's API include the dimension filter in the body of the request.

## How

There are two things that are done now:

1. We take the incoming config and transform it into the format expected
by Google's API. This is a direct port of what we used to do as a
pre-sync transformation:
https://github.com/airbytehq/airbyte/pull/60342/files#diff-c598765182c592504650290115e49900ef4b473307ddd69ea1662e6a6865cddfL206-L223
. This would also avoid a breaking change
2. Define in the stream template, the interpolation to inject the
dimensionFilter (if it exists) into the request body which will be
applied for each dynamic stream created by a custom_report

## Review guide

1. `components.py`
3. `manifest.yaml`

## User Impact

Should only be additive and fix customers with the issue

## Can this PR be safely reverted and rolled back?

- [x] YES 💚
- [ ] NO 
2025-10-08 15:02:31 -07:00
Serhii Lazebnyi
952c8f3bbc feat(source-google-analytics): migrate to low-code (#60342)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-06-06 12:42:43 +02:00
CapCaWork
1bc0b083e4 [source-google-analytics-data-api] Add end_date option (#48381)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2025-03-27 10:23:23 -03:00
Aaron ("AJ") Steers
83ecbe0fc3 CI: apply pre-commit format fix from #49806 (#49852) 2024-12-18 14:05:43 -08:00
Patrick Nilan
5fda600d3c [source-google-analytics-data-api] - Migrate to CDK v5 (#47013) 2024-10-28 16:53:45 -07:00
Aldo Gonzalez
e4623e8a3c 🐛 Source google-analytics-data-api: fix max time (#43929) 2024-08-13 13:52:40 -06:00
Aldo Gonzalez
fd7fa002fd Source google-analytics-data-api: upgrade cdk 3 (#42841) 2024-08-07 06:52:55 -06:00
Brian Lai
7528651f4d 🐛 [google-analytics-data-api] [tiktok-marketing] bump CDK version and fix state updater if no cursor_field (#36302) 2024-03-25 16:20:04 -04:00
Anatolii Yatsuk
5ecb97163d 🐛 Source Google Analytics Data API: Add rounding integer values that may be float (#34708) 2024-02-02 08:18:34 -04:00
Anton Karpets
4e694c5985 🐛Source Google Analytics: add incorrect custom reports config handling (#34352) 2024-01-18 17:50:42 +02:00
Artem Inzhyyants
c404899092 Source google analytics Data API: add a report option keepEmptyRows (#34176) 2024-01-15 11:37:41 +01:00
Artem Inzhyyants
ce84d11859 🐛 Source Google Analytics Data API: Add CohortSpec to custom report in specification (#33802) 2024-01-04 17:19:17 +01:00
Roman Yermilov [GL]
2007fda09a Source Google Analytics Data API: increase test coverage (#32289)
Co-authored-by: roman-yermilov-gl <roman-yermilov-gl@users.noreply.github.com>
2023-11-09 11:38:49 +04:00
Baz
3d136aa0c7 🐛 Source Google Analytics Data API: Fixed bug with missing metadata when the credntials are not valid (#32149)
Co-authored-by: bazarnov <bazarnov@users.noreply.github.com>
2023-11-03 15:11:30 -05:00
Denys Davydov
b406deb7fc 🚨 🚨 Source Google Analytics: fix stream naming (#30930) 2023-10-02 19:54:47 +03:00
Marius Posta
7ae97175a6 gradle: fix repo wide behaviour (#30607) 2023-09-28 05:01:13 -07:00
Serhii Lazebnyi
311c33bb77 Source Google Analytics (GAv4): custom reports migrated and add FilterExpression support (#30460)
Co-authored-by: lazebnyi <lazebnyi@users.noreply.github.com>
2023-09-22 20:55:54 +02:00
Serhii Lazebnyi
ae41c30b1a 🚨🚨🐛 Source Google Analytics: revert : auto replacement to underscore in column names (#30608) 2023-09-21 22:48:38 +02:00
Ryan Br
317f7acc22 Bigquery uses async framework (#30069)
Co-authored-by: tryangul <tryangul@users.noreply.github.com>
Co-authored-by: benmoriceau <benoit@airbyte.io>
Co-authored-by: benmoriceau <benmoriceau@users.noreply.github.com>
2023-09-20 16:34:07 -05:00
Serhii Lazebnyi
fa6ae0f2c4 Source Google Analytics (GAv4): add yearWeek, yearMonth, year dimensions cursor (#30421) 2023-09-19 17:09:09 +02:00
Serhii Lazebnyi
a984b753c2 Source Google Analytics (GAv4): change start date to optional; add suggested streams and update error… (#30417) 2023-09-15 21:38:42 +02:00
Baz
3f1f13c4d7 🐛 Source Google Analytics Data API: fix duplicated stream instance (#30424) 2023-09-15 11:59:17 +03:00
Edward Gao
68c6b01937 Destinations v2: threadsafe setup (#30439)
Co-authored-by: edgao <edgao@users.noreply.github.com>
2023-09-14 11:56:12 -05:00
Roman Yermilov [GL]
6442bd110c Source Google Analytics Data API: ability to add multiple property ids (#30152) 2023-09-14 15:12:14 +04:00
Serhii Lazebnyi
9f3d120b67 Source Google Analytics Data API: add new reports (#30290) 2023-09-13 15:09:43 +02:00
Denys Davydov
3d14fc721f 🐛 Source GA Data API: change page size when calling check() (#27718)
* Connector health: source hubspot, gitlab, snapchat-marketing: fix builds

* #2277 source GA: limit page size when calling check

* source GA: upd changelog

* code formatting

* #2277 review fixes
2023-06-29 10:52:04 +03:00
Serhii Chvaliuk
019153f178 Source Google Analytics v4: - add pk and lookback window (#26283)
* primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* bump 0.2.3

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* test_parse_response fixed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* metadata = None added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* LOOKBACK_WINDOW added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* google-analytics-data-api.md updated

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* threshold_days: 2 added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* remove uuid from acceptance-test-config.yml

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* uuid removed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* Automated Change

* oss_registry.json - removed

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range added for pivot_report pk

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* improve LOOKBACK_WINDOW

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* date_range -> (startDate, endDate)

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* bump 0.3.0

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* get_source_defined_primary_key added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* added comment about cohort get_json_schema

* Major Version Number Bump

---------

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: grubberr <grubberr@users.noreply.github.com>
Co-authored-by: Daryna Ishchenko <darina.ishchenko17@gmail.com>
2023-06-22 19:00:38 +03:00
Artem Inzhyyants
797eb4f427 Source google analytics data api: Improve error messages (#27175)
* Source Google Analytics v4: refactor error messages

* Source Google Analytics Data API: improve error messages

* Source Google Analytics Data API: Refactor

* Source Google Analytics Data API: bump version + update docs

* Source Google Analytics Data API: fix test config

* Source Google Analytics Data API: update message
2023-06-09 14:11:44 +02:00
Augustin
9099aa78cc source-google-analytics-data-api: fix formatting (#27011) 2023-06-05 09:21:06 -05:00
mpetrykin
746ccb4035 Source Google Analytics (GA4): Fix Pagination (#26126)
* Fix paggination and add offset and limit to acceptable parameters in request body

* Change next_page_token and add tests

* Update dockerImageTag

* Update PR version

* Remove minimum, maximum, pattern fields

* Remove pattern limit and offset from test_source.py

* Remove offset and limit string type

* Remove offset and limit string type

* Increase limit number to 100000 and remove limit and offset from parameters

* Change return type value of next_page_token from int to dict

* Change return type value of next_page_token from int to dict

* Change page_size to offset and add constant PAGE_SIZE equals 100000

* Add comment to PAGE_SIZE constant and add constant to unit tests

* Remove offset and limit from PivotReport

* Import PAGE_SIZE in unit_tests from source.py

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>
2023-05-31 13:57:34 -04:00
Serhii Lazebnyi
1060415870 🎉Categorized Config Errors Accurately for Google Analytics 4 (GA4) and Google Ads (#25987)
* Categorized Config Errors Accurately

* Update PR number

* Update error list for GAv4

* Updated version

* Updated formating

* auto-bump connector version

* Skip spec backward compatibility

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-12 21:39:10 +02:00
Baz
d9f653bc47 🐛 Source Google Analytics V4 Data API: handle 429 - potentiallyThresholdedRequestsPerHour (#26008) 2023-05-12 09:01:28 +03:00
Denys Davydov
3f327f60f3 Source Google Analytics Data API: implement advanced reports (#25179)
* #11689 source Google Analytics Data API: implement advanced reports

* #11689 source GA data API: upd changelog

* #11689 source GA data API: fix CAT

* #11689 source GA data API: fix CAT

* Have empty dict as default option

* Remove dateRange and dimensions from required params

* Generate source defintions manually

---------

Co-authored-by: Arsen Losenko <20901439+arsenlosenko@users.noreply.github.com>
2023-04-25 19:55:55 +03:00
Artem Inzhyyants
3e812513b0 Source Google Analytics v4: certify to GA (#23872)
* Source Google Analytics v4: check custom reports; remove date as required field

* Source Google Analytics: fix unit tests

* Source Google Analytics: fix unit tests

* Source Google Analytics: update to latest cdk

* Source Google Analytics: http -> https

* Source Google Analytics: add allowed hosts

* Source Google Analytics: docs update

* Apply suggestions from code review

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>

* Source Google Analytics: docs update

* Source Google Analytics: add expected records

* auto-bump connector version

---------

Co-authored-by: Ella Rohm-Ensing <erohmensing@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-16 15:41:29 +01:00
Baz
00752aaa50 🐛 Source Google Analytics 4 (GA4): improve rate limits messages and retry logic (#23822) 2023-03-11 21:15:07 +02:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Serhii Chvaliuk
59ff2a2f59 Source Google Analytics Data API: slicer updated, unit tests added (#21169)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-01-11 18:26:29 +02:00
Serhii Chvaliuk
4923edf20a Source: Google Analytics 4 (GA4) - improve config validation and SAT (#20889)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2023-01-09 16:52:08 +02:00
Roman Yermilov [GL]
e40ee3fd50 🎉Source Google Analytics Data Api: code refactoring (#15229)
* Source: google analytics data api refactoring

* google-analytics-data-api.md

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* updated spec: added custom reports field

* doclint

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>

* auto-bump connector version [ci skip]

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-08-17 16:49:41 +04:00
Mohamed Magdy
a6bb6e0ead 🎉 Introduce Google Analytics Data API source (#12701)
* Introduce Google Analytics Data API source

https://developers.google.com/analytics/devguides/reporting/data/v1

* Add Google Analytics Data API source PR link

* Add `client` class for Google Analytics Data API

* Move dimensions and metrics extraction to the `client` class

In the Google Analytics Data API

* Change the copyright date to 2022 in Google Analytics Data API

* fix: removing incremental syncs

* fix: change project_id to string

* fix: flake check is failing

* chore: added it to source definitions

* chore: update seed file

Co-authored-by: Harshith Mullapudi <harshithmullapudi@gmail.com>
2022-06-27 23:25:53 +05:30