jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-25 02:09:19 -05:00
Code Issues Packages Projects Releases Wiki Activity

Source Google Analytics: always sync data from two days ago (#12426)

Browse Source 
* #12013 source GA to Beta: always sync data from two days ago

* #12013 GA to Beta: fix changelog

* #12013 source GA to Beta: rm odd file

* #12013 Source GA to Beta: comment out integration tests

* #12013 expose isDataGolden field, assume missing field equals False

* #12013 expose isDataGOlden flag: reword docs

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
This commit is contained in:
Denis Davydov
2022-05-03 17:24:33 +03:00
committed by GitHub
parent 51be2fcc32
commit e6ee556f0c
10 changed files with 55 additions and 37 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/integrations/sources/google-analytics-v4.md
View File

@@ -97,6 +97,9 @@ When sampling occurs, a warning is logged to the sync log.
## IsDataGolden
Google Analytics API may return provisional or incomplete data. When this occurs, the returned data will set the flag `isDataGolden` to false, and the connector will log a warning to the sync log.
The connector adds a lookback window of 2 days to ensure any previously synced non-golden data is re-synced with its potential updates. This is done because [Google Analytics takes up to 48 hours](https://support.google.com/analytics/answer/1070983?hl=en#DataProcessingLatency&zippy=%2Cin-this-article) to update the data. For example:
- If your last sync occurred 5 days ago and a sync kicks off today, it will attempt to sync data from 7 days ago up to the latest data available.
To determine whether data is finished processing or not, the `isDataGolden` flag is exposed and should be used.
## Reading Custom Reports
@@ -159,6 +162,7 @@ Incremental sync is supported only if you add `ga:date` dimension to your custom
| Version | Date | Pull Request | Subject |
|:--------|:-----------|:---------------------------------------------------------|:---------------------------------------------------------------------------------------------|
| 0.1.20 | 2022-04-28 | [12426](https://github.com/airbytehq/airbyte/pull/12426) | Expose `isDataGOlden` field and always resync data two days back to make sure it is golden |
| 0.1.19 | 2022-04-19 | [12150](https://github.com/airbytehq/airbyte/pull/12150) | Minor changes to documentation |
| 0.1.18 | 2022-04-07 | [11803](https://github.com/airbytehq/airbyte/pull/11803) | Improved documentation |
| 0.1.17 | 2022-03-31 | [11512](https://github.com/airbytehq/airbyte/pull/11512) | Improved Unit and Acceptance tests coverage, fixed `read` with abnormally large state values |