jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-19 18:14:56 -05:00
Code Issues Packages Projects Releases Wiki Activity

fix(source-google-search-console): Ignore 403 "insufficient permission" errors (#63720)

Browse Source
This commit is contained in:
Anatolii Yatsuk
2025-07-23 18:36:59 +03:00
committed by GitHub
parent d6dd104b73
commit ae65c846ff
3 changed files with 30 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files

18
airbyte-integrations/connectors/source-google-search-console/manifest.yaml
View File

@@ -353,6 +353,10 @@ definitions:
- type: HttpResponseFilter
action: RATE_LIMITED
error_message_contains: "Search Analytics QPS quota exceeded"
- type: HttpResponseFilter
action: IGNORE
error_message_contains: "User does not have sufficient permission"
error_message: "{{ response['error']['message'] }}"
- type: HttpResponseFilter
action: FAIL
http_codes:
@@ -1006,6 +1010,10 @@ definitions:
- type: HttpResponseFilter
action: RATE_LIMITED
error_message_contains: "Search Analytics QPS quota exceeded"
- type: HttpResponseFilter
action: IGNORE
error_message_contains: "User does not have sufficient permission"
error_message: "{{ response['error']['message'] }}"
- type: HttpResponseFilter
action: FAIL
http_codes:
@@ -1253,6 +1261,16 @@ dynamic_streams:
type: "{{ stream_partition.get('search_type') }}"
aggregationType: auto
dataState: "{{ config.get('data_state', 'final') }}"
error_handler:
type: DefaultErrorHandler
response_filters:
- type: HttpResponseFilter
action: RATE_LIMITED
error_message_contains: "Search Analytics QPS quota exceeded"
- type: HttpResponseFilter
action: IGNORE
error_message_contains: "User does not have sufficient permission"
error_message: "{{ response['error']['message'] }}"
paginator:
type: DefaultPaginator
page_token_option:

2
airbyte-integrations/connectors/source-google-search-console/metadata.yaml
View File

@@ -10,7 +10,7 @@ data:
connectorSubtype: api
connectorType: source
definitionId: eb4c9e00-db83-4d63-a386-39cfa91012a8
dockerImageTag: 1.10.5
dockerImageTag: 1.10.6
dockerRepository: airbyte/source-google-search-console
documentationUrl: https://docs.airbyte.com/integrations/sources/google-search-console
erdUrl: https://dbdocs.io/airbyteio/source-google-search-console?view=relationships

21
docs/integrations/sources/google-search-console.md
View File

@@ -230,16 +230,17 @@ Google Search Console only retains data for websites from the last 16 months. An
| Version | Date | Pull Request | Subject |
|:------------|:-----------|:---------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 1.10.5 | 2025-07-19 | [63471](https://github.com/airbytehq/airbyte/pull/63471) | Update dependencies |
| 1.10.4 | 2025-07-15 | [63309](https://github.com/airbytehq/airbyte/pull/63309) | Adds `type` property to `config_normalization_rules` in manifest |
| 1.10.3 | 2025-07-12 | [63094](https://github.com/airbytehq/airbyte/pull/63094) | Update dependencies |
| 1.10.2 | 2025-07-05 | [62613](https://github.com/airbytehq/airbyte/pull/62613) | Update dependencies |
| 1.10.1 | 2025-06-28 | [62194](https://github.com/airbytehq/airbyte/pull/62194) | Update dependencies |
| 1.10.0 | 2025-06-23 | [61425](https://github.com/airbytehq/airbyte/pull/61425) | Migrate to manifest-only |
| 1.9.4 | 2025-06-21 | [61789](https://github.com/airbytehq/airbyte/pull/61789) | Update dependencies |
| 1.9.3 | 2025-06-18 | [61706](https://github.com/airbytehq/airbyte/pull/61706) | Fix record serialization bug |
| 1.9.2 | 2025-06-14 | [60663](https://github.com/airbytehq/airbyte/pull/60663) | Update dependencies |
| 1.9.1 | 2025-06-10 | [61514](https://github.com/airbytehq/airbyte/pull/61514) | Promoting release candidate 1.9.1-rc.1 to a main version. |
| 1.10.6 | 2025-07-22 | [63720](https://github.com/airbytehq/airbyte/pull/63720) | Ignore 403 "insufficient permission" errors |
| 1.10.5 | 2025-07-19 | [63471](https://github.com/airbytehq/airbyte/pull/63471) | Update dependencies |
| 1.10.4 | 2025-07-15 | [63309](https://github.com/airbytehq/airbyte/pull/63309) | Adds `type` property to `config_normalization_rules` in manifest |
| 1.10.3 | 2025-07-12 | [63094](https://github.com/airbytehq/airbyte/pull/63094) | Update dependencies |
| 1.10.2 | 2025-07-05 | [62613](https://github.com/airbytehq/airbyte/pull/62613) | Update dependencies |
| 1.10.1 | 2025-06-28 | [62194](https://github.com/airbytehq/airbyte/pull/62194) | Update dependencies |
| 1.10.0 | 2025-06-23 | [61425](https://github.com/airbytehq/airbyte/pull/61425) | Migrate to manifest-only |
| 1.9.4 | 2025-06-21 | [61789](https://github.com/airbytehq/airbyte/pull/61789) | Update dependencies |
| 1.9.3 | 2025-06-18 | [61706](https://github.com/airbytehq/airbyte/pull/61706) | Fix record serialization bug |
| 1.9.2 | 2025-06-14 | [60663](https://github.com/airbytehq/airbyte/pull/60663) | Update dependencies |
| 1.9.1 | 2025-06-10 | [61514](https://github.com/airbytehq/airbyte/pull/61514) | Promoting release candidate 1.9.1-rc.1 to a main version. |
| 1.9.1-rc.1 | 2025-06-10 | [61508](https://github.com/airbytehq/airbyte/pull/61508) | Add API budget, reduce concurrency levels, and catch 403 rate limiting errors |
| 1.9.0 | 2025-06-06 | [61408](https://github.com/airbytehq/airbyte/pull/61408) | Migrate custom reports streams to low-code |
| 1.8.0 | 2025-06-06 | [61335](https://github.com/airbytehq/airbyte/pull/61335) | Migrate `SearchAnalyticsAllFields`, `SearchAnalyticsByDate`, `SearchAnalyticsByDevice`, `SearchAnalyticsByPage`, and `SearchAnalyticsByQuery` to low-code |