1
0
mirror of synced 2025-12-20 10:32:35 -05:00
Commit Graph

149 Commits

Author SHA1 Message Date
devin-ai-integration[bot]
9fa1f55620 feat(source-google-sheets): Add optional flag to read columns with empty headers (#69848)
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: Alfredo Garcia <freddy.garcia7.fg@gmail.com>
Co-authored-by: Alfredo Garcia <alfredo.garcia@hallmark.edu>
2025-12-03 10:21:33 -06:00
octavia-bot-hoard[bot]
b4cd94e44a 🐙 source-google-sheets: run up-to-date pipeline [2025-11-25] (#70029)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-11-24 22:20:00 -08:00
octavia-bot-hoard[bot]
6a5a781574 🐙 source-google-sheets: run up-to-date pipeline [2025-11-18] (#69396)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-11-17 20:12:54 -08:00
octavia-bot-hoard[bot]
1aa1f8c539 🐙 source-google-sheets: run up-to-date pipeline [2025-10-29] (#68759)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-28 22:57:32 -04:00
octavia-bot-hoard[bot]
31fe1bfaef 🐙 source-google-sheets: run up-to-date pipeline [2025-10-21] (#68254)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-21 12:37:20 -04:00
Alfredo Garcia
08c42ced3d Fix(Source Google Sheets): Add error handling for unexpected data in sheets causing 500 responses (#67531)
## What
<!--
* Describe what the change is solving. Link all GitHub issues related to
this change.
-->
OC Issue: https://github.com/airbytehq/oncall/issues/9057

The Google Sheets API is returning a 500 response when requesting the
GridData for certain sheets. This is causing us to fail CHECK for some
connectors. We confirmed with the user that in these situations, the
data in those sheets is unstructured, and they likely don't want to sync
it, but still want to sync other sheets in the spreadsheet.

Due to this, we should be okay with skipping these sheets altogether. 

To detect if it is a real 500 error or bad grid data, we can keep the
existing backoff for 500's. On the last attempt, we will retry with
`"includeGridData=false"` in the parameter. If we get a 200 response,
the sheet is highly likely to have bad/corrupted data. If we still get a
500, then there likely are genuine server errors going on with the API,
and in that case, we will default to the 500 server error being raised.

## How
<!--
* Describe how code changes achieve the solution.
-->
In the manifest.yaml we need to add a custom error handler that can do
this in the `components_resolver_retriever`. The existing error handler
is a DefaultErrorHandler, with multiple response_filters:

[single_sheet_response_error_filters](663615eee6/airbyte-integrations/connectors/source-google-sheets/manifest.yaml (L328-L331));
which use `ExponentialBackoffStrategy`

We cannot refactor this into a CompositeErrorHandler to keep the
existing response_filters, and add on the CustomErrrorHandler due to
lack of support in the CDK
[here](7ab013d412/airbyte_cdk/sources/declarative/declarative_component_schema.yaml (L391-L393)).

Due to this, the existing
[DefaultErrorHandler](663615eee6/airbyte-integrations/connectors/source-google-sheets/manifest.yaml (L234-L239)),
should be refactored into the new custom error handler.

This is done in `GridDataErrorHandler`, existing tests are left
unchanged, indicating the refactoring was done correctly.

We also added some new tests for the 500 error handling.

## Review guide
<!--
1. `x.py`
2. `y.py`
-->

## User Impact
<!--
* What is the end result perceived by the user?
* If there are negative side effects, please list them. 
-->

## Can this PR be safely reverted and rolled back?
<!--
* If unsure, leave it blank.
-->
- [X ] YES 💚
- [ ] NO 

---------

Co-authored-by: maxime.c <maxime@airbyte.io>
2025-10-16 12:27:37 -05:00
octavia-bot-hoard[bot]
7d9059b980 🐙 source-google-sheets: run up-to-date pipeline [2025-10-14] (#67876)
# Update source-google-sheets

This PR was autogenerated by running `airbyte-ci connectors
--name=source-google-sheets up_to_date --pull`

We've set the `auto-merge` label on it, so it will be automatically
merged if the CI pipelines pass.
If you don't want to merge it automatically, please remove the
`auto-merge` label.
Please reach out to the Airbyte Connector Tooling team if you have any
questions or concerns.


## Operations

- Upgrade the base image to the latest version in metadata.yaml:
Successful

- PATCH bump source-google-sheets version to 0.12.9: Successful

- Build source-google-sheets docker image for platform(s) linux/amd64,
linux/arm64: Successful

- Get dependency updates: Successful

- Create or update pull request on Airbyte repository: Successful

- Add changelog entry: Successful




## Dependency updates

We use [`syft`](https://github.com/anchore/syft) to generate a SBOM for
the latest connector version and the one from the PR.
It allows us to spot the dependencies that have been updated at all
levels and for all types of dependencies (system, python, java etc.).
Here are the dependencies that have been updated compared to
`airbyte/source-google-sheets:latest`.
Keep in mind that `:latest` does not always match the connector code on
the main branch.
It is the latest released connector image when the head commit of this
branch was created.

| Type | Name | State | Previous Version | New Version |
|------|------|-------|-------------|------------------|
| python | airbyte-cdk | updated | 6.60.12 | **7.3.4** |
| python | anyio | updated | 4.10.0 | **4.11.0** |
| python | cattrs | updated | 24.1.2 | **25.2.0** |
| python | importlib_metadata | updated | 8.0.0 | **8.7.0** |
| python | joblib | updated | 1.5.1 | **1.5.2** |
| python | jsonschema | updated | 4.17.3 | **4.25.1** |
| python | pandas | updated | 2.2.2 | **2.2.3** |
| python | whenever | updated | 0.6.16 | **0.8.8** |
| python | zipp | updated | 3.19.2 | **3.23.0** |
| python | jsonschema-specifications | added | not present |
**2025.4.1** |
| python | referencing | added | not present | **0.36.2** |
| python | rpds-py | added | not present | **0.27.1** |
| python | filelock | removed | 3.18.0 | **not present** |
| python | pyrsistent | removed | 0.20.0 | **not present** |

> [!IMPORTANT]
> **Auto-merge enabled.**
> 
> _This PR is set to merge automatically when all requirements are met._

Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-14 16:23:45 -04:00
octavia-bot-hoard[bot]
fe871569a7 🐙 source-google-sheets: run up-to-date pipeline [2025-10-07] (#67395)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-07 14:11:07 -04:00
Airbyte
230e455585 🐙 source-google-sheets: run up-to-date pipeline [2025-09-30] (#65383)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-09-30 12:19:16 -04:00
Maxime Carbonneau-Leclerc
3503649ce7 chore: google-sheets cdk 7 migration (#66012)
Co-authored-by: Danylo Jablonski <150933663+DanyloGL@users.noreply.github.com>
2025-09-16 12:58:26 -04:00
Airbyte
068b9598b8 🐙 source-google-sheets: run up-to-date pipeline [2025-08-09] (#64633) 2025-08-09 16:06:09 +02:00
Airbyte
2736cfa9ea 🐙 source-google-sheets: run up-to-date pipeline [2025-08-02] (#64179) 2025-08-02 16:11:36 +02:00
Airbyte
7fe317fc88 🐙 source-google-sheets: run up-to-date pipeline [2025-07-26] (#63822) 2025-07-26 16:09:36 +02:00
Alfredo Garcia
663615eee6 Feat(Source-Google-Sheets): Deduplicate Headers (#63334)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-07-22 11:49:13 -05:00
Airbyte
5909a133ce 🐙 source-google-sheets: run up-to-date pipeline [2025-07-19] (#55490) 2025-07-19 20:10:37 +02:00
octavia-bot[bot]
7a32af6647 🐙 source-google-sheets: release 0.12.0 (#63305)
Co-authored-by: octavia-bot[bot] <108746235+octavia-bot[bot]@users.noreply.github.com>
2025-07-15 11:07:02 -07:00
Christo Grabowski
a218ac9bab fix(source-google-sheets): handle empty properties_to_match key (#62931) 2025-07-11 12:01:13 -04:00
Christo Grabowski
4beeba5d86 feat(source-google-sheets): migrate connector to manifest-only (#62456)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-07-07 12:15:11 -04:00
Alfredo Garcia
bcd60d3d87 Feat:(Source-Google-Sheets) - Add Stream Name Override Options (#61489) 2025-06-11 12:16:14 -05:00
Alfredo Garcia
a29ec171e5 Feat(Source-Google-Sheets): Added additional sanitization flags when using Convert Column Names to SQL-Compliant Format (names_conversion) (#60836)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-06-09 10:19:34 -05:00
Christo Grabowski
b3298e3d7d fix(source-google-sheets): use userdefined exponential backoff policy on all 429 errors (#60874) 2025-05-23 20:25:34 +03:00
Alfredo Garcia
3b489fab5f Fix(Google-Sheets): whitespaces used for column names when enabling names_conversion (#60259)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-05-15 20:32:38 +03:00
Airbyte
43805b5c21 🐙 source-google-sheets: run up-to-date pipeline [2025-03-01] (#54989) 2025-03-02 02:34:49 +02:00
Airbyte
086e86c3ba 🐙 source-google-sheets: run up-to-date pipeline [2025-02-22] (#54434) 2025-02-23 02:33:49 +02:00
Airbyte
466df956c6 🐙 source-google-sheets: run up-to-date pipeline [2025-02-15] (#53720) 2025-02-18 08:04:31 +02:00
Airbyte
3091bd3213 🐙 source-google-sheets: run up-to-date pipeline [2025-02-08] (#51696) 2025-02-08 22:15:29 +02:00
github-actions[bot]
3ba67876c1 🐙 source-google-sheets: release 0.9.0 (#53154)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-02-04 14:12:55 +02:00
Serhii Lazebnyi
183bedf47f fix(sorce-google-sheets): add stream name typing (#52682) 2025-01-31 16:47:37 +01:00
Serhii Lazebnyi
9130c9f26e fix(source-google-sheets): add sheet id encoding (#52671)
Co-authored-by: Aldo Gonzalez <aldo.gonzalez@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-01-31 11:35:33 +01:00
Aldo Gonzalez
a4f6530386 feat(source-google-sheets): migrate low code (#50843)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
2025-01-30 21:10:06 +01:00
Airbyte
b668fe0783 🐙 source-google-sheets: run up-to-date pipeline [2025-01-11] (#44270)
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2025-01-15 12:27:26 +02:00
Aldo Gonzalez
c9ac3527ee feat(source-google-sheets): add integration tests (#48835)
Co-authored-by: maxi297 <maxime@airbyte.io>
2024-12-11 06:44:57 -06:00
Daryna Ishchenko
6b879cc621 docs: fix docs for sources - Facebook Marketing, Google Ads, Google Sheets, File (#46537) 2024-10-10 17:06:21 +03:00
Chris Reid
15589bb1bd fix(source-google-sheets): fail the sync attempt when google responds with an api error (#45108) 2024-10-02 13:32:20 -03:00
Natalie Kwong
b0407dc16a docs: Add field anchors for top source docs (#45885) 2024-09-25 08:55:06 -05:00
Daryna Ishchenko
fc35c03aa4 fix(connectors docs): updated connectors to follow standard template (#39328) 2024-08-14 10:53:16 -05:00
Airbyte
01282e8dae 🐙 source-google-sheets: run up-to-date pipeline [2024-08-12] (#43921) 2024-08-13 03:16:45 +03:00
Augustin
8fb7ce6581 🐙 source-google-sheets: run up-to-date pipeline [2024-08-10] (#43544) 2024-08-11 02:24:24 +02:00
Augustin
660f3c9d8d 🐙 source-google-sheets: run up-to-date pipeline [2024-08-03] (#43290) 2024-08-04 02:17:23 +02:00
Patrick Nilan
bdf1498909 [source-recharge, source-zendesk-support, source-google-sheets] - Migrate to CDK v4.3.0 (#42975) 2024-08-02 10:59:03 -07:00
Augustin
ceb9189ff6 🐙 source-google-sheets: run up-to-date pipeline [2024-07-27] (#42826) 2024-07-28 02:17:34 +02:00
Henrique Melo
846a3f4fc9 🐛 source-google-sheets: correctly fails syncs when rate limit has been reached (#41993)
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2024-07-23 16:31:02 -03:00
Augustin
132fa19599 🐙 source-google-sheets: run up-to-date pipeline [2024-07-20] (#42376) 2024-07-21 02:17:39 +02:00
Patrick Nilan
6bfcb7e598 [source-google-sheets] - Migrate to CDK v3.9.0 (#42071) 2024-07-19 14:42:05 -07:00
Augustin
6eb13eadd2 🐙 source-google-sheets: run up-to-date pipeline [2024-07-13] (#41527) 2024-07-14 02:30:07 +02:00
Augustin
0ba3ac8532 🐙 source-google-sheets: run up-to-date pipeline [2024-07-09] (#41273) 2024-07-10 02:17:15 +02:00
Augustin
e93c932703 🐙 source-google-sheets: run up-to-date pipeline [2024-07-06] (#41005) 2024-07-07 02:17:09 +02:00
btkcodedev
e7843c7f19 Replace deprecated AirbyteLogger with logging.Logger - source-google-sheets (#40587)
Co-authored-by: Dhroov Makwana <pabloescoder@gmail.com>
2024-06-28 16:53:40 +02:00
Denys Davydov
a88d9e8531 🐛 Source google sheets: catch an auth error during discover and raise a config error (#40560) 2024-06-27 13:32:37 -04:00
Augustin
225e771069 🐙 source-google-sheets: run up-to-date pipeline [2024-06-26] (#40533) 2024-06-27 02:14:21 +02:00