1
0
mirror of synced 2025-12-21 02:51:29 -05:00
Commit Graph

19 Commits

Author SHA1 Message Date
Daryna Ishchenko
36a1f95a7f chore(source-gcs) update to airbyte-cdk v7 (#66671)
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2025-10-06 18:10:20 +03:00
Przemysław Dąbek
80b4b4712f [source-gcs] Fix io.UnsupportedOperation: underlying stream is not seekable (#54677) 2025-02-25 13:50:42 -08:00
Aaron ("AJ") Steers
83ecbe0fc3 CI: apply pre-commit format fix from #49806 (#49852) 2024-12-18 14:05:43 -08:00
Daryna Ishchenko
fdca55a6d4 feat(source-gcs): updated support level, logging, cat for oauth (#45923) 2024-10-29 12:38:47 +02:00
Daryna Ishchenko
7658f43097 feat(source-gcs): added oauth flow (#45414) 2024-10-28 11:55:31 +02:00
Daryna Ishchenko
56dd151bdc feat(source-gcs): add support for zip files (#45671) 2024-09-24 17:48:30 +03:00
Erick Corona
39caa99fa1 fix(source-gcs): raise OSError in reader.open_file, improve unit test coverage (#45092)
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Erick Corona <erick.corona@airbyte.io>
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-09-19 16:51:06 +02:00
Erick Corona
5478a4bca3 fix(source-gcs): fix empty file list when prefix is empty (#44796) 2024-08-29 18:47:46 +03:00
Erick Corona
8f12adc212 fix(source-gcs): Set file signature default expiration to max value (#44781) 2024-08-27 17:47:01 -06:00
Erick Corona
96847e413d feat(source-gcs): Enable all file types for GCS (#44015) 2024-08-16 16:36:28 -06:00
Erick Corona
4de70b36d4 feat(source-gcs): Upgrade GCS CDK dependency to v4 (#44070) 2024-08-15 23:50:18 +03:00
Anton Karpets
b8a1c2393b Source GCS: avoid error on empty stream when running discover (#38696) 2024-05-28 15:59:52 +03:00
Anatolii Yatsuk
7382c877ef Source GCS: Add Gzip and Bzip compression support (#36373)
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
2024-03-26 22:20:27 +02:00
Catherine Noll
a8bdeef904 Update file-based connectors for compatibility with concurrent CDK (#34681) 2024-01-31 08:48:38 -05:00
Joe Reuter
f29234a2db airbyte-lib: Refactor connectors (#34552) 2024-01-30 03:22:13 -06:00
Joe Reuter
94dc6861cf Source GCS: Fix unstructured format (#34158) 2024-01-12 10:55:28 +00:00
Serhii Lazebnyi
2d552a99e4 Source GCS: Migrated to file based CDK (#31212)
Co-authored-by: lazebnyi <lazebnyi@users.noreply.github.com>
2023-10-24 14:35:05 +02:00
Marius Posta
f5c7c1c0b8 chore: get ./gradlew format to pass for the whole repo (same java style) (#29786) 2023-08-24 05:09:42 -05:00
Tuan Nguyen
200b035ec5 🎉 New Source: GCS (#23186)
* initial commit

* fix test error

* Update get_gcs_blobs logic

* add docs

* Update source_definitions.yaml

* Update airbyte-integrations/connectors/source-gcs/source_gcs/source.py

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>

* Update airbyte-config/init/src/main/resources/seed/source_definitions.yaml

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* Update airbyte-integrations/connectors/source-gcs/source_gcs/helpers.py

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* Update airbyte-integrations/connectors/source-gcs/source_gcs/helpers.py

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* update docker file for pandas package

* reimplement read_csv file

* add logic to filter selected streams

* close file_obj after reading

* fix format and tests

* add another stream

* auto-bump connector version

---------

Co-authored-by: Sunny <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-03-14 15:00:18 -03:00