jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 11:01:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
22,318 Commits 5,109 Branches 518 Tags
baf4633ab8b51a55276115ea083837d8632fe217
Commit Graph

49 Commits

Author SHA1 Message Date
Daryna Ishchenko
7658f43097 feat(source-gcs): added oauth flow (#45414) 2024-10-28 11:55:31 +02:00
Airbyte
9bbfb381f9 🐙 source-gcs: run up-to-date pipeline [2024-10-12] (#46858) 2024-10-13 03:17:57 +03:00
Airbyte
a3db474974 🐙 source-gcs: run up-to-date pipeline [2024-10-05] (#46458) 2024-10-06 03:19:42 +03:00
Airbyte
5496e52dc9 🐙 source-gcs: run up-to-date pipeline [2024-09-28] (#46178) 2024-09-29 03:19:51 +03:00
Daryna Ishchenko
6070d29918 fix(source-gcs): update metadata and docs (#45897) 2024-09-25 18:07:36 +03:00
Artem Inzhyyants
f3c748b8e7 test(source-gcs): add integration test (#45850) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-09-24 20:27:19 +02:00
Daryna Ishchenko
56dd151bdc feat(source-gcs): add support for zip files (#45671) 2024-09-24 17:48:30 +03:00
Airbyte
c54878651f 🐙 source-gcs: run up-to-date pipeline [2024-09-21] (#45798) 2024-09-22 03:19:48 +03:00
Erick Corona
39caa99fa1 fix(source-gcs): raise OSError in reader.open_file, improve unit test coverage (#45092) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
Co-authored-by: Erick Corona <erick.corona@airbyte.io>
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-09-19 16:51:06 +02:00
Artem Inzhyyants
162d878176 docs(source-gcs): update source header name (#45668) 
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-09-19 13:24:44 +02:00
Airbyte
c43c6e83b5 🐙 source-gcs: run up-to-date pipeline [2024-09-14] (#45492) 2024-09-15 03:22:28 +03:00
Airbyte
51852fe73f 🐙 source-gcs: run up-to-date pipeline [2024-09-07] (#45232) 2024-09-08 03:21:40 +03:00
Airbyte
158d4ed1b5 🐙 source-gcs: run up-to-date pipeline [2024-08-31] (#45010) 2024-09-01 03:20:49 +03:00
Erick Corona
5478a4bca3 fix(source-gcs): fix empty file list when prefix is empty (#44796) 2024-08-29 18:47:46 +03:00
Erick Corona
8f12adc212 fix(source-gcs): Set file signature default expiration to max value (#44781) 2024-08-27 17:47:01 -06:00
Airbyte
ce56052203 🐙 source-gcs: run up-to-date pipeline [2024-08-24] (#44733) 2024-08-25 03:17:32 +03:00
Airbyte
1dcf5dbf50 🐙 source-gcs: run up-to-date pipeline [2024-08-17] (#44285) 2024-08-18 03:20:13 +03:00
Erick Corona
96847e413d feat(source-gcs): Enable all file types for GCS (#44015) 2024-08-16 16:36:28 -06:00
Erick Corona
4de70b36d4 feat(source-gcs): Upgrade GCS CDK dependency to v4 (#44070) 2024-08-15 23:50:18 +03:00
Airbyte
3452767674 🐙 source-gcs: run up-to-date pipeline [2024-08-12] (#43733) 2024-08-12 20:00:37 +03:00
Augustin
3449e07353 🐙 source-gcs: run up-to-date pipeline [2024-08-10] (#43512) 2024-08-11 02:25:49 +02:00
Augustin
158749bb53 🐙 source-gcs: run up-to-date pipeline [2024-08-03] (#43236) 2024-08-04 02:20:21 +02:00
Augustin
ff8c7d4714 🐙 source-gcs: run up-to-date pipeline [2024-07-27] (#42693) 2024-07-28 02:26:01 +02:00
Augustin
6175c25101 🐙 source-gcs: run up-to-date pipeline [2024-07-20] (#42312) 2024-07-21 02:20:58 +02:00
Augustin
bc66ac92d9 🐙 source-gcs: run up-to-date pipeline [2024-07-13] (#41865) 2024-07-14 02:20:52 +02:00
Augustin
9052a447a9 🐙 source-gcs: run up-to-date pipeline [2024-07-10] (#41430) 2024-07-10 16:19:12 +02:00
Augustin
85764ebde2 🐙 source-gcs: run up-to-date pipeline [2024-07-09] (#41148) 2024-07-10 02:23:19 +02:00
Augustin
50b0a99b7e 🐙 source-gcs: run up-to-date pipeline [2024-07-06] (#41015) 2024-07-07 02:16:42 +02:00
Augustin
09b3c2b9be 🐙 source-gcs: run up-to-date pipeline [2024-06-26] (#40540) 2024-06-27 02:14:00 +02:00
Augustin
831480ca81 🐙 source-gcs: run up-to-date pipeline [2024-06-25] (#40391) 2024-06-26 02:24:37 +02:00
Augustin
9f762a444a 🐙 source-gcs: run up-to-date pipeline [2024-06-24] (#40234) 2024-06-25 02:13:39 +02:00
Augustin
d917de6ae2 🐙 source-gcs: run up-to-date pipeline [2024-06-22] (#40089) 2024-06-23 02:20:54 +02:00
Augustin
34761bac6e source-gcs: [autopull] Upgrade base image to v1.2.2 (#39255) 2024-06-06 14:03:12 +02:00
Audrey Maldonado
b9690ba76e Wrapping changelog in details for a collapsible view (#38801) 2024-06-04 13:40:53 -04:00
Anton Karpets
b8a1c2393b ✨Source GCS: avoid error on empty stream when running discover (#38696) 2024-05-28 15:59:52 +03:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Anatolii Yatsuk
7382c877ef ✨ Source GCS: Add Gzip and Bzip compression support (#36373) 
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
 2024-03-26 22:20:27 +02:00
Catherine Noll
58de015de4 File based sources fix sync mode bug (#34936) 
Includes:
Source Azure Blob Storage
Source GCS
Source Google Drive
Source Microsoft Onedrive
 2024-02-06 19:59:52 -05:00
Catherine Noll
a8bdeef904 Update file-based connectors for compatibility with concurrent CDK (#34681) 2024-01-31 08:48:38 -05:00
Catherine Noll
aec1082f46 Pin file-based sources to airbyte-cdk version 0.59.2 (#34661) 2024-01-30 13:30:02 -05:00
Roman Yermilov [GL]
6dc61d10df Source GCS: update docs (#34515) 2024-01-25 14:03:19 +01:00
Joe Reuter
94dc6861cf Source GCS: Fix unstructured format (#34158) 2024-01-12 10:55:28 +00:00
Catherine Noll
f73827eb43 File-based CDK Sources: Hide primary key (#33187) 2023-12-06 13:01:47 -05:00
Joe Reuter
8f7abc2cc0 S3, Azure Blob Storage, GCS, Weviate, Milvus, Chroma, Qdrant: Bump cdk version (#32608) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-11-30 09:48:18 +01:00
Joe Reuter
b3396626ee S3, Azure Blob Storage, GCS, Pinecone, Weaviate, Milvus, Chroma, Qdrant: Update CDK to improve spec generation (#32357) 
Co-authored-by: flash1293 <flash1293@users.noreply.github.com>
 2023-11-14 16:53:27 +01:00
Serhii Lazebnyi
2d552a99e4 Source GCS: Migrated to file based CDK (#31212) 
Co-authored-by: lazebnyi <lazebnyi@users.noreply.github.com>
 2023-10-24 14:35:05 +02:00
Evan Tahler
79dba56923 S3 and GCS connector license to Elv2 (#27725) 
* S3 and GCS connector license to Elv2

* docs update

* docs
 2023-06-26 18:27:18 -05:00
Alex
f43cc9f3fd 📝 Add info on egress costs for Cloud storage connectors (#25935) 
* add info blurb to Cloud Bucket Storage sources and destinations

* Apply suggestions from code review

Remove extra colon

Co-authored-by: Ben Church <ben@airbyte.io>

---------

Co-authored-by: Ben Church <ben@airbyte.io>
 2023-05-09 17:33:49 -05:00
Tuan Nguyen
200b035ec5 🎉 New Source: GCS (#23186) 
* initial commit

* fix test error

* Update get_gcs_blobs logic

* add docs

* Update source_definitions.yaml

* Update airbyte-integrations/connectors/source-gcs/source_gcs/source.py

Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com>

* Update airbyte-config/init/src/main/resources/seed/source_definitions.yaml

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* Update airbyte-integrations/connectors/source-gcs/source_gcs/helpers.py

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* Update airbyte-integrations/connectors/source-gcs/source_gcs/helpers.py

Co-authored-by: Denys Davydov <davydov.den18@gmail.com>

* update docker file for pandas package

* reimplement read_csv file

* add logic to filter selected streams

* close file_obj after reading

* fix format and tests

* add another stream

* auto-bump connector version

---------

Co-authored-by: Sunny <6833405+sh4sh@users.noreply.github.com>
Co-authored-by: Denys Davydov <davydov.den18@gmail.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-14 15:00:18 -03:00