Erick Corona
39caa99fa1
fix(source-gcs): raise OSError in reader.open_file, improve unit test coverage ( #45092 )
...
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com >
Co-authored-by: Erick Corona <erick.corona@airbyte.io >
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com >
2024-09-19 16:51:06 +02:00
Artem Inzhyyants
162d878176
docs(source-gcs): update source header name ( #45668 )
...
Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com >
2024-09-19 13:24:44 +02:00
Airbyte
c43c6e83b5
🐙 source-gcs: run up-to-date pipeline [2024-09-14] ( #45492 )
2024-09-15 03:22:28 +03:00
Airbyte
51852fe73f
🐙 source-gcs: run up-to-date pipeline [2024-09-07] ( #45232 )
2024-09-08 03:21:40 +03:00
Airbyte
158d4ed1b5
🐙 source-gcs: run up-to-date pipeline [2024-08-31] ( #45010 )
2024-09-01 03:20:49 +03:00
Erick Corona
5478a4bca3
fix(source-gcs): fix empty file list when prefix is empty ( #44796 )
2024-08-29 18:47:46 +03:00
Erick Corona
8f12adc212
fix(source-gcs): Set file signature default expiration to max value ( #44781 )
2024-08-27 17:47:01 -06:00
Airbyte
ce56052203
🐙 source-gcs: run up-to-date pipeline [2024-08-24] ( #44733 )
2024-08-25 03:17:32 +03:00
Airbyte
1dcf5dbf50
🐙 source-gcs: run up-to-date pipeline [2024-08-17] ( #44285 )
2024-08-18 03:20:13 +03:00
Erick Corona
96847e413d
feat(source-gcs): Enable all file types for GCS ( #44015 )
2024-08-16 16:36:28 -06:00
Erick Corona
4de70b36d4
feat(source-gcs): Upgrade GCS CDK dependency to v4 ( #44070 )
2024-08-15 23:50:18 +03:00
Airbyte
3452767674
🐙 source-gcs: run up-to-date pipeline [2024-08-12] ( #43733 )
2024-08-12 20:00:37 +03:00
Augustin
3449e07353
🐙 source-gcs: run up-to-date pipeline [2024-08-10] ( #43512 )
2024-08-11 02:25:49 +02:00
Augustin
158749bb53
🐙 source-gcs: run up-to-date pipeline [2024-08-03] ( #43236 )
2024-08-04 02:20:21 +02:00
Augustin
ff8c7d4714
🐙 source-gcs: run up-to-date pipeline [2024-07-27] ( #42693 )
2024-07-28 02:26:01 +02:00
Augustin
6175c25101
🐙 source-gcs: run up-to-date pipeline [2024-07-20] ( #42312 )
2024-07-21 02:20:58 +02:00
Augustin
bc66ac92d9
🐙 source-gcs: run up-to-date pipeline [2024-07-13] ( #41865 )
2024-07-14 02:20:52 +02:00
Augustin
9052a447a9
🐙 source-gcs: run up-to-date pipeline [2024-07-10] ( #41430 )
2024-07-10 16:19:12 +02:00
Augustin
85764ebde2
🐙 source-gcs: run up-to-date pipeline [2024-07-09] ( #41148 )
2024-07-10 02:23:19 +02:00
Augustin
50b0a99b7e
🐙 source-gcs: run up-to-date pipeline [2024-07-06] ( #41015 )
2024-07-07 02:16:42 +02:00
Augustin
09b3c2b9be
🐙 source-gcs: run up-to-date pipeline [2024-06-26] ( #40540 )
2024-06-27 02:14:00 +02:00
Augustin
831480ca81
🐙 source-gcs: run up-to-date pipeline [2024-06-25] ( #40391 )
2024-06-26 02:24:37 +02:00
Augustin
9f762a444a
🐙 source-gcs: run up-to-date pipeline [2024-06-24] ( #40234 )
2024-06-25 02:13:39 +02:00
Augustin
d917de6ae2
🐙 source-gcs: run up-to-date pipeline [2024-06-22] ( #40089 )
2024-06-23 02:20:54 +02:00
Augustin
34761bac6e
source-gcs: [autopull] Upgrade base image to v1.2.2 ( #39255 )
2024-06-06 14:03:12 +02:00
Audrey Maldonado
b9690ba76e
Wrapping changelog in details for a collapsible view ( #38801 )
2024-06-04 13:40:53 -04:00
Anton Karpets
b8a1c2393b
✨ Source GCS: avoid error on empty stream when running discover ( #38696 )
2024-05-28 15:59:52 +03:00
Natik Gadzhi
cb80e6922a
[tools] prettier rules for .md + formatting cleanup
2024-05-07 08:19:33 -07:00
Anatolii Yatsuk
7382c877ef
✨ Source GCS: Add Gzip and Bzip compression support ( #36373 )
...
Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com >
2024-03-26 22:20:27 +02:00
Catherine Noll
58de015de4
File based sources fix sync mode bug ( #34936 )
...
Includes:
Source Azure Blob Storage
Source GCS
Source Google Drive
Source Microsoft Onedrive
2024-02-06 19:59:52 -05:00
Catherine Noll
a8bdeef904
Update file-based connectors for compatibility with concurrent CDK ( #34681 )
2024-01-31 08:48:38 -05:00
Catherine Noll
aec1082f46
Pin file-based sources to airbyte-cdk version 0.59.2 ( #34661 )
2024-01-30 13:30:02 -05:00
Roman Yermilov [GL]
6dc61d10df
Source GCS: update docs ( #34515 )
2024-01-25 14:03:19 +01:00
Joe Reuter
94dc6861cf
Source GCS: Fix unstructured format ( #34158 )
2024-01-12 10:55:28 +00:00
Catherine Noll
f73827eb43
File-based CDK Sources: Hide primary key ( #33187 )
2023-12-06 13:01:47 -05:00
Joe Reuter
8f7abc2cc0
S3, Azure Blob Storage, GCS, Weviate, Milvus, Chroma, Qdrant: Bump cdk version ( #32608 )
...
Co-authored-by: flash1293 <flash1293@users.noreply.github.com >
2023-11-30 09:48:18 +01:00
Joe Reuter
b3396626ee
S3, Azure Blob Storage, GCS, Pinecone, Weaviate, Milvus, Chroma, Qdrant: Update CDK to improve spec generation ( #32357 )
...
Co-authored-by: flash1293 <flash1293@users.noreply.github.com >
2023-11-14 16:53:27 +01:00
Serhii Lazebnyi
2d552a99e4
Source GCS: Migrated to file based CDK ( #31212 )
...
Co-authored-by: lazebnyi <lazebnyi@users.noreply.github.com >
2023-10-24 14:35:05 +02:00
Evan Tahler
79dba56923
S3 and GCS connector license to Elv2 ( #27725 )
...
* S3 and GCS connector license to Elv2
* docs update
* docs
2023-06-26 18:27:18 -05:00
Alex
f43cc9f3fd
📝 Add info on egress costs for Cloud storage connectors ( #25935 )
...
* add info blurb to Cloud Bucket Storage sources and destinations
* Apply suggestions from code review
Remove extra colon
Co-authored-by: Ben Church <ben@airbyte.io >
---------
Co-authored-by: Ben Church <ben@airbyte.io >
2023-05-09 17:33:49 -05:00
Tuan Nguyen
200b035ec5
🎉 New Source: GCS ( #23186 )
...
* initial commit
* fix test error
* Update get_gcs_blobs logic
* add docs
* Update source_definitions.yaml
* Update airbyte-integrations/connectors/source-gcs/source_gcs/source.py
Co-authored-by: sh4sh <6833405+sh4sh@users.noreply.github.com >
* Update airbyte-config/init/src/main/resources/seed/source_definitions.yaml
Co-authored-by: Denys Davydov <davydov.den18@gmail.com >
* Update airbyte-integrations/connectors/source-gcs/source_gcs/helpers.py
Co-authored-by: Denys Davydov <davydov.den18@gmail.com >
* Update airbyte-integrations/connectors/source-gcs/source_gcs/helpers.py
Co-authored-by: Denys Davydov <davydov.den18@gmail.com >
* update docker file for pandas package
* reimplement read_csv file
* add logic to filter selected streams
* close file_obj after reading
* fix format and tests
* add another stream
* auto-bump connector version
---------
Co-authored-by: Sunny <6833405+sh4sh@users.noreply.github.com >
Co-authored-by: Denys Davydov <davydov.den18@gmail.com >
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com >
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com >
2023-03-14 15:00:18 -03:00
