Ella Rohm-Ensing
|
9b19d9078f
|
update source-s3 to use airbyte-cdk version with protocol pydantic v2 (#39573)
|
2024-06-27 02:51:15 +02:00 |
|
Anton Karpets
|
9c8d0c19df
|
✨Source S3: avoid error on empty stream when running discover (#38674)
|
2024-05-28 15:59:04 +03:00 |
|
Anatolii Yatsuk
|
5b91b5b0e8
|
✨ Source S3: Add region to S3 source (#34842)
Co-authored-by: Håkon Åmdal <hakon@aamdal.com>
|
2024-02-06 11:45:58 +02:00 |
|
Anatolii Yatsuk
|
63c6961e78
|
✨ Source S3: Add IAM Role Authentication (#33818)
|
2024-01-17 19:15:09 +02:00 |
|
Christo Grabowski
|
5f990f4afe
|
Source S3: always show S3 Access Key fields (#28639)
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
|
2023-09-11 14:56:33 -04:00 |
|
Maxime Carbonneau-Leclerc
|
526be63fa6
|
✨ Source S3: ensure parsing errors are consider as config errors to avoid Sentry alerts (#30217)
|
2023-09-06 15:15:08 -04:00 |
|
Artem Inzhyyants
|
3080f65429
|
Source S3: Add start date filter for files (#25010)
* Source S3: Add start date filter for files
* Source S3: add docs
* Source S3: add unittest
* Source S3: add unittest
* Source S3: add unittest
* Source S3: Fix spec test
* Source S3: bump version
* Source S3: fix tests
* Source S3: fix description
* auto-bump connector version
* Source S3: refactor start_date filtering
* Source S3: update setup
* Source S3: serialize state for cache
* Source S3: refactor skip file filter
* Source S3: bump version + update docs
* auto-bump connector version
---------
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
|
2023-04-18 14:07:15 +02:00 |
|
Cole Snodgrass
|
2e099acc52
|
update headers from 2022 -> 2023 (#22594)
* It's 2023!
* 2022 -> 2023
---------
Co-authored-by: evantahler <evan@airbyte.io>
|
2023-02-08 13:01:16 -08:00 |
|
Serhii Lazebnyi
|
5df66cd572
|
Source S3: Connector does not enforce SSL/TLS for non-S3 endpoints (#17800)
* Deleted ssl/tsl flag from config
* Updated PR number
* auto-bump connector version [ci skip]
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
|
2022-10-12 16:07:22 +02:00 |
|
Pedro S. Lopez
|
938436bcc9
|
update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls
* update docs urls in specs
* update generators
* regenerate scaffold connectors
* remove unrelated changes
* update more urls
* update specs
* fix tests
* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting
* revert docs changes to make pr more reviewable
* revert generator readme changes to make more reviewable
* fix mysql strict encrypt expected spec
* fix postgres expected spec
|
2022-10-11 11:04:23 -04:00 |
|
Marcos Marx
|
dca2256a7c
|
Bump 2022 license version (#13233)
* Bump year in license short to 2022
* remove protocol from cdk
|
2022-05-26 15:00:42 -03:00 |
|
Sherif A. Nada
|
b8e147538c
|
Update various connector input configs & docs copy (#12500)
|
2022-05-04 23:37:10 -07:00 |
|
Maksym Pavlenok
|
91eff1dffd
|
🐛 Source S3: Loading of files' metadata (#8252)
|
2022-02-02 00:49:18 +02:00 |
|
Serhii Chvaliuk
|
c7021e6f30
|
🐛 Source S3: work-around for format.delimiter change '\\t' -> '\t' (#9163)
* work-around for format.delimiter '\\t' -> '\t'
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
|
2022-01-06 20:49:55 +02:00 |
|
Michel Tricot
|
1773e41e47
|
Shorten our headers + adds contributors file (#6478)
|
2021-09-27 10:45:50 -07:00 |
|
Dmytro
|
6767424b6d
|
🎉 S3 source: add support for non-AWS S3 Storage (#6398)
|
2021-09-27 16:40:24 +03:00 |
|
George Claireaux
|
d9f11bcf6a
|
🎉 New Source: S3 (+ abstract files source) (#4990)
* minor line length changes
* cdk generated source + oop structure + start of implementation
* fixed some broken syntax stuff
* pre-pyarrow convert
* introducing pyarrow
* skeleton for unit tests
* read working on multiple files
* incremental first draft
* blobfile -> fileclient
* change references of 'blob' to 'file'
* minor tidy to make draft PR
* fixes
* addressed review comments + more unit tests
* finished unit tests
* bugfixes and abstract integration tests framework
* remove old commented stuff
* docstrings
* restructure as source-s3
* Delete playground.py
* integration tests
* acceptance tests and some more reshuffling
* source S3 credentials
* change _airbyte_ columns to _ab_
* update spec with better descriptions and ordering
* created s3 source docs
* source definition
* reverse docstring change in cdk
* reverse docstring change
* reverse change
* reverse docstring change
* remove TODO comments
* add PR to changelog
* removed unused libraries
* formatting & address some review comments
* rename of files/classes for clarity
* addressing review comments
* address reviews
* add s3 source
* building spec with pydantic for provider-specific inheritance
* pydantic spec and improved path pattern with wcmatch.glob
* update path patterns info in doc
* formatting
* tests gzip and bz2 compression on csv
* updated compression support in doc
* forgot to upload bz2 test file
* added pattern validation to dataset
* formatting
* Format.
* ran testScaffoldTemplates & generated this diff
* bumped version because of documentationUrl fix
Co-authored-by: Davin Chia <davinchia@gmail.com>
|
2021-07-30 15:06:11 +01:00 |
|