jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-25 02:09:19 -05:00
Code Issues Packages Projects Releases Wiki Activity

✨ Source S3: remove streams.*.file_type from source-s3 configuration (#30476)

Browse Source
This commit is contained in:
Maxime Carbonneau-Leclerc
2023-09-18 09:34:26 -04:00
committed by GitHub
parent 327d3c9ae8
commit 2954cbb7ce
10 changed files with 33 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/integrations/sources/s3-migrations.md
View File

@@ -1,5 +1,12 @@
# S3 Migration Guide
## Upgrading to 4.0.4
Note: This change is only breaking if you created S3 sources using the API and did not provide `streams.*.format`.
Following 4.0.0 config change, we are removing `streams.*.file_type` field which was redundant with `streams.*.format`. This is a breaking change as `format` now needs to be required. Given that the UI would always populate `format`, only users creating actors using the API and not providing `format` are be affected. In order to fix that, simply set `streams.*.format` to `{"filetype": <file_type>}`.
## Upgrading to 4.0.0
We have revamped the implementation to use the File-Based CDK. The goal is to increase resiliency and reduce development time. Here are the breaking changes:
@@ -18,3 +25,4 @@ Other than breaking changes, we have changed the UI from which the user configur
* You can now configure multiple streams by clicking on `Add` under `Streams`.
* `Output Stream Name` has been renamed to `Name` when configuring a specific stream.
* `Pattern of files to replicate` field has been renamed `Globs` under the stream configuration.