jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-25 02:09:19 -05:00
Code Issues Packages Projects Releases Wiki Activity

✨feat(source-s3): Increase individual file size limit to 1.5 GB (#49824)

Browse Source
This commit is contained in:
Aldo Gonzalez
2024-12-17 07:40:01 -06:00
committed by GitHub
parent 24f95a9106
commit db035e19a6
4 changed files with 4 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
airbyte-integrations/connectors/source-s3/metadata.yaml
View File

@@ -10,7 +10,7 @@ data:
connectorSubtype: file
connectorType: source
definitionId: 69589781-7828-43c5-9f63-8925b1c1ccc2
dockerImageTag: 4.10.2
dockerImageTag: 4.11.0
dockerRepository: airbyte/source-s3
documentationUrl: https://docs.airbyte.com/integrations/sources/s3
githubIssueLabel: source-s3

2
airbyte-integrations/connectors/source-s3/pyproject.toml
View File

@@ -3,7 +3,7 @@ requires = [ "poetry-core>=1.0.0",]
build-backend = "poetry.core.masonry.api"
[tool.poetry]
version = "4.10.2"
version = "4.11.0"
name = "source-s3"
description = "Source implementation for S3."
authors = [ "Airbyte <contact@airbyte.io>",]

2
airbyte-integrations/connectors/source-s3/source_s3/v4/stream_reader.py
View File

@@ -31,7 +31,7 @@ AWS_EXTERNAL_ID = getenv("AWS_ASSUME_ROLE_EXTERNAL_ID")
class SourceS3StreamReader(AbstractFileBasedStreamReader):
FILE_SIZE_LIMIT = 1_000_000_000
FILE_SIZE_LIMIT = 1_500_000_000
def __init__(self):
super().__init__()

1
docs/integrations/sources/s3.md
View File

@@ -361,6 +361,7 @@ This connector utilizes the open source [Unstructured](https://unstructured-io.g
| Version | Date | Pull Request | Subject |
|:--------|:-----------|:----------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------|
| 4.11.0 | 2024-12-17 | [49824](https://github.com/airbytehq/airbyte/pull/49824) | Increase file size limit to 1.5GB |
| 4.10.2 | 2024-11-25 | [48613](https://github.com/airbytehq/airbyte/pull/48613) | Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64 |
| 4.10.1 | 2024-11-12 | [48346](https://github.com/airbytehq/airbyte/pull/48346) | Implement file-transfer capabilities |
| 4.9.2 | 2024-11-04 | [48259](https://github.com/airbytehq/airbyte/pull/48259) | Update dependencies |