d9f11bcf6a
* minor line length changes * cdk generated source + oop structure + start of implementation * fixed some broken syntax stuff * pre-pyarrow convert * introducing pyarrow * skeleton for unit tests * read working on multiple files * incremental first draft * blobfile -> fileclient * change references of 'blob' to 'file' * minor tidy to make draft PR * fixes * addressed review comments + more unit tests * finished unit tests * bugfixes and abstract integration tests framework * remove old commented stuff * docstrings * restructure as source-s3 * Delete playground.py * integration tests * acceptance tests and some more reshuffling * source S3 credentials * change _airbyte_ columns to _ab_ * update spec with better descriptions and ordering * created s3 source docs * source definition * reverse docstring change in cdk * reverse docstring change * reverse change * reverse docstring change * remove TODO comments * add PR to changelog * removed unused libraries * formatting & address some review comments * rename of files/classes for clarity * addressing review comments * address reviews * add s3 source * building spec with pydantic for provider-specific inheritance * pydantic spec and improved path pattern with wcmatch.glob * update path patterns info in doc * formatting * tests gzip and bz2 compression on csv * updated compression support in doc * forgot to upload bz2 test file * added pattern validation to dataset * formatting * Format. * ran testScaffoldTemplates & generated this diff * bumped version because of documentationUrl fix Co-authored-by: Davin Chia <davinchia@gmail.com>
28 lines
1.1 KiB
Python
28 lines
1.1 KiB
Python
"""
|
|
MIT License
|
|
|
|
Copyright (c) 2020 Airbyte
|
|
|
|
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
of this software and associated documentation files (the "Software"), to deal
|
|
in the Software without restriction, including without limitation the rights
|
|
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
copies of the Software, and to permit persons to whom the Software is
|
|
furnished to do so, subject to the following conditions:
|
|
|
|
The above copyright notice and this permission notice shall be included in all
|
|
copies or substantial portions of the Software.
|
|
|
|
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
SOFTWARE.
|
|
"""
|
|
|
|
from .source import SourceS3
|
|
|
|
__all__ = ["SourceS3"]
|