* Implement Flag to avoid inferring data types for CSV input files in s3 SOURCE
* Unit Tests to Flag to avoid inferring data types for CSV input files in s3 SOURCE
Refactor parametrized tests in CSV and Parquet formats to use pytest.parametrize for better error reporting on test failure.
* S3 Source, infer_datatypes flag: additional unit tests
* wrong method signature
* Refactors
* s3-source - infer_datatypes flag, fix user message
* Update airbyte-integrations/connectors/source-s3/source_s3/source_files_abstract/formats/csv_spec.py
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* s3-source - refactor - use spec defaults instead of hardcoding them in code.
* Update airbyte-integrations/connectors/source-s3/source_s3/utils.py
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* code review changes
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* memory & performance optimisations
* address comments
* version bump
* added advanced_options for reading csv without header, and more custom pyarrow ReadOptions
* updated to use the latest airbyte-cdk
* updated docs
* bump source-s3 to 0.1.6
* remove unneeded lines
* Use the all dep ami for python builds.
* ec2-instance-id should be ec2-image-id
* ec2-instance-id should be ec2-image-id
Co-authored-by: Jingkun Zhuang <Jingkun.Zhuang@icims.com>
Co-authored-by: Davin Chia <davinchia@gmail.com>
