* make spec field required
* remove spec backfill logic
* remove usages of specFetcher.getSpec()
* remove unused code and the caching scheduler clients
* fix tests to work with fetching specs from definitions
* fetch spec from definition in config repository and fix RunMigrationTest
* remove unused SpecFetcher methods/tests
* run gw format
* run gw format
* undo change to main method
* add back newlines
* set additional properties to true on destination definition
* remove now-unused VERSION_0_32_0_FORCE_UPGRADE env var
* Implement vlidatation if each field in a stream has appeared it least once in some record.
* Add unit tests for `_validate_empty_streams` TestBasicRead method.
* Add validate_data_points basic read input option.
* Update `_validate_field_appears_at_least_once_in_stream` to support oneOf/anyOf choices.
Add oneOf/anyOf unit tests.
* Bump docker version.
Update CHANGELOG.md
* Fix test_core.py imports.
* Implement Flag to avoid inferring data types for CSV input files in s3 SOURCE
* Unit Tests to Flag to avoid inferring data types for CSV input files in s3 SOURCE
Refactor parametrized tests in CSV and Parquet formats to use pytest.parametrize for better error reporting on test failure.
* S3 Source, infer_datatypes flag: additional unit tests
* wrong method signature
* Refactors
* s3-source - infer_datatypes flag, fix user message
* Update airbyte-integrations/connectors/source-s3/source_s3/source_files_abstract/formats/csv_spec.py
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* s3-source - refactor - use spec defaults instead of hardcoding them in code.
* Update airbyte-integrations/connectors/source-s3/source_s3/utils.py
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* code review changes
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* Adds Inventory Items to the source-shopify connector
* fix: rather use updated_at as cursor
* docs: updates the shopify readme changelog
* fix: use Products parent stream to get the inventory item ids
fix: parse response as json object not array
* feat: get inventory items in 1 batch per Product
* fix: remove cusor_field property - already defined in parent
* other: bump shopify source version number anywhere I could find
* correct ci failure
Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
* feat: adds stream config for TicketMetricEvents
* other: bumps version numbers
* feat: adds ticket metric events schema file
* fix: sorts out a few small spelling mistakes
* fix: add generated_timestamp in place of updated_at
* fix: remove some extra spaces
* fix: use time instead of generated_timestamp as cursor
* docs: update zendesk support MD file
* fix: remove generated_timestamp refs from TicketMetricEvents
* bump connector version
* run seed config
Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
* Fixed schemas and ui issues
* Deleted anyOf structure from schema
* Updated PR number
* Added fields with static data types to cohort_members schema
* Add DefaultSchemaNormalization to Engage and CohortMembers streams
* Changed Transformer name
* Checkin specs
* Added milliseconds for date format for cursor
* Added milliseconds for date format for cursor
* Added milliseconds for date format for cursor
* updated documentation
* SAT for destination should accept custom dbt transformations without complete normalization implementation
(only transform_config is required)
* Fix destination bigquery denormalized and custom dbt
* Fix postgres money type > 1000
* Convert money to double
* Bump source postgres version
* Do not bump version in seed yet
* Check type ignoring case
* Test insertion with currency symbol
* Test parsing money string method
* Add test case with currency symbol and negative values
* Update version date
* Bump seed version
* Set default end_date value
* Upd changelog
* Few updates
* Remove timeout_seconds from SAT config
* Add cursor_paths to SAT configuration
* After rebase fix
* Bump connector's version + update docs
Co-authored-by: oleh <lovemybeard@gmail.com>
* airbyte-8254 Source Postgres: views are not listed during schema discovery
* airbyte-8254 Source Postgres: views are not listed during schema discovery
* airbyte-8254 Source Postgres: views are not listed during schema discovery
* airbyte-8254 Remove GRANTEE and PRIVILEGE constants from AbstractJdbcSource.java
* airbyte-8254 Version bumped.
* airbyte-8254 Version bumped.
* airbyte-8254 Version bumped.
