* Mixpanel initiation
* copied schemas and specs file from singer connector
* authentication and a few streams
* Added Funnels + FunnelsList
* Added example of funnel response
* added incremental Funnels stream with tests
* added Annotations, CohortMembers, Engage, Cohorts, Funnels
* added Revenue
* fixed formatting
* fixed variable names
* fixed cohort_members and updated export streams
* moved start_date and date checks into SourceMixpanel class
* added error handling
* added unit test, update docs and ci creds
* fix url base for export stream
* added full and incremental read for export stream
* updated acceptance tests, added limit correction based on number of streams, export cursor is stored in datatime string
* Funnel stream - added complex state which contains state for each funnel
* added attribution windows support and project timezone config
* fixed formatting
* added default timezone
* added dynamic schema generation for Engage and Export streams
* fixed formatting
* fixed ability to pass start_date in datetime format as well
* fixed ability to pass start_date in datetime format as well
* added additional_properties field for dynamic schemas. updates regex for start_date matching to support old config file
* fixed formatting
* export stream - convert all values to default type - string
* added schema ref
* added new properties for funnel stream
* fixed formatting in funnel schema
* added build related files
* update changelog
* fixed and added comments, renamed rate_limit variable
* fixed formatting
* changed normalization for reserved mixpanel attributes like $browser
* alphabetise spec fields
* added description about API limit handling
* updated comment
* Adding Google Cloud Storage as destination
* Removed few comments and amended the version
* Added documentation in docs/integrations/destinations/gcs.md
* Amended gcs.md with the right pull id
* Implemented all the fixes requested by tuliren as per https://github.com/airbytehq/airbyte/pull/4329
* Renaming all the files
* Branch alligned to S3 0.1.7 (with Avro and Jsonl). Removed redundant file by making S3 a dependency for GCS
* Removed some additional duplicates between GCS and S3
* Revert changes in the root files
* Revert jdbc files
* Fix package names
* Refactor gcs config
* Format code
* Fix gcs connection
* Format code
* Add acceptance tests
* Fix parquet acceptance test
* Add ci credentials
* Register the connector and update documentations
* Fix typo
* Format code
* Add unit test
* Add comments
* Update readme
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Marco Fontana <marco.fontana@sohohouse.com>
Co-authored-by: marcofontana.ing@gmail.com <marcofontana.ing@gmail.com>
Co-authored-by: Marco Fontana <MaxwellJK@users.noreply.github.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
#4669 Stripe Source: Fix subscriptions stream to return all kinds of subscriptions (including expired and canceled)
Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
* this should fix the check if no records in annotations stream
* update schemas for new SAT requirements && apply user hint upgrade on wrong api key
* save schema upd
* upd insights schema
* upd insights schema2
* upd insights schema3
* upd insights schema4
* upd insights schema5 (null is joking)
* upd insights schema6 (null is joking)
* upd insights schema7
* upd insights schema8
* upd insights schema8
* bump version && docs
* Few updates for GitHub source
Set correct `cursor_field` for `IssueEvents` stream.
Add rate limit handling.
Add handling for 403 error.
Add handling for 502 error.
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* first few classes for mssql cdc
* wip
* mssql cdc working against unit tests
* increment version
* add cdc acceptance test
* tweaks
* add file
* working on comprehensive tests
* change isolation from snapshot to read_committed_snapshot
* finalised type tests
* Revert "change isolation from snapshot to read_committed_snapshot"
This reverts commit 20c6768071.
* small docstring fix
* remove unused imports
* stress test fixes
* minor formatting improvements
* mssql cdc docs
* finish off cdc docs
* format fix
* update connector version
* add to changelog
* fix for sql server agent offline failing cdc enable on tables
* final structure
* few more updates
* undo unwanted changes
* add abstract test + more refinement
* remove CDC metadata to debezium
* use new cdc abstraction for mysql
* undo wanted change
* use cdc abstraction for postgres
* add files
* pull in latest changes
* ready
* rename class + add missing property
* use renamed class + move constants to MySqlSource
* use renamed class + move constants to PostgresSource
* move debezium to bases + upgrade debezium version + review comments
* downgrade version + minor fixes
* bring in latest changes from cdc abstraction
* reset to minutes
* bring in the latest changes
* format
* fix build
* address review comments
* bring in latest changes
* bring in latest changes
* use common abstraction for CDC via debezium for sql server
* remove debezium from build
* finalise PR
* should return Optional
* pull in latest changes
* pull in latest changes
* address review comments
* use common abstraction for CDC via debezium for mysql (#4604)
* use new cdc abstraction for mysql
* undo wanted change
* pull in latest changes
* use renamed class + move constants to MySqlSource
* bring in latest changes from cdc abstraction
* format
* bring in latest changes
* pull in latest changes
* use common abstraction for CDC via debezium for postgres (#4607)
* use cdc abstraction for postgres
* add files
* ready
* use renamed class + move constants to PostgresSource
* bring in the latest changes
* bring in latest changes
* pull in latest changes
* lower version for tests to run on CI
* format
* Update docs/integrations/sources/mssql.md
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* addressing review comments
* fix for testGetTargetPosition
* format changes
Co-authored-by: George Claireaux <george@claireaux.co.uk>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* pre-PR
* add git config
* format
* Update airbyte-integrations/connectors/source-zendesk-sunshine/requirements.txt
upd requirements.txt remove extra
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* Update airbyte-integrations/connectors/source-zendesk-sunshine/source_zendesk_sunshine/streams.py
backoff time int to float (btw real return type in headers is integer)
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* requested changes
* fix newline absence && rm unnecessary temp file
* url_base to property
* rm extra var coming property
* rm extra var coming property
* save
* finishing updating the documentation
* forgotten definition
* add nullable to pass the test
* fix date in the log
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* Added spec.json
* Initialization
* added oauth2 autorization
* added spec, check, discover + catalogs/configurared_catalogs
* updated request_params
* added paging, slicing (1d)
* Use oath2 for paypal
* incremental sync, acceptance test
* incremental sync, acceptance test
* Added spec.json
* Initialization
* added oauth2 autorization
* added spec, check, discover + catalogs/configurared_catalogs
* updated request_params
* added paging, slicing (1d)
* Use oath2 for paypal
* incremental sync, acceptance test
* incremental sync, acceptance test
* Added spec.json
* Initialization
* added oauth2 autorization
* added spec, check, discover + catalogs/configurared_catalogs
* updated request_params
* added paging, slicing (1d)
* Use oath2 for paypal
* incremental sync, acceptance test
* updated slices and api limits, added validation for input dates
* added tests, fixed cursor related information in schemas and configured catalogs, removed old comments, re-arranged Base PaypalTransactionStream class
* added input param 'env' to support production and sandbox envs
* added support for sandbox option, updated pattern for optional end date option
* added github secrets
* added support for sandbox option, updated pattern for optional end date option
* fixed Copyright date, removed debug mesages
* added docs
* fix for test failure - The sync should produce at least one STATE message
* removed optional parameter 'end_date'
* removed detailed info about balances schema
* Delete employees.json
* Delete customers.json
* Added requests_per_minute rate limit
* added unit tests, added custom backoff
* added test for stream slices with stream state
* removed comments
* updated docs pages
* fixed format for json files
* fixed types in schemas and link to the schema. fixed primary key for Transactions stream
* updated stream slices
* Updated tests, unified stream_slices for both streams, all instance variables instantiated directly in __init__ method
* added CHANGELOG.md
* Added build seeds
* fixed closing double quotation mark
* added paypal entry in builds.md
* add fixture helper
* added paypal transaction generator script
* fixed styling
* maximum allowed start_date is extracted from API response now.
* fixed schemas
* fixed schemas - removed datetime
* now maximum_allowed_start_date is identified by last_refreshed_datetime attr in API response.
* added possibility to specify additional properties
Co-authored-by: Sherif Nada <snadalive@gmail.com>
* Support combined restrictions in json schema
* Bump s3 version
* Add more test cases
* Update changelog
* Add more test cases
* Update documentation
* Format code
* Few updates for GitHub connector
Add `AIRBYTE_ENTRYPOINT` to `Dockerfile`.
Add `Changelog` section to `docs/integrations/sources/github.md`.
Remove `source-github/CHANGELOG.md` file.
* Bump GitHub connector version
#4472 - Source Shopify - change the default stream cursor_field to 'updated_at' where possible
Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
* Bump mysql destination version to pick up normalization
* Also change the publish command to run on ec2-runners to try and avoid build errors with gradle unable to find the right volume.
Co-authored-by: Davin Chia <davinchia@gmail.com>
