* Add source-chargebee/
* Add schemas
* Remove debug messages
* Remove airbyte_secret specification to fix UI error: API key not found
* Add Invoice stream
* Add airbyte_secret back
* Rename streams for consistency with source.py
* Add pagination and incremental syncing
* Add backoff
* Add invoice schema
* Minor JSON bug fix
* Add orders; Clean up source.py
* Change format to remove datetime string with integer (according to Chargebee documentation)
* Change format to remove datetime string with integer (according to Chargebee documentation)
* Change self.params to be instance var (to reset every Stream instance); Add Stream logging; Add Plan
* Change self.params to be instance var (to reset every Stream instance); Add Stream logging; Add Plan
* Add Plan
* Add Addon
* Reformat
* Rename files so they are recognizeable in the UI
* Update airbyte-integrations/connectors/source-chargebee/setup.py
Thanks! TIL!! 🙏
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* introduce automatic migration at the startup of server
* handle versions with non-zero patch
* it works!!!
* add dummy data
* cleanup orphan configs
* add more assertions
* format + add comments
* move migration acceptance test to acceptance test directory
* add automatic migration test to the build
* address review comments
* missed out on these
* format
* add more assertions
* format
* fix test
* format
* use default port for temporal
* move seed to server + introduce atomice replacement for config
* make tests better
* remove unwanted changes
* move atomic replacement logic behind persistence + pass path to latest seeds
* format
* update seeds
* review comments
* update seeds
* merge latest seeds with configs
* fix bug around latest seed
* update seed
* update seed
* seeds should be populated by separate container
* address review comment + change latest definition url
* update seeds
* format
* update seed references
* update seed
* update seed
* update seed
* update seed references
* update seed references + add Migration Acceptance Test
* update seed container in kube + disable automatic migration for kube + update docs
* update docs
* address review comments from Michel
* update doc
* temporary commmit to see if build becomes green
* delete seeds from airbyte config + undo temp commit
* added SAT tests, deleted incremental test sfrom pipeline
* pr changes and tests uncommented
* deleted facebook file from pr
* deleted facebook file from pr
* removed tap adwords from install_requires
* Update airbyte-integrations/connectors/source-google-adwords-singer/acceptance-test-config.yml
* added changelog info
* version bump
* version bump
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* Allow configuring lookback windows and start date, allow configuring whether to join all channels and flake8 errors in amazon source
* added acceptance tests, fixed incremental read test, fixed readme python run instruction
* added acceptance tests
* added pre commit config
* fixed chmod on amazon and facebook files
* format changes
* fixed chmod on amazon and facebook files
* fixed tests
* pr changes
* deleted amazon changes, precommit file and source pr changes
* changed lookback window to interval
* changed lookback window to duration
* added annotations
* changed lookback_window to pendulum.duration logic
* added cast cursor field function, deleted latest_state changing during get_update_state function
* deleted threads from configured catalog due to the timeout error in incremental stream
* deleted threads from configured catalog due to the timeout error in incremental stream
* deleted threads from configured catalog due to the timeout error in incremental stream
* deleted try except blocks and response parsing
* fix state parsing logic, leave timestamp
* grooming
* pr changes and tests uncommented
* updated cursor field and according files
* version bump
* version bump
* version bump
* version bump
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
* looker run_looks method works with normalization
* update catalogs
* validate that look(s) entered actually exist at config time
* field type lookup works, though it is a bit messy
* don't re-run explore query if we have already run it
* add more type mappings
* add some docstrings and comments
* add title for ease of use
* Revert "update catalogs"
This reverts commit 7ecaaa4d0d.
* fix configuration file formatting
* fix some issues from code review and reorder methods
* update docs to include run_look endpoint
* Add source_defined_primary_key validation test to test_read
* Updated source defined PKs test
* Fix source defined PKs test exception formatting.
* Update test_core.py source_defined_primary_key test.
Add parse_value date type support.
* Bump docker version
* move to CDK implementation
* make insights streams configurable
* improve Async implementation using slices
* minimize set of streams in configured_catalog.json
* apply suggestions from @sherifnada
* improve async jobs handling even more
Co-authored-by: Ka-Ping Yee <zestyping@gmail.com>
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
small fixes for SAT for better DX:
- better stack trace in case of error inside the connector, print only relevant information with proper formatting (multiline stack trace instead of single string)
- better logging - print message about image pulling only when it actually happens, stop tests if image not found
- using discovery command for json_schema, when configured_catalog will be loaded we populate `json_schema` from a schema that we get from discovery command, the result is cached for all session duration.
- better record comparison, takes care of lists inside dicts - because lists are unordered we will have false negatives when compare serialized records.
- copied pytest config to airbyte root folder, so when pytest runs tests locally it can find it, this will affect all local execution of pytest
- add IPython as a standard debugger
Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
Use Log4j2 appender to support routing logs to S3.
Create LogClient to support reading from S3.
Some clean up of the Log4j2 xml variables.
Several dependency changes to be more explicit when configuring jackson.
* add changelog for postres source
* add changelog for mysql source
* add changelog for mssql source
* add changelog for file source
* add changelog for google sheets
* add full changelog for file source
* add full changelog for google sheet source
* add full changelog for mssql source
* add changelog for http requests
* add changelog for salesforce source
* add changelog for facebook marketing source
* add changelog for google analytics source
* add changelog for shopify native source connector
