Implement logging to and reading from Minio. Use the same S3 client for this.
Configure Airbyte Kube Prod and Staging to use Minio by default, so Airbyte Kube is a standalone deployment.
Also update documentation to reflect this.
* Add incremental append note about syncs with unchanged data
* Update SQL statement to illustrate how incremental append could work.
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
* introduce automatic migration at the startup of server
* handle versions with non-zero patch
* it works!!!
* add dummy data
* cleanup orphan configs
* add more assertions
* format + add comments
* move migration acceptance test to acceptance test directory
* add automatic migration test to the build
* address review comments
* missed out on these
* format
* add more assertions
* format
* fix test
* format
* use default port for temporal
* move seed to server + introduce atomice replacement for config
* make tests better
* remove unwanted changes
* move atomic replacement logic behind persistence + pass path to latest seeds
* format
* update seeds
* review comments
* update seeds
* merge latest seeds with configs
* fix bug around latest seed
* update seed
* update seed
* seeds should be populated by separate container
* address review comment + change latest definition url
* update seeds
* format
* update seed references
* update seed
* update seed
* update seed
* update seed references
* update seed references + add Migration Acceptance Test
* update seed container in kube + disable automatic migration for kube + update docs
* update docs
* address review comments from Michel
* update doc
* temporary commmit to see if build becomes green
* delete seeds from airbyte config + undo temp commit
* Add paged results to job history retrieval.
* Make job histories come back in a sort order controlled by the sql query
* Increased default job history to show, to make better defaults for UI before paging
* Code review cleanup, constants.
* Update airbyte-scheduler/persistence/src/main/java/io/airbyte/scheduler/persistence/DefaultJobPersistence.java
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Update airbyte-scheduler/persistence/src/main/java/io/airbyte/scheduler/persistence/DefaultJobPersistence.java
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* Use a Pagination object for pagesize and offset
* NPE fix when pagination is not sent with the request and it falls back to defaults
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
* added SAT tests, deleted incremental test sfrom pipeline
* pr changes and tests uncommented
* deleted facebook file from pr
* deleted facebook file from pr
* removed tap adwords from install_requires
* Update airbyte-integrations/connectors/source-google-adwords-singer/acceptance-test-config.yml
* added changelog info
* version bump
* version bump
Co-authored-by: Eugene Kulak <widowmakerreborn@gmail.com>
* looker run_looks method works with normalization
* update catalogs
* validate that look(s) entered actually exist at config time
* field type lookup works, though it is a bit messy
* don't re-run explore query if we have already run it
* add more type mappings
* add some docstrings and comments
* add title for ease of use
* Revert "update catalogs"
This reverts commit 7ecaaa4d0d.
* fix configuration file formatting
* fix some issues from code review and reorder methods
* update docs to include run_look endpoint
