* docker-compose split of scheduler and worker
* fix heartbeat location bug + add support for kubernetes
* use two workers in integration tests
* capture logs in AirbyteTestContainer
* add waiting
* rename to make it easier to review
* rename module
* fix remaining conflicts
* allow configuring max workers of each type and document usage
* fix build
* remove comment
* add worker resource requiremetns
* try to fix for connector build
* fix regression in biuld
* add env comments for SUBMITTER_NUM_THREADS
* Update airbyte-workers/src/main/java/io/airbyte/workers/WorkerApp.java
Co-authored-by: Davin Chia <davinchia@gmail.com>
* Update airbyte-workers/src/main/java/io/airbyte/workers/temporal/TemporalPool.java
Co-authored-by: Davin Chia <davinchia@gmail.com>
* merge temporalpool into workerapp
* output docker system info
* move check to before
* remove unnecessary parts of the patch
* could this be the problem? i thought i added this
* show disk usage
* add print statements
* add pruning
* fix prune option
* use force
Co-authored-by: Davin Chia <davinchia@gmail.com>
See bluedenim/log4j-s3-search#101 for a summary.
Because this is upstream, I built the jar locally and uploaded it to a temp gcs bucket serving as a maven repository.
I've added this location and the new version in the build.gradle.
I want to merge this in now since there are several users waiting on this. Created #4915 to follow up with the OSS PR and clean up work.
Implement logging to and reading from Minio. Use the same S3 client for this.
Configure Airbyte Kube Prod and Staging to use Minio by default, so Airbyte Kube is a standalone deployment.
Also update documentation to reflect this.
* Additinal details about Windows specific long filename error during cloning
* Corrected the path
* Revert "Corrected the path"
This reverts commit bbd3b78fcb.
* Revert "Additinal details about Windows specific long filename error during cloning"
This reverts commit 0b695eea1a.
* Email is mandatory 'Specify your preferences', Link to docker inst guide
* Use relative paths while linking
* Typo in Destination section
* On Windows, fixing long filename error during cloning
* For Windows with WSL2 and Docker, clarify steps to locate destination local folder
* Link to locating local files on Windows
* Update docs/contributing-to-airbyte/updating-documentation.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Update docs/quickstart/set-up-a-connection.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Update docs/examples/postgres-replication.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Update docs/examples/postgres-replication.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Update docs/examples/postgres-replication.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Update docs/deploying-airbyte/local-deployment.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Update docs/deploying-airbyte/local-deployment.md
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
Co-authored-by: Patali, Prashanth <ppatali@hidglobal.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
* Making single port 8000 default and update NetworkErrorBoundary.tsx response code 502
* add .env files
* Updating instructions in docs/deploying-airbyte/*
* add troubleshooting section and remove FAQ file
* add windows new tutorial to summary
* remove change on normalization
* add eof
* transfer user handbook to docs
* review comments and made changes
* fix for filenames too long in local Win deployment
* added Azure Blob Storage capability to files source
* azure blob storage files source connector
* Revert "fix for filenames too long in local Win deployment"
This reverts commit 5a36b979bf.
* Revert "azure blob storage files source connector"
This reverts commit a76130f487.
* Revert "Revert "fix for filenames too long in local Win deployment""
This reverts commit 473ef8be1c.
Co-authored-by: George Claireaux <george.claireaux@effem.com>
