1
0
mirror of synced 2026-01-07 09:05:45 -05:00
Commit Graph

93 Commits

Author SHA1 Message Date
shyngysnurzhan
f77b59246a Docs: Extended guide for local deployment on windows (#11255)
Co-authored-by: Nurzhan_Shyngys <nurzhanshyngys@gmail.com>
2022-03-18 13:14:54 -03:00
Kemp Po
67ad902874 Docs: update kubernetes deploy (#11044) 2022-03-10 17:41:28 -03:00
davidbeckse
a62dbddeff Doc: deploy use variable instead of hard coded value (#10921)
Replace "airbyte" with $INSTANCE_NAME
2022-03-07 16:25:22 -03:00
Greg Solovyev
fed5a68385 Added a note about running in dev mode on M1 macs (#10776)
Currently, Macs with M1 chips can run Airbyte only in dev mode. I added a note about that.
2022-03-01 16:11:47 -08:00
rbalsick
3aa90a7fce Update deploy spelling error (#10036) 2022-02-04 09:42:01 +05:30
Harshith Mullapudi
1b1b94e705 Added an official Deploy to DigitalOcean button (#10023) (#10025)
Co-authored-by: rbalsick <rbalsick@gmail.com>
2022-02-03 10:57:20 +05:30
Harshith Mullapudi
c554322102 Include DO one-click deployment option (#9803) (#9914)
Offer users the ability to one click deploy much more quickly on DO

Co-authored-by: rbalsick <rbalsick@gmail.com>
2022-01-31 15:59:50 +05:30
michaeljguarino
0d55835d66 Polish docs for installing airbyte on Plural (#9461)
* Polish docs for installing airbyte on Plural

* addressed Abhi's comments
2022-01-13 13:27:51 -08:00
Abhi Vaidyanatha
9b1ed03fe4 Add Plural deployment instructions (#9455)
* Add initial Plural installation instructions.

* Add to SUMMARY.md
2022-01-12 13:56:42 -08:00
Shadab Mohammad
6f621a7c91 Update Oracle Deploy Instructions docs (#8164)
* Update on-oci-vm.md

- Edited sudo command for docker-compose to add version to first block
- Edited command for docker-compose to add sudo to second block
- Added OCI bastion service as a second connection option to deploy Airbyte as a fully secure service in a private subnet
- Multiple movement of blocks to ensure deployment guide has a seamless narrative for the connectivity options

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update on-oci-vm.md

* Add files via upload

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-12-13 20:05:04 -03:00
Jared Rhizor
58475ce2a4 Revert "Update platform containers to use non-root users (#7872)" (#8611)
This reverts commit ebcaf2bcad.
2021-12-07 21:55:06 -08:00
Per-Victor Persson
ebcaf2bcad Update platform containers to use non-root users (#7872)
* Update platform containers to use non-root users

* Update kube template for the webapp container to use port 8080

After having updated the webbapp nginx image to expose port 8080 instead of 80

* missing 80 -> 8080 changes

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2021-12-07 21:40:32 -08:00
Davin Chia
341f505a94 Rename env vars for better readability. (#8447)
* Rename GcsStorageBucket to GcsLogBucket.

* Update all references to GCP_STORAGE_BUCKET to GCS_LOG_BUCKET.

* Undo this for configuration files for older Airbyte versions.

* Clean up Job env vars. (#8462)

* Rename MAX_SYNC_JOB_ATTEMPTS to SYNC_JOB_MAX_ATTEMPTS.

* Rename MAX_SYNC_TIMEOUT_DAYS to SYNC_JOB_MAX_TIMEOUT_DAYS.

* Rename WORKER_POD_TOLERATIONS to JOB_POD_TOLERATIONS.

* Rename WORKER_POD_NODE_SELECTORS to JOB_POD_NODE_SELECTORS.

* Rename JOB_IMAGE_PULL_POLICY to JOB_POD_MAIN_CONTAINER_IMAGE_PULL_POLICY.

* Rename JOBS_IMAGE_PULL_SECRET to JOB_POD_MAIN_CONTAINER_IMAGE_PULL_SECRET.

* Rename JOB_SOCAT_IMAGE to JOB_POD_SOCAT_IMAGE.

* Rename JOB_BUSYBOX_IMAGE to JOB_POD_BUSYBOX_IMAGE.

* Rename JOB_CURL_IMAGE to JOB_POD_CURL_IMAGE.

* Rename KUBE_NAMESPACE to JOB_POD_KUBE_NAMESPACE.

* Rename RESOURCE_CPU_REQUEST to JOB_POD_MAIN_CONTAINER_CPU_REQUEST.

* Rename RESOURCE_CPU_LIMIT to JOB_POD_MAIN_CONTAINER_CPU_LIMIT.

* Rename RESOURCE_MEMORY_REQUEST to JOB_POD_MAIN_CONTAINER_MEMORY_REQUEST.

* Rename RESOURCE_MEMORY_LIMIT to JOB_POD_MAIN_CONTAINER_MEMORY_LIMIT.

* Remove worker suffix from created pods to reduce confusion with actual worker pods.

* Use sync instead of worker to name job pods.
2021-12-03 23:28:48 +08:00
Lake Mossman
93c63a3fc1 improve documentation around logging in kubernetes (#8072)
* improve documentation around logging in kubernetes

* add placeholders in env vars

* add extra clause
2021-11-19 09:30:31 -08:00
Shadab Mohammad
70bd193395 Update on-oci-vm.md (#8081)
1. Editing docker-compose command to include sudo and full path :

sudo /usr/local/bin/docker-compose up -d

2. Specify shape of VM as Intel

Tezt : Ensure you select shape as 'Intel'
2021-11-18 13:44:42 -08:00
Harshith Mullapudi
51bf42abe6 🚀 Digital Ocean deployment (#7192)
* Started digital ocean documentation

* fix: instructions according to ubuntu 20.04

* chore: added to summary

* fix: text change
2021-11-17 13:33:14 +05:30
Shadab Mohammad
f4e3687496 Update on-oci-vm.md (#7890)
Fixes
- URL fix for Airbyte docker image
- URL fix for Docker compose download
- Text Formatting Fix
2021-11-14 21:00:35 -08:00
Jared Rhizor
154ecceda0 improve link checker (#6797)
* improve link checker

* use ref instead of base_ref

* remove base, always compare to master for modified

* add failing to test

* don't do quiet for testing

* switch error to 404 not 403

* yes to both

* turn off verbose mode

* fix

* actually check things

* fix outstanding link problems

* revet change to run for everything

* use new format

* ignore gitbook failures

* switch back to only running on master
2021-11-07 23:01:08 -08:00
Abhi Vaidyanatha
ed78937c3b Add instructions to chmod private key in Azure Setup (#7467) 2021-10-28 13:15:17 -07:00
Abhi Vaidyanatha
4bc5005a9a Add note about host name issue with Azure Cloud (#7462)
* Add note about host name issue with Azure Cloud

* Update SSH Tunnel instructions.
2021-10-28 13:09:37 -07:00
Abhi Vaidyanatha
922bfd08a9 Add recommendation for disk size in GCP/AWS deployment guide. (#7018)
* Add note about Airbyte disk recommendations on GCP.

* Add note for AWS/
2021-10-13 12:49:20 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Harshith Mullapudi
86ee2ad05b fix(docs): remove #4232 since it is fixed (#6789) 2021-10-06 15:33:53 +05:30
Abhi Vaidyanatha
75aee683cd Add waitlist to cloud deploy doc (#6826) 2021-10-05 16:58:11 -07:00
Abhi Vaidyanatha
74d1d6589e Update quickstart. (#6825) 2021-10-05 16:44:19 -07:00
Sherif A. Nada
9006d1638b Update on-cloud.md 2021-10-05 15:24:33 -07:00
Abhi Vaidyanatha
ee8528dd36 Fix lists + add headers for cloud deploy (#6823) 2021-10-05 15:08:58 -07:00
Abhi Vaidyanatha
cbdb11a6f0 Add Deploy guide ☁️ (#6805)
* Add Airbyte Cloud deployment page.

* Small fixes.
2021-10-05 14:53:20 -07:00
Xiangxuan Liu
5ff55abace Update about the helm chart (#6705)
* Update about the helm chart

* Update docs/deploying-airbyte/on-kubernetes.md

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2021-10-04 11:10:36 -03:00
Brian Bugh
5a960831ec Fix MacOS brew install command (#6629) 2021-10-01 16:37:49 -03:00
Abhi Vaidyanatha
805fabb1fc Fix list in quickstart guide. (#6520) 2021-09-28 16:26:14 -07:00
Abhi Vaidyanatha
4631d8c920 Move long filename troubleshooting out of deploy guide (#6518)
* Move long filename troubleshooting out of deploy guide

* Edit title of troubleshooting message.

Signed-off-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>

* period.

Signed-off-by: Abhi Vaidyanatha <abhivaidyanatha@gmail.com>

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-09-28 15:20:01 -07:00
Jared Rhizor
c7d8055731 split scheduler and worker (#5737)
* docker-compose split of scheduler and worker

* fix heartbeat location bug + add support for kubernetes

* use two workers in integration tests

* capture logs in AirbyteTestContainer

* add waiting

* rename to make it easier to review

* rename module

* fix remaining conflicts

* allow configuring max workers of each type and document usage

* fix build

* remove comment

* add worker resource requiremetns

* try to fix for connector build

* fix regression in biuld

* add env comments for SUBMITTER_NUM_THREADS

* Update airbyte-workers/src/main/java/io/airbyte/workers/WorkerApp.java

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update airbyte-workers/src/main/java/io/airbyte/workers/temporal/TemporalPool.java

Co-authored-by: Davin Chia <davinchia@gmail.com>

* merge temporalpool into workerapp

* output docker system info

* move check to before

* remove unnecessary parts of the patch

* could this be the problem? i thought i added this

* show disk usage

* add print statements

* add pruning

* fix prune option

* use force

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-09-08 11:27:32 -07:00
LiRen Tu
a1de8f2361 Format code and add missing doc links (#5847)
* Fix format

* Fix documentation links

* Add missing documentation
2021-09-04 11:17:13 -07:00
Davin Chia
72ba343a1c 🍾 Scaling Airbyte document. (#4630) 2021-08-25 09:44:53 +08:00
Abhi Vaidyanatha
16b21b4ef0 Add note about sending EC2 logs to CloudWatch (#5164)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-08-03 13:24:35 -07:00
Charles
67dd8a353c add deployments to tracking model (#4837) 2021-07-23 17:22:23 -07:00
Davin Chia
73e6f576bb Fix Kube S3 Logging Bug. (#4914)
See bluedenim/log4j-s3-search#101 for a summary.

Because this is upstream, I built the jar locally and uploaded it to a temp gcs bucket serving as a maven repository.

I've added this location and the new version in the build.gradle.

I want to merge this in now since there are several users waiting on this. Created #4915 to follow up with the OSS PR and clean up work.
2021-07-23 12:34:35 +08:00
Jared Rhizor
8529c59d0c update kube docs (#4749) 2021-07-15 08:41:56 -07:00
Shadab Mohammad
9d5231ff0a 📚 add SSH instructions for OCI VM setup (#4684)
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-07-12 13:08:53 -07:00
Davin Chia
bfab448568 🎉 Add documentation for configuring Kube GCS logging. (#4622) 2021-07-09 09:01:10 +08:00
Shadab Mohammad
9b20c1ae4b Create on on-oci-vm.md (#4468)
* Create on on-oci-vm.md

Deployment guide for Airbyte on Oracle Cloud Infrastructure (OCI) VM

* Update on-oci-vm.md

Adding the image links and uploading images to the repository

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update on-oci-vm.md

* Add files via upload

* Update on-oci-vm.md

* Add files via upload

* Update on-oci-vm.md

* Update on-oci-vm.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-07-07 21:55:44 -03:00
jonathan-duval
e2469342d9 Add operator guide for persistant volume on regional GKE cluster (#4591) 2021-07-07 14:22:00 +08:00
Davin Chia
dd41155cc2 Minor kube docs corrections. (#4563) 2021-07-06 17:52:08 +08:00
Davin Chia
52bd5c96f0 🎉 Add Minio support to Kube. (#4365)
Implement logging to and reading from Minio. Use the same S3 client for this.

Configure Airbyte Kube Prod and Staging to use Minio by default, so Airbyte Kube is a standalone deployment.

Also update documentation to reflect this.
2021-06-30 09:42:50 +08:00
Abhi Vaidyanatha
33a80deb0a Fix broken links in docs. (#4419)
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
2021-06-29 14:51:46 -07:00
Jared Rhizor
51bb5ccf42 kubernetes v2 docs (#4234)
* some logs

* Add cloud logging section.

* Add instructions on upgrading Kube K8s.

* minor edit

* minor clarification

Co-authored-by: Davin Chia <davinchia@gmail.com>
2021-06-21 15:00:28 -07:00
Prashantha Patali
0884fa74a6 📚More clarity added for Windows based Docker Desktop environments (#4068)
* Additinal details about Windows specific long filename error during cloning

* Corrected the path

* Revert "Corrected the path"

This reverts commit bbd3b78fcb.

* Revert "Additinal details about Windows specific long filename error during cloning"

This reverts commit 0b695eea1a.

* Email is mandatory 'Specify your preferences', Link to docker inst guide

* Use relative paths while linking

* Typo in Destination section

* On Windows, fixing long filename error during cloning

* For Windows with WSL2 and Docker, clarify steps to locate destination local folder

* Link to locating local files on Windows

* Update docs/contributing-to-airbyte/updating-documentation.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/quickstart/set-up-a-connection.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/examples/postgres-replication.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/examples/postgres-replication.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/examples/postgres-replication.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/local-deployment.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

* Update docs/deploying-airbyte/local-deployment.md

Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>

Co-authored-by: Patali, Prashanth <ppatali@hidglobal.com>
Co-authored-by: Abhi Vaidyanatha <abhi@airbyte.io>
2021-06-16 14:14:25 -03:00
Marcos Marx
3dd14e2c88 add section troubleshoot related issue btw kubectl/kustomize on k8s deploy (#3573)
* add problem btw kubectl/kustomize

* update comments
2021-06-15 20:54:06 -03:00
Matheus Vinicius de Paula
e4335b1d17 Making single port 8000 default and update NetworkErrorBoundary (#3656)
* Making single port 8000 default and update NetworkErrorBoundary.tsx response code 502

* add .env files

* Updating instructions in docs/deploying-airbyte/*
2021-06-09 16:14:12 -07:00