1
0
mirror of synced 2025-12-21 19:11:14 -05:00
Commit Graph

29 Commits

Author SHA1 Message Date
Natalie Kwong
7b70a70eb0 docs: Update old resources (#46875) 2024-10-19 03:35:32 +03:00
Davin Chia
aa5d6dd6b3 docs: worker v2 public docs. (#42873)
Update docs to prep for Worker V2 OSS launch.

The main focus is a brief explanation of what/why/how of the feature. We have a blog post in the works I'm going to link to for more explaination once it's published.

- Remove old *_WORKER configs.
- Update the diagram to reflect the new flow. Viewing now is not great due to the rendering. Will likely follow up on a different diagram.
- Write Worker V2 explanation. Note that I left all the Docker pieces in place and tried to make things 'flow'. Will follow up here when we deprecate Docker officially.

Co-authored-by: Jimmy Ma <gosusnp@users.noreply.github.com>
2024-07-31 05:44:44 +00:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Ryan Br
a384c59263 Rbroughan/stream limits docs updates (#37526) 2024-04-24 10:06:51 -07:00
terencecho
2080c8c014 Update documentation for aws secret manager configs (#35057) 2024-02-09 00:09:12 -08:00
Tim Roes
faedd86ee0 📚 Add availability information to docs (#33650) 2023-12-20 18:47:58 +01:00
Tim Roes
de0a392b17 Move access variables do docker specific section (#30499) 2023-09-16 02:17:40 +02:00
Antoine Balliet
a10595e171 Add hint to change Airbyte instance URL used in slack notifications (#30024) 2023-08-31 09:28:37 -05:00
Marcos Marx
ab34d4dc88 Remove Kustomize references in docs and replace with Helm Chart (#30008) 2023-08-31 10:24:08 -03:00
Malik Diarra
1095bf75f4 Remove obsolete Kustomize documentation (#29641) 2023-08-21 14:12:38 -07:00
Ryan Br
4dba9ddc7f Rbroughan/add retry docs (#29421)
* Update docs with basic attempt information.

* Add backoff and env vars docs.

* Currently -> by default.

* Add retry attempt example tables.
2023-08-15 09:53:24 -07:00
Pedro S. Lopez
b4051ccca1 Delete docs for old sentry integration (#27719)
* Delete sentry-integration.md

* rm image

* rm other references
2023-06-26 17:06:49 -04:00
hehe
431b7d1ba8 docs: update configuring-airbyte.md (#26822) 2023-05-31 07:30:28 -05:00
Chris Wu
7a250d57fd Docs: Add AWS_SECRET_MANAGER to list of available options for storing secrets in documentation (#25374) 2023-04-21 09:32:37 -03:00
Jimmy Ma
dd379bb492 Document the config for docker workspace cleanup (#25210) 2023-04-14 14:29:14 -07:00
Martin Nash
df545d1667 Correcting minor typo. (#22827)
Misspelling of Kubernetes.

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-02-14 18:15:08 -06:00
Mauricio
f76833e2e0 🎉 New implementation for AWS Secret Manager for issue (#19690)
* 🎉 New implementation for AWS Secret Manager for issue
#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager

* Updated version to `aws-secretsmanager-caching-java:1.0.2`
- Added new argument check for AWS Secret Manager.

* exclude jackson-databind from aws dependency and run gradle format

* bump aws-related dependencies to prevent old version of jackson-databind from being pulled in

* - Added new entry for `AWS_SECRET_MANAGER` into SecretPersistence.java
- Externalized configurations for AWS Secret Manager into Configs and EnvConfigs.java as requested.
- Adjusted test to use new constructor for `AWSSecretManagerPersistence`
- Augmented instructions configuring-airbyte.md with the new config keys.

* Formatting code.

* revert dependency version bump

Co-authored-by: pmossman <parker@airbyte.io>
Co-authored-by: mauricioalarcon <unknown>
2022-12-12 15:25:23 -08:00
Marcelo Castro
2dbbe655b7 Airbyte-Proxy: Added a variable to control timeout (#19493)
* Added a default proxy timeout of 5min

* Changed proxy timeout to be a .env variable

* Update docs/operator-guides/configuring-airbyte.md

Co-authored-by: Evan Tahler <evantahler@gmail.com>

* Changed file permissions

Co-authored-by: Evan Tahler <evantahler@gmail.com>
Co-authored-by: Nataly Merezhuk <65251165+natalyjazzviolin@users.noreply.github.com>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2022-12-12 11:04:41 -03:00
Evan Tahler
3d053e32ee Use Nginx + Basic Auth to secure OSS Airbyte (#17694)
* Use Nginx + Basic Auth to secure OSS Airbyte

* use local passwords

* Use gradle builds

* K8s setup and source values from ENV

* note about disabling

* add back defaults

* custom 401 page

* update http message

* update docs

* remove kube files

* additional doc updates

* Add a test suite

* fix failure exit codes

* doc updates

* Add docs

* bump to re-test

* add more sleep in tests for CI

* better sleep in test

* Update docs/operator-guides/security.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* PR updates

* test comment

* change test host on CI

* update tests and nginx to boot without backend

* proxy updates for docker DNS

* simpler test for uptime

* acceptance test skips PWs

* remove resolver madness

* fixup tests

* more proxy_pass revert

* update acceptance test exit codes

* relax test expectations

* add temporal mount back for testing

* Update docs/operator-guides/security.md

Co-authored-by: swyx <shawnthe1@gmail.com>

* Update airbyte-proxy/401.html

Co-authored-by: swyx <shawnthe1@gmail.com>

* more doc updates

* Octavia CLI uses Basic Auth  (#17982)

* [WIP] Octavia CLI uses Basic Auth

* readme

* augustin: add basic auth headers to clien

* augustin: add basic auth headers to client

* tests passing

* lint

* docs

* Move monkey patch to test

* coerce headers into strings

* monkey patch get_basic_auth_token

Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>

* fix launch permissions

* Keep worker port internal

* more readme

Co-authored-by: Davin Chia <davinchia@gmail.com>
Co-authored-by: swyx <shawnthe1@gmail.com>
Co-authored-by: alafanechere <augustin.lafanechere@gmail.com>
2022-10-19 15:52:01 -07:00
Davin Chia
5cb66a3471 Update monitoring configuration documentation. (#15861) 2022-08-22 15:49:05 -07:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596)
This reverts commit a2c194a11f.
2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369)
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
2022-07-08 14:18:27 -05:00
Stella Chung
007e7b5258 secret-persistence: Hashicorp Vault Secret Store (#13616)
Co-authored-by: Amanda Murphy <amanda.murphy@heapanalytics.com>
Co-authored-by: Benoit Moriceau <benoit@airbyte.io>
2022-06-24 07:20:19 +02:00
Lake Mossman
73034c64da Sweep old scheduler code (#13400)
* sweep all scheduler application code and new-scheduler conditional logic

* remove airbyte-scheduler from deployments and docs

* format

* remove 'v2' from github actions

* add back scheduler in delete deployment command

* remove scheduler parameters from helm chart values

* add back job cleaner + test and add comment

* remove now-unused env vars from code and docs

* format

* remove feature flags from web backend connection handler as it is no longer needed

* remove feature flags from config api as it is now longer needed

* remove feature flags input from config api test

* format + shorter url

* remove scheduler parameters from helm chart readme
2022-06-06 10:49:17 -07:00
Guy Feldman
5e003583a7 Issue: 11867 add option for sidecar pull policy (#11868)
* adding env config JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY to support image pull policy on sidecar containers

* add documentation

* docs: adding more description and trying to force cla check.

* docs: fix wording
2022-04-13 19:08:30 -03:00
Thibaud Chardonnens
5528d7d874 airbyte-workers: add support for kubernetes pod annotations (#10753)
This PR adds the possibility to define pod annotations to the pods created by the workers.
Pod annotations can be required in different situations, such as configuring which IP pool to use when using some network plugins.

The original PR was here: #9874 we decided to split it into 3 different PRs.
2022-04-05 17:44:59 +08:00
Augustin
f3fa7ad92b Documentation: fix typo in configuring Airbyte (SECRET_PERSISTENCE) (#9848) 2022-01-28 09:29:45 +01:00
Maksym Pavlenok
20d6009afa add Sentry docs (#9791) 2022-01-25 18:43:18 +02:00
Davin Chia
8d34062a4f Move configuring airbyte to operator guides. (#9272) 2022-01-04 18:10:49 +08:00