e577b4987e
* Implement db config persistence * Fix database readiness check * Reduce logging noise * Setup config database in config persistence factory * Update documentation * Load seed from yaml files * Refactor config persistence factory * Add one more test to mimic migration * Remove unnecessary changes * Run code formatter * Update placeholder env values * Set default config database parameters in docker compose Co-authored-by: Christophe Duong <christophe.duong@gmail.com> * Default setupDatabase to false * Rename variable * Set default config db parameters for server * Remove config db parameters from the env file * Remove unnecessary environment statements * Hide config persistence factory (#4772) * Remove CONFIG_DATABASE_HOST * Use builder in the test * Simplify config persistence builder * Clarify config db connection readiness * Format code * Add logging * Fix typo Co-authored-by: Christophe Duong <christophe.duong@gmail.com> * Add a config_id only index * Reuse record insertion code * Add id field name to config schema * Support data loading from legacy config schemas * Log missing logs in migration test * Move airbyte configs table to separate directory * Update exception message * Dump specific tables from the job database * Remove postgres specific uuid extension * Comment out future branch * Default configs db variables to empty When defaulting them to the jobs db variables, it somehow does not work. * Log inserted config records * Log all db write operations * Add back config db variables in env file to mute warnings * Log connection exception to debug flaky e2e test * Leave config db variables empty `.env` file does not support variable expansion. Co-authored-by: Christophe Duong <christophe.duong@gmail.com> Co-authored-by: Charles <giardina.charles@gmail.com>
27 lines
1.0 KiB
Bash
Executable File
27 lines
1.0 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
set -e
|
|
|
|
. tools/lib/lib.sh
|
|
|
|
assert_root
|
|
|
|
echo "Starting app..."
|
|
|
|
# todo (cgardens) - docker-compose 1.27.3 contained a bug that causes a failure if the volume path
|
|
# does not exist when the volume is created. It was fixed in 1.27.4. Github actions virtual envs,
|
|
# however, new ubuntu release upgraded to 1.27.3 on 09/24/20. Once github actions virtual envs
|
|
# upgrades to 1.27.4, we can stop manually making the directory.
|
|
mkdir -p /tmp/airbyte_local
|
|
|
|
# Detach so we can run subsequent commands
|
|
VERSION=dev TRACKING_STRATEGY=logging docker-compose up -d
|
|
trap 'echo "docker-compose logs:" && docker-compose logs -t --tail 1000 && docker-compose down && docker rm -f $(docker ps -q --filter name=airbyte_ci_pg)' EXIT
|
|
|
|
docker run -d -p 5433:5432 -e POSTGRES_PASSWORD=secret_password -e POSTGRES_DB=airbyte_ci --name airbyte_ci_pg postgres
|
|
echo "Waiting for services to begin"
|
|
sleep 30 # TODO need a better way to wait
|
|
|
|
echo "Running e2e tests via gradle"
|
|
SUB_BUILD=PLATFORM ./gradlew --no-daemon :airbyte-e2e-testing:e2etest
|