1
0
mirror of synced 2026-01-01 18:02:53 -05:00
Commit Graph

22 Commits

Author SHA1 Message Date
Charles
df4a246017 dev use volumes (#1659)
* have dev use docker volumes instead of bindmounts the same way that stable does
2021-01-15 10:38:55 -08:00
Charles
63c748cd41 fix local mounts in compose after compose update (#576) 2020-10-15 17:13:44 -07:00
Charles
721fe3e8fc Local CSV output to local FS in "prod" env (#363) 2020-09-21 14:42:51 -07:00
Charles
3bed78a227 expose local csv target (#316) 2020-09-18 13:11:23 -07:00
Charles
47e9654ef1 Fix networking issues in Integration Tests (#310) 2020-09-16 13:35:42 -07:00
Michel Tricot
86795a77cb Improve docker in code and configs (#302) 2020-09-16 09:57:32 -07:00
Michel Tricot
039ec06491 Miscellaneous fixes for gradle (#250) 2020-09-13 18:57:40 -07:00
Michel Tricot
7ecfa0fe04 Simplify developer UX when debugging isolated modules (#240) 2020-09-12 09:02:59 -07:00
Michel Tricot
d31b0b5407 Improve build speed + Prepare fixing docker tests (#112) 2020-08-26 10:02:49 -07:00
Jared Rhizor
fa4d742214 make server depend on db not scheduler (#94)
* make server depend on db not scheduler

* add back in env vars
2020-08-21 15:47:49 -07:00
Jared Rhizor
511c28ed25 split scheduler into its own container (#92)
* split out scheduler

* move entrypoints into the dockerfiles

* update test docker image name
2020-08-21 11:26:55 -07:00
Jared Rhizor
8be30b0905 fix wait problem (#89) 2020-08-21 09:00:26 -07:00
Jared Rhizor
84ceb51bf8 improve build speed (#82)
* remove all building from start script

* add sherif's change of not caching gradle deps first

* prefer cached dependencies

* use mount for gradle cache and stop running the server-dist build twice

* only use docker compose

* use build file again

* separate tests

* add test entrypoint

* make testable by pushing image

* get build working with only docker compose

* simplify name

* create webapp_base so we can run tests on it

* run tests

* separate base image builds

* correct tag for webapp-base

* make names line up

* another one

* make tests non-interactive

* final

* use CI mode for the test run

* readable logs in CI

* update documentation

* use auto instead of rich

* add note to readme about running tests before pushing a public docker image
2020-08-20 16:36:26 -07:00
Jared Rhizor
45ae34d9b0 basic scheduling (#37)
* wip

* run scheduler with ServerApp

* use .env for environment

* working scheduling end to end

* use new db schema / tooling

* tmp commit

* complete postgres switchover

* reduce debug logging

* fix bug preventing repeat runs of a job

* refactor

* more refactoring

* add comments to job submitter

* use same log4j config

* don't use star import

* move echoworker

* treat cancelled as completed

* rename

* use scheduled executor

* use jackson instead of gson

* commit autogenerated
2020-08-18 14:42:38 -07:00
Charles
8ebec16d91 Trigger Check Connection from API (#68) 2020-08-18 13:44:05 -07:00
Charles
7390f681a6 pass in persistence paths as env variables (#60) 2020-08-17 15:03:27 -07:00
Sherif A. Nada
af601cdb0a hotfix docker compose (#65) 2020-08-17 12:44:45 -07:00
Sherif A. Nada
636c5dda3a Add Singer infra (#58) 2020-08-14 16:32:06 -07:00
Jared Rhizor
ef0db383f7 use postgres / jooq (without code generation) / test containers (#57)
* add database image to docker compose

* add database setup

* allow connetions from a connect string in env variables

* add a test for the docker case

* add pg init script in docker-compose

* fix env and add server dependency on db

* convert schema to postgres

* use postgres driver

* fix build

* fix edge cases (dependencies between containers, data dirs, etc)

* use docker wait

* remove debugging logging

* add grant

* working test and working docker-compose

* use beforeall

* use key instead of id for k-v metadata

* clean up env names

* fix typo
2020-08-14 11:02:10 -07:00
Jared Rhizor
cb3814fbb2 initial db setup (#18)
* add sqlite support

* remove no-op test

* remove empty scheduler class checked in

* add prod env var to start script

* switch to using data dir in docker

* add stopgap data dir

* fix merge err

* move database operations out of commons into separate module

* fix package paths

* get tests working

* revert gradle properties

* rename to server uuid

* describe ServerUuid

* fix mount folder creation
2020-08-11 09:04:04 -07:00
Michel Tricot
b91aa2c86c Conduit is dead, long live dataline (#33) 2020-08-10 19:44:10 -07:00
Michel Tricot
5f3c82d6f5 Prepare project for Webapp + Support multiple images with Docker compose (#27) 2020-08-10 17:53:19 -07:00