jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-19 18:14:56 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

41480 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Michel Tricot
29ea7d74c8 Add styling rules for json (#136) 2020-08-31 09:59:46 -07:00
Michel Tricot
d25ea729f4 Create a JSON helper class in common (#134) 2020-08-29 12:57:06 -07:00
Charles
3b060e030f TargetConsumer unit test (#133) 2020-08-29 12:30:05 -07:00
Charles
a99fb6e761 Parse SingerMessage JSON (and unit tests) (#121) 2020-08-28 14:17:15 -07:00
Michel Tricot
f344ecbbb1 Prepare clean mount management (#126) 2020-08-28 14:04:51 -07:00
Jared Rhizor
5d696f01db fix config type switching (#125) 
* fix config type switching

* fix formatting
 2020-08-28 14:03:06 -07:00
Charles
839666862e DefaultSyncWorker unit tests (#122) 2020-08-28 13:55:00 -07:00
Shrif Nada
4e57bec6fe GitBook: [master] one page and one asset modified 2020-08-28 18:17:19 +00:00
Michel Tricot
51f59d58d9 Add dataline-commons to all java projects + fix .env (#124) 2020-08-28 10:59:34 -07:00
Michel Tricot
0660a7ee1a Add Badges to readme 2020-08-27 17:14:43 -07:00
John Lafleur
64390ac53a GitBook: [master] one page modified 2020-08-27 23:46:21 +00:00
John Lafleur
bf2fdca02c GitBook: [master] 30 pages and 2 assets modified 2020-08-27 23:25:40 +00:00
Charles
e53c0e1aaa separate tap and target in sync worker (#113) 2020-08-27 14:32:39 -07:00
John Lafleur
5199f232ee GitBook: [master] one page modified 2020-08-27 20:14:18 +00:00
Sherif A. Nada
6f3e670c05 Fix sync worker deps & tests (#120) 
* save

* working sync tests

* nullcheck

* disable test until docker is fixed
 2020-08-27 12:59:57 -07:00
johnlafleur
541fbcd629 1st tests on README.md (#119) 
* 1st tests on README.md

The goal is to see if Gitbook will update accordingly, if we update GitHub's README.md

* Adding instructions at the end

* With all sections as a 1st draft
 2020-08-27 11:47:49 -07:00
John Lafleur
5308befca3 GitBook: [master] 30 pages modified 2020-08-27 04:02:38 +00:00
Sherif A. Nada
a13441f45a Fix selected settings when converting between singer and DL schema (#117) 2020-08-26 16:12:01 -07:00
jrhizor
7b2ab41b17 remove demo db config after deleting test heroku db 2020-08-26 16:07:38 -07:00
Michel Tricot
8081f790fc Fix path in docker image (#116) 2020-08-26 15:17:28 -07:00
Artem Astapenko
144f7ef57f Sources pages markup and API calls for preferences (#105) 
* Add main sources table

* Add source status page with empty history

* Add settings source page

* Container for source schema page

* Add treeview

* Workspace entity

* Add api calls to preferences page

* Edit preferences form toggles

* Edit api url in config
 2020-08-26 23:15:59 +03:00
Jared Rhizor
a91fa48175 job history handler (#95) 
* add most of job history handler

* finish endpoint

* run build

* format

* use config type and config id instead of scope in the API

* use consistent type:id scopes

* use enum converter

* fix build

* remove private method

* remove rest of function

* add helper for scope creation and interpretation
 2020-08-26 11:04:32 -07:00
Michel Tricot
d50f385f2a Restore clean build step (#115) 2020-08-26 10:44:08 -07:00
John Lafleur
51d1c80471 GitBook: [master] 30 pages modified 2020-08-26 17:31:48 +00:00
Michel Tricot
d31b0b5407 Improve build speed + Prepare fixing docker tests (#112) 2020-08-26 10:02:49 -07:00
Charles
aeab5d54f9 apply java styles revealed by gradle clean (#114) 2020-08-26 00:59:34 -07:00
Charles
0dc24ec117 Use Integrations Enum to determine docker image (#111) 2020-08-25 22:44:19 -07:00
Charles
9c115c9410 pass state into sync worker (#110) 2020-08-25 22:24:15 -07:00
Charles
a1f6188504 add source_implementations/delete (#107) 2020-08-25 22:23:38 -07:00
Sherif Nada
acb902efef fix compilation errors 2020-08-25 17:05:14 -07:00
Sherif A. Nada
0feb7672d9 Add sync worker (#84) 2020-08-25 14:58:58 -07:00
Charles
7bedf00b52 split JobSubmitter into JobSubmitter and JobScheduler (#109) 
* split JobSubmitter into JobSubmitter and JobScheduler

* JobSubmitter looks for pending jobs and runs them.

* JobScheduler checks the schedules for active connections and creates pending jobs if warranted.
 2020-08-25 14:39:49 -07:00
John Lafleur
bfcef5446e GitBook: [master] one page modified 2020-08-25 18:20:48 +00:00
John Lafleur
bcb29cb345 GitBook: [master] 25 pages modified 2020-08-25 15:13:02 +00:00
Charles
fb337013e4 validate request body against openapi schema (#104) 2020-08-25 08:11:20 -07:00
Charles
bc08781cd9 Operate on docker image workers (#102) 2020-08-25 08:08:55 -07:00
Charles
25c3d8b270 hotfix: getConfigs and add destination configuration (#106) 
* Addresses a bug where if the resource directory for a config type did not exist, the config persistence would throw an error. Fixed it by creating that directory before trying to read it.

* Add big query as a destination for sake of example in the UI.
 2020-08-25 08:02:52 -07:00
John Lafleur
245457faca GitBook: [master] 2 pages modified 2020-08-25 07:14:37 +00:00
John Lafleur
682280b204 GitBook: [master] 32 pages modified 2020-08-25 06:49:44 +00:00
John Lafleur
ebba4dded5 GitBook: [master] 9 pages modified 2020-08-25 06:32:14 +00:00
Charles
c8ce024081 standardize configuration interface (#101) 
* DiscoveryWorker => DiscoverSchemaWorker 

* Map from spec id to the docker image that should be used to for the worker.
 2020-08-24 16:03:24 -07:00
Charles
68b07fc5f2 ensure test dir exists (#103) 2020-08-24 15:49:18 -07:00
Sherif A. Nada
72309ac926 run tests in default docker mountpoints (#100) 2020-08-24 13:42:04 -07:00
Charles
00f642a672 Apply Dataline schema to discovered singer catalog (#93) 2020-08-24 13:23:59 -07:00
Charles
e3fadb3653 validate json schema on write (#98) 2020-08-24 12:11:30 -07:00
Sherif A. Nada
dc8138d753 correctly run gradle tests in build script (#96) 2020-08-24 10:20:31 -07:00
Jared Rhizor
fa4d742214 make server depend on db not scheduler (#94) 
* make server depend on db not scheduler

* add back in env vars
 2020-08-21 15:47:49 -07:00
Jared Rhizor
511c28ed25 split scheduler into its own container (#92) 
* split out scheduler

* move entrypoints into the dockerfiles

* update test docker image name
 2020-08-21 11:26:55 -07:00
Jared Rhizor
2c7ae15ad0 add simple job history api interface (#91) 
* add simple job history api

* fix compilation errors
 2020-08-21 10:35:12 -07:00
Jared Rhizor
8be30b0905 fix wait problem (#89) 2020-08-21 09:00:26 -07:00