1
0
mirror of synced 2026-01-20 03:07:18 -05:00
Commit Graph

73 Commits

Author SHA1 Message Date
Michel Tricot
9a2ec03e40 Test connector templates (#2081) 2021-02-16 22:05:29 -08:00
Michel Tricot
ac092ada6e Hide connector scaffolding behind a script (#2080) 2021-02-16 20:09:03 -08:00
Jared Rhizor
30e2e98c49 fix formatting issues (#2045)
* fix formatting issues

* remove space

* unit tests -> format anchor
2021-02-11 13:02:21 -08:00
Charles
be5fbc2e8a Move Python checklist to docs (#1810) 2021-01-25 16:55:55 -08:00
Charles
e3639b1a93 add import to build.gradle.hbs so that python module will build (#1556) 2021-01-06 16:04:57 -08:00
Sherif A. Nada
222413104a use standardSourceTestFile by default in python templates (#1360) 2020-12-17 13:45:17 -08:00
Christophe Duong
bc207528b3 Add docs in python source templates (#1365)
* Add docstrings to template code (#1320)

* Make standard tests passing on a newly created python source (will make it easier to automate testing of #725)

* Add docstring in python singer source

* Add note on loggers
2020-12-17 19:29:12 +01:00
Christophe Duong
e92e9aa8c4 Refactor python sources (#1331)
* Make ConfigContainer internal to SingerSource only
2020-12-16 17:52:17 +01:00
Charles
25689eea56 add incremental to jooq source (and postgres) (#1172) 2020-12-08 21:14:11 -08:00
Sherif A. Nada
e59c4994e9 Update templates to reflect standard test changes (#1214)
* update templates for new tests

* one more

* add renamed files
2020-12-04 20:27:24 -08:00
Charles
eb601c5be0 Add Connectors using an index yaml file, instead of individual json files (#1046) 2020-11-30 01:04:19 -08:00
Sherif A. Nada
de09b40b93 Update templates to reflect incremental model changes (#1083) 2020-11-24 22:22:03 -08:00
Sherif A. Nada
b05a2b0839 Update connector READMEs to reflect new build plugin commands (#969) 2020-11-12 20:36:18 -08:00
Charles
cf21f2a3a2 Various Docs Updates (#964)
* Explain how to implement standard tests in python and singer sources
* Make a note that basic normalization doesn't current work with >100 many fields. There's a fix in progress for this.
* Document how to reset the connectors index in local development.
2020-11-12 16:13:53 -08:00
Charles
54dba21b96 use hyphen instead of underscore in template (#907) 2020-11-11 12:01:20 -08:00
Jared Rhizor
e1d7add50a mostly incremental builds (#817)
* support cached builds for base -> base-java -> snowflake

* use plugin for image building

* fix matching on COPY from

* remove docker.gradle

* tmp commit

* update connectors

* finish rest of build files

* fix ide errors

* more build fixes

* clean up

* clean up for new soruces

* fix spotless

* fix flake problems

* add recommended empty file

* python caching

* fixes upon review

* clean up docker and build test files

* clean up python

* clean up

* fix integration test dependencies

* fix standard tests

* fix

* remove symlink

* re-add requirements to fix normalizatioon build

* fix symlink

* fix dumbest build problem of all

* add missing integration test def

* fix missing dep

* remove class exclusion

* move trim so null source versions are allowed

* rename map

* fix hardcoded value

* remove unnecessary dep

* use dashes for salesforce package name

* fix typo

* DRY and fix test image name

* Fix edit

* assert string is not empty

* build integration test image only for integrationTest

* move code generator to tools and rename docker build tasks

* make source test depend on integration test build, not the other way

* remove guard because the docker build should exist before the integrationtest is applied

* remove comment

* DRY up airbyte-source-test

* fix plugin compilation

* add missing dependency

* rename getTaggedImage to getDevTaggedImage

* fix test vs main docker build bug
2020-11-09 11:00:11 -08:00
Sherif A. Nada
636a7d8154 python template documentation improvements (#823) 2020-11-05 09:42:13 -08:00
Sherif A. Nada
f7b9bda81f Add Singer Facebook Source (#808) 2020-11-04 16:38:54 -08:00
Sherif A. Nada
6ac281fad9 improve python source code documentation and typing for better DX (#811) 2020-11-04 09:57:43 -08:00
Christophe Duong
daf58b2dbd Add SourceFile integration (#716)
Implement Source for files stored in GCS/S3/SFTP/SSH/SCP
2020-11-02 18:43:59 +01:00
Charles
97085c744c template fixes (#775) 2020-11-02 07:30:16 -08:00
Sherif A. Nada
a14d8385e7 template: Install pytest as a module in the venv to allow more flexible testing (#761) 2020-10-30 10:58:25 -07:00
Sherif A. Nada
92d542c166 Add python source template generator (#740) 2020-10-29 20:29:27 -07:00