1
0
mirror of synced 2026-01-05 12:05:28 -05:00
Commit Graph

23 Commits

Author SHA1 Message Date
Davin Chia
73e6f576bb Fix Kube S3 Logging Bug. (#4914)
See bluedenim/log4j-s3-search#101 for a summary.

Because this is upstream, I built the jar locally and uploaded it to a temp gcs bucket serving as a maven repository.

I've added this location and the new version in the build.gradle.

I want to merge this in now since there are several users waiting on this. Created #4915 to follow up with the OSS PR and clean up work.
2021-07-23 12:34:35 +08:00
Sherif A. Nada
a4bb30430d Python Demo Destination: KVDB (#4786) 2021-07-19 09:44:36 -07:00
Davin Chia
5f7d36efa6 🐛 Add missing dependencies for acceptance tests to run. (#4808) 2021-07-19 12:24:07 +08:00
Charles
d279ae3796 Restore template generator and fix formatting. (#4768) 2021-07-15 14:08:18 -07:00
Jared Rhizor
b4793b2510 add AIRBYTE_ENTRYPOINT for kubernetes support (#3973)
* add AIRBYTE_ENTRYPOINT for kubernetes support

* bump versions

* bump version in seed

* Update generic template

* keep scaffold sources at 0.1.0

* add missing newline

* handle python base versions correctly

* re-bump mysql and postgres sources

* re-bump snowflake destination

* add skip tests option

* switch to running tests

* reverse conditional to make it safer

* fix publish to include the test running

* fix iterable version

* fix file generation

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-06-09 13:01:45 -07:00
vovavovavovavova
123355bd04 secondary PR: update acceptance config variable (#3930) 2021-06-08 09:09:35 +03:00
Dmytro
a1035e007b 📚 Update all Python connectors READMEs with minimum required version (#3760) 2021-06-02 12:35:29 +03:00
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Davin Chia
9a92da06b9 Update CDK Tutorial to use new CDK. (#3358)
As the title suggests.

Some intricacies around how various directories have diverged.

The HTTP templates now use integration_tests to house catalogs and config files instead of sample_files. After this PR, everything should be updated to use integration_tests for all files except config files. Config files use secrets since they often contain secrets. Anything, besides actual implementations that have yet to be updated, not following this is my mistake.

Even though it diverges from the generated templates, I've decided to leave the tutorial code and the tutorial as using sample_files for now. I think it's more straightforward than telling people to create a new secrets directory. We can change this at a later date.

Confirmed the checked in http python tutorial code works by running ./gradlew :airbyte-integrations:connectors:source-python-http-tutorial:standardSourceTestFile.
2021-05-11 16:52:13 +08:00
Davin Chia
94f6d17796 CDK: Update conceptual docs. Update template docs. (#3352) 2021-05-11 11:02:51 +08:00
Sherif A. Nada
0cc1f637d4 CDK: update generated modules used in testing generators (#3353) 2021-05-10 19:04:08 -07:00
Davin Chia
945e46b53e Update generator templates to use CDK. (#3316)
* Update singer template.
* Update source python.
* Update http python.
* Fix a bug where the template tests were not previously running.
2021-05-11 06:26:22 +08:00
Davin Chia
f660b0a946 Add template generation for Santa aka CDK. (#3034)
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.

General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.

Checked in and added tests for the generated modules.
2021-04-25 18:02:33 +08:00
Charles
f445fdb5b2 match styling for spotlessApply and format (#3017)
* as a java developer I want to be able to run spotlessApply without changing styles in python code
2021-04-23 09:21:41 -07:00
Sherif A. Nada
2d2d0173d6 Update codegen template READMEs (#2873) 2021-04-13 11:41:52 -07:00
Jared Rhizor
0609011e05 fix connector base versioning (#2726)
* fix connector base versioning

* only run integration tests in non-bases directories

* upgrade datamodel-code-generator which coincidentally has already fixed this issue with generating List of Lists

* bump forgotten hubspot version

* fix build
2021-04-02 22:46:06 -07:00
Christophe Duong
bc1547f185 Fix integration tests of connectors related to destination_sync_mode and sync_mode being required (#2688) 2021-04-01 09:58:38 +02:00
Sherif Nada
c9bed304dc hotfix python template scaffolding 2021-03-15 17:31:22 -07:00
Sherif Nada
50accf925f hotfix: fmt 2021-03-15 02:39:02 -07:00
Sherif A. Nada
e87468d4bc improve instructions in templates & publish base docker images to dockerhub (#2441) 2021-03-15 02:16:36 -07:00
Sherif A. Nada
2139a9656b Cleanup Python packages (#2440) 2021-03-15 01:24:21 -07:00
Sherif A. Nada
ac0bcf7d01 Add comment at the top of all requirements.txt files clarifying they should not be used for dependencies (#2366) 2021-03-08 19:01:47 -08:00
Michel Tricot
9a2ec03e40 Test connector templates (#2081) 2021-02-16 22:05:29 -08:00