1
0
mirror of synced 2025-12-25 11:06:55 -05:00
Commit Graph

11 Commits

Author SHA1 Message Date
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Davin Chia
f660b0a946 Add template generation for Santa aka CDK. (#3034)
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.

General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.

Checked in and added tests for the generated modules.
2021-04-25 18:02:33 +08:00
Charles
f445fdb5b2 match styling for spotlessApply and format (#3017)
* as a java developer I want to be able to run spotlessApply without changing styles in python code
2021-04-23 09:21:41 -07:00
Sherif A. Nada
3ab8c26a6f Add intercom source (#1255) 2020-12-08 14:42:58 -08:00
Sherif A. Nada
e8a332ae65 Standard source incremental tests (#1175) 2020-12-04 09:54:10 -08:00
Jared Rhizor
e1d7add50a mostly incremental builds (#817)
* support cached builds for base -> base-java -> snowflake

* use plugin for image building

* fix matching on COPY from

* remove docker.gradle

* tmp commit

* update connectors

* finish rest of build files

* fix ide errors

* more build fixes

* clean up

* clean up for new soruces

* fix spotless

* fix flake problems

* add recommended empty file

* python caching

* fixes upon review

* clean up docker and build test files

* clean up python

* clean up

* fix integration test dependencies

* fix standard tests

* fix

* remove symlink

* re-add requirements to fix normalizatioon build

* fix symlink

* fix dumbest build problem of all

* add missing integration test def

* fix missing dep

* remove class exclusion

* move trim so null source versions are allowed

* rename map

* fix hardcoded value

* remove unnecessary dep

* use dashes for salesforce package name

* fix typo

* DRY and fix test image name

* Fix edit

* assert string is not empty

* build integration test image only for integrationTest

* move code generator to tools and rename docker build tasks

* make source test depend on integration test build, not the other way

* remove guard because the docker build should exist before the integrationtest is applied

* remove comment

* DRY up airbyte-source-test

* fix plugin compilation

* add missing dependency

* rename getTaggedImage to getDevTaggedImage

* fix test vs main docker build bug
2020-11-09 11:00:11 -08:00
Christophe Duong
daf58b2dbd Add SourceFile integration (#716)
Implement Source for files stored in GCS/S3/SFTP/SSH/SCP
2020-11-02 18:43:59 +01:00
Jared Rhizor
73446b2f48 google analytics source + regex standard testing (#715)
* save GA state

* bugfix, documentation, ci creds

* fmt

* set up standard testing

* set up config for check

* oops

* fix path for standard tests

* add to registry

* add documentation and env var handling

* working with new standard source test

* send pageview on setup

* use file for tracker code

* add regexes

* add logging and remove intentionally failing test case

* fmt

* Update airbyte-integrations/bases/standard-source-test/src/main/java/io/airbyte/integrations/base/TestSource.java

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update airbyte-integrations/bases/standard-source-test/src/main/java/io/airbyte/integrations/base/TestSource.java

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* switch to start_date for connection test

* add comment and use future date

* use dashes for packages

* better way to call GA than hardcoded

* restructure for more consistent naming

* fmt

* update ordering

* fix dep from merge

* add regex tests to jdbc

* fmt

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2020-10-30 13:48:30 -07:00
Charles
2f238d6d35 read module env variables in main (#735) 2020-10-29 10:13:46 -07:00
Sherif A. Nada
6452b62dda avoid overloading env variable names (#734) 2020-10-28 23:57:49 -07:00
Charles
a0003dac82 Write python to implement standard source tests (#719) 2020-10-27 20:16:48 -07:00