1
0
mirror of synced 2025-12-22 03:21:25 -05:00
Commit Graph

135 Commits

Author SHA1 Message Date
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Mohamed Magdy
273537ac59 Source Recurly: adds state_checkpoint_interval to streams (#13685)
* Add `state_checkpoint_interval` to Recurly stream

* Bumpg Recurly source version to `0.4.1`
2022-08-11 11:56:42 -03:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Christophe Duong
744e0d5f13 Refactor Snowflake internal Staging as a base class for other staging classes (#10865)
* Refactor Snowflake internal Staging as model to share staging abilities in jdbc destinations
2022-03-11 15:29:12 +01:00
Mohamed Magdy
63af98e3b9 🎉 Recurly Schema Revamp (#9866)
* Cleanup Recurly connector schemas

* Add more Recurly schemas to the connector

- `billing_infos`
- `shipping_addresses`
- `shipping_methods`
- `subscription_changes`

* Add Recurly `add-on` resouce

* Add Recurly's account notes resource schema

* Add unique coupons to Recurly source

* Add credit payments to Recurly connector

* Add Recurly resources to integration tests configurations

* Bump Recurly source version to `0.4.0`

* Add `line_items` Recurly resource

* Add `line_items` to Recurly documentation

* Add missing `line_items` JSON schema

* Replace Subscription Change Recurly API call with Subscription `pending_changes` field

* Replace Recurly unique coupon codes API call with coupons `unique_coupon` field

To avoid the extra API call to import unique coupon calls

* Revert "Replace Recurly unique coupon codes API call with coupons `unique_coupon` field"

This reverts commit 1c4592d82d.

* Add `end_time` parameter to Recurly connector

* Order Recurly specs

* Set the Recurly `begin_time` and `end_time` to be optional

* Add `order` to Recurly `source_spec.yaml`

* Add `maxLength` to Recurly source schemas

* Set `maxLength` for Recurly Subscription and Transaction `uuid`

* Fix Recurly `export_dates` acceptance tests
2022-03-08 17:59:47 +05:30
Iryna Grankova
579923d2f8 Update fields in source-connectors specifications: posthog, recurly, redshift, salesforce, salesloft (#8617)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-01-25 16:14:02 +02:00
Mohamed Magdy
484169eed1 🐛 Source Recurly: avoid loading all accounts when importing account coupon redemptions (#9382)
* Avoid loading all accounts when importing account coupon redemptions

* Bump Recurly connector version to `0.3.1`

* merge contributor code

* update seed file

* update docs

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2022-01-10 19:55:02 -03:00
Christophe Duong
7727b86359 Include tcp port in Clickhouse destination configuration for normalization (#9340)
* Include tcp port in Clickhouse destination configuration for normalization

* revert custom dbt on clickhouse

* Bumpversion of destination connector

* Format code
2022-01-06 18:03:06 +01:00
Mohamed Magdy
4a535ebdfc 🎉 Source Recurly: Support incremental Sync Mode (#8675)
* [1384] Change Recurly connector to use `AbstractSource` and `Stream`

Those 2 classes are part of the CDK and are the base line to start integrating
the `incremental` sync mode to the Recurly resources

* [1384] Support `incremental` sync mode for Recurly

* [1384] Add `account_coupon_redemptions` Recurly resource

* [1384] Add Recurly source unit tests

* [1384] Bump `source-recurly` version to `0.3.0`

Bumped the minor version as the `incremental` sync mode functionality is added

* [1384] Removed `.python-version` from Git

* [1384] Annotate the Recurly `api_key` with `airbyte_secret`

* [1384] Bump `source-recurly` to `0.3.0`

* [1384] Update code style

After running `gradle`

* [1384] Update Recurly source documentation

By adding the Account Coupon Redemption documentation
and setting the `Incremental sync` to `Yes`

* [1384] Fix typo in Python doc

* [1384] List all accounts when fetching the redeemed coupons

As fetching accounts only updated after the `begin_time` won't work in
`incremental` sync mode if an older account redeemed coupons

* [1384] Fix typo in Python doc

* [1384] Update Recurly JSON schemas

* [1384] Move constants outside the `BaseStream` class

* [1384] Add `incremental` sync mode acceptance tests for Recurly

* [1384] Remove the mandatory `name` method to override in child classes

In the Recurly streams

* [1384] Fix formatting

* [1384] Remove `format: "email"` from Recurly `invoices` schema

* [1384] Add `account_coupon_redemption` to Recurly acceptance tests
2021-12-28 22:30:29 -03:00
vitaliizazmic
79acc2bf69 🎉 Source Recurly: migrate to the CDK
* Source Microsoft Teams #8315 - migrate to  the CDK

* Source Microsoft Teams #8315 - acceptances test

* Source Microsoft Teams #8315 - fixed schemas

* Source Microsoft Teams #8315 - reformat

* Source Microsoft Teams #8315 - bump version

* Source Recurly #8318 - reformat
2021-12-06 19:54:02 +02:00
Michel Tricot
1773e41e47 Shorten our headers + adds contributors file (#6478) 2021-09-27 10:45:50 -07:00
Jared Rhizor
b4793b2510 add AIRBYTE_ENTRYPOINT for kubernetes support (#3973)
* add AIRBYTE_ENTRYPOINT for kubernetes support

* bump versions

* bump version in seed

* Update generic template

* keep scaffold sources at 0.1.0

* add missing newline

* handle python base versions correctly

* re-bump mysql and postgres sources

* re-bump snowflake destination

* add skip tests option

* switch to running tests

* reverse conditional to make it safer

* fix publish to include the test running

* fix iterable version

* fix file generation

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2021-06-09 13:01:45 -07:00
Marcos Marx
2f8b10d2d0 Recurly catalog update (#3818)
* update recurly catalog

* change config files
2021-06-02 15:04:55 -03:00
Dmytro
a1035e007b 📚 Update all Python connectors READMEs with minimum required version (#3760) 2021-06-02 12:35:29 +03:00
Marcos Marx
3129a17653 change all integers to number on recurly catalog (#3769) 2021-06-01 15:09:00 -03:00
Marcos Marx
f13d578304 Source Recurly bugfix: update integer to number normalization (#3751) 2021-05-31 12:57:54 -03:00
Charles
0df53170c9 Stop formatting python with spotless (#3388) 2021-05-13 17:46:34 -07:00
Davin Chia
f660b0a946 Add template generation for Santa aka CDK. (#3034)
Template generation for new Source using the Santa CDK - provide basic scaffolding for someone implementing a new source.

General approach is to buff up comments in the original SDK, and add TODOs with secondary comments in the generated stub methods, as well as links to existing examples (e.g. Stripe or ExchangeRate api) users can look at.

Checked in and added tests for the generated modules.
2021-04-25 18:02:33 +08:00
Charles
f445fdb5b2 match styling for spotlessApply and format (#3017)
* as a java developer I want to be able to run spotlessApply without changing styles in python code
2021-04-23 09:21:41 -07:00
Sherif A. Nada
2d2d0173d6 Update codegen template READMEs (#2873) 2021-04-13 11:41:52 -07:00
Jared Rhizor
0609011e05 fix connector base versioning (#2726)
* fix connector base versioning

* only run integration tests in non-bases directories

* upgrade datamodel-code-generator which coincidentally has already fixed this issue with generating List of Lists

* bump forgotten hubspot version

* fix build
2021-04-02 22:46:06 -07:00
Christophe Duong
bc1547f185 Fix integration tests of connectors related to destination_sync_mode and sync_mode being required (#2688) 2021-04-01 09:58:38 +02:00
Sherif A. Nada
02a5b9b8a8 depend on published base singer/python images in existing connectors (#2469) 2021-03-15 18:21:05 -07:00
Sherif A. Nada
fe22594bb9 update all python Readmes to describe dev process without gradle (#2442) 2021-03-15 18:05:38 -07:00
Sherif A. Nada
2139a9656b Cleanup Python packages (#2440) 2021-03-15 01:24:21 -07:00
Christophe Duong
070575ffdf Protocol allows future / unknown properties (#2238)
* Allow new extra properties in validation
* Create migration script to upgrade all connectors versions
* Bumpversion of all connectors
2021-03-09 13:36:36 +01:00
Sherif A. Nada
ac0bcf7d01 Add comment at the top of all requirements.txt files clarifying they should not be used for dependencies (#2366) 2021-03-08 19:01:47 -08:00
Christophe Duong
e92e9aa8c4 Refactor python sources (#1331)
* Make ConfigContainer internal to SingerSource only
2020-12-16 17:52:17 +01:00
Sherif A. Nada
e8a332ae65 Standard source incremental tests (#1175) 2020-12-04 09:54:10 -08:00
Sherif A. Nada
b31b4dc94a Update recurly sample catalogs (#1084) 2020-11-25 00:12:37 -08:00
Sherif A. Nada
130b0fa311 add recurly creds to ci (#1085) 2020-11-24 22:59:38 -08:00
Yevhenii
9b033891dc Recurly (#1058) 2020-11-24 22:19:06 -08:00