1
0
mirror of synced 2025-12-23 11:57:55 -05:00
Commit Graph

92 Commits

Author SHA1 Message Date
Airbyte
b3fc8f9c2d 🐙 source-kyriba: run up-to-date pipeline [2024-08-17] (#44352) 2024-08-18 03:17:06 +03:00
Augustin
601c3c455c Rename registries to registryOverrides in connector metadata (#43757) 2024-08-13 16:10:56 +02:00
Augustin
859335ad04 🐙 source-kyriba: run up-to-date pipeline [2024-08-10] (#43546) 2024-08-11 02:24:19 +02:00
Augustin
6f535d15b3 🐙 source-kyriba: run up-to-date pipeline [2024-08-03] (#43256) 2024-08-04 02:19:11 +02:00
Augustin
6f246286fe 🐙 source-kyriba: run up-to-date pipeline [2024-07-27] (#42825) 2024-07-28 02:17:37 +02:00
Augustin
e7195031e2 🐙 source-kyriba: run up-to-date pipeline [2024-07-20] (#42289) 2024-07-21 02:22:07 +02:00
Augustin
bc7c52c5cb 🐙 source-kyriba: run up-to-date pipeline [2024-07-13] (#41885) 2024-07-14 02:19:51 +02:00
Augustin
b5ecddde71 🐙 source-kyriba: run up-to-date pipeline [2024-07-10] (#41452) 2024-07-10 16:16:53 +02:00
Augustin
fc76be2ee7 🐙 source-kyriba: run up-to-date pipeline [2024-07-09] (#41147) 2024-07-10 02:23:23 +02:00
Augustin
63d49b2c55 🐙 source-kyriba: run up-to-date pipeline [2024-07-06] (#40874) 2024-07-07 02:23:30 +02:00
Natik Gadzhi
0ab6314e08 chore: Removes .dockerignore and requirements.txt in connectors (#40217) 2024-07-05 11:46:02 -07:00
Augustin
7a0ecc3451 🐙 source-kyriba: run up-to-date pipeline [2024-06-25] (#40367) 2024-06-26 02:25:45 +02:00
Augustin
962f2d2bef 🐙 source-kyriba: run up-to-date pipeline [2024-06-22] (#40111) 2024-06-23 02:19:40 +02:00
Augustin
a033504e11 source-kyriba: [autopull] Upgrade base image to v1.2.2 (#39232) 2024-06-06 16:51:53 +02:00
Augustin
31c95da499 [skip ci] Add connectorTestSuitesOptions to metadata (#38188) 2024-05-15 15:04:10 -05:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Brian Leonard
a57f3b8828 source-kyriba: ensure inline schemas, updated cdk, poetry (where possible) (#37184) 2024-05-01 11:46:31 -07:00
Augustin
8c862a8013 Fix tags in metadata.yaml files: declare cdk tags (#35670) 2024-03-07 04:32:29 -06:00
Maxime Carbonneau-Leclerc
333adf74ec [ISSUE #35112] clean acceptance-test-config.yml (#35708) 2024-02-28 15:35:02 -06:00
Patrick Nilan
b8fb1eefb9 Source Kyriba: Updates CDK, Increases Testing Coverage, Fixes Acceptance Test Config, Adds Expected Records (#34545) 2024-02-01 09:58:30 -08:00
Joe Reuter
51e6cbeffc Publish to pypi batch6 (#34672) 2024-01-31 06:17:53 -06:00
Joe Reuter
4cfaebeacf airbyte-lib: Refactor follow-up (#34649) 2024-01-30 12:11:41 +01:00
Joe Reuter
f29234a2db airbyte-lib: Refactor connectors (#34552) 2024-01-30 03:22:13 -06:00
Augustin
368ba78b64 🧹doc: update connectors README and remove acceptance-test-docker.sh (#32209) 2023-11-06 12:36:07 -06:00
Marius Posta
7ae97175a6 gradle: fix repo wide behaviour (#30607) 2023-09-28 05:01:13 -07:00
Ben Church
5c56ac1d84 Airbyte-ci: Remove gradle task connectorAcceptanceTest (#30326) 2023-09-19 15:16:37 -05:00
Ben Church
40781313da Update Internal Fields: update ql levels to better resemble previous high strictness (#29450) 2023-08-15 18:03:10 -05:00
Augustin
00d9462216 cat/connectors-ci: replace docker runner with dagger runner in CAT (#28000) 2023-08-11 17:58:48 +02:00
Ben Church
2f7deaee02 [skip ci] Metadata: Remove leading underscore (#29024)
* DNC

* Add test models

* Add model test

* Remove underscore from metadata files

* Regenerate models

* Add test to check for key transformation

* Allow additional fields on metadata

* Delete transform
2023-08-03 10:56:13 -07:00
Ben Church
e9490e3fb6 Connector Levels: Add new internal metadata fields (#28904)
* Add airbyte internal

* Add tests

* First pass

* Set destinations to same levels as sources

* Best guess at missing statuses

* Best guess at _ql

* Add separate enum class

* Fix support level name

* Update templates

* Add one more test
2023-08-01 18:08:33 -05:00
Ben Church
1dabc6208e Metadata: add tags field (#26320)
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-05-26 16:13:09 -07:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254)
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084)
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2023-02-24 16:13:42 -05:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850)
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
2023-01-03 15:55:36 -08:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Marcos Marx
8bbe9939f6 run gradlew format (#14721) 2022-07-14 15:17:12 -03:00
wjwatkinson
19df797ac0 New Source: Kyriba (#12748)
* remove redundant error status retry logic

* added kyriba source

* implemented account incremental sync

* remove unnecessary scheams and rename accounts

* added cash flows

* allow for different kyriba domains

* added account balances

* added bank balances and intraday streams

* refactored with account sub stream class

* airbyte cannot accomodate nested incremental date fields

* fix nested date fields in schema

* fix cash flow schema and logic

* specify max retries

* change 401 status code, so it gets retried

* moved to requests native auth

* compare tokens

* update request auth on 401

* set request auth header on 401

* increase cash flow page size to 1000

* add retries to login

* only sync cash balances yesterday and earlier

* corrected account schema

* increased max retries

* create uuid for eod bank balances

* add standard cash balance sync

* add standard bank balance sync

* fixed cash flow schema

* full refresh cash balances to enable proper ELT

* full refresh bank balances to enable proper ELT

* add end date

* fix formatting None end date

* don't require end_date in regex

* fixed cash balance range increment

* added unit tests

* added tests updated update date time parameter formatting

* added unit tests

* removed modification

* formatted

* fix integration tests

* fix test connection integration test

* added lastKnownBalanceDate

* produce STATE with abnormal future state

* formatted

* added source kyriba

* added kyriba build

* removed unnecessary files

* address PR comments to improve code

* make api version name consistent

* decrease size of cash flow slices

* improve cash flow sync performance with 1 day stream slices

* reduce number of retries as slices checkpoint state

* currently only one version of the API

* fixed pr link

* fixed static code check issues

* added source kyriba

* correct doc

* remove redundant error status retry logic

* added kyriba source

* implemented account incremental sync

* remove unnecessary scheams and rename accounts

* added cash flows

* added account balances

* added bank balances and intraday streams

* airbyte cannot accomodate nested incremental date fields

* fix cash flow schema and logic

* specify max retries

* change 401 status code, so it gets retried

* compare tokens

* set request auth header on 401

* add retries to login

* increased max retries

* create uuid for eod bank balances

* add standard cash balance sync

* add standard bank balance sync

* fixed cash flow schema

* full refresh cash balances to enable proper ELT

* full refresh bank balances to enable proper ELT

* added unit tests

* added tests updated update date time parameter formatting

* removed modification

* formatted

* fix integration tests

* fix test connection integration test

* added source kyriba

* removed unnecessary files

* address PR comments to improve code

* currently only one version of the API

* fixed static code check issues

* correct mypy checks

* auto-bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-07-13 11:11:07 -03:00