1
0
mirror of synced 2025-12-20 18:39:31 -05:00
Commit Graph

89 Commits

Author SHA1 Message Date
Augustin
7a63abaf95 🐙 source-convex: run up-to-date pipeline [2024-07-20] (#42224) 2024-07-21 02:25:40 +02:00
Augustin
bff3a6f6d8 🐙 source-convex: run up-to-date pipeline [2024-07-13] (#41868) 2024-07-14 02:20:45 +02:00
Augustin
a6cb3fe8af 🐙 source-convex: run up-to-date pipeline [2024-07-10] (#41584) 2024-07-11 02:16:29 +02:00
Augustin
4358cdcfe1 🐙 source-convex: run up-to-date pipeline [2024-07-09] (#41261) 2024-07-10 02:17:44 +02:00
Augustin
07e58eb2ad 🐙 source-convex: run up-to-date pipeline [2024-07-06] (#40799) 2024-07-07 02:27:16 +02:00
Natik Gadzhi
0ab6314e08 chore: Removes .dockerignore and requirements.txt in connectors (#40217) 2024-07-05 11:46:02 -07:00
Augustin
fe5b073338 🐙 source-convex: run up-to-date pipeline [2024-06-25] (#40305) 2024-06-26 02:29:03 +02:00
Augustin
475f874a08 🐙 source-convex: run up-to-date pipeline [2024-06-22] (#40038) 2024-06-23 02:23:05 +02:00
Augustin
eb9ab87909 source-convex: [autopull] Upgrade base image to v1.2.2 (#39210) 2024-06-06 11:45:36 +02:00
Natik Gadzhi
00002a189c source-convex: [autopull] base image + poetry + up_to_date (#38485)
Co-authored-by: Danylo Jablonski <150933663+DanyloGL@users.noreply.github.com>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
2024-05-30 03:39:32 +02:00
Augustin
31c95da499 [skip ci] Add connectorTestSuitesOptions to metadata (#38188) 2024-05-15 15:04:10 -05:00
Natik Gadzhi
cb80e6922a [tools] prettier rules for .md + formatting cleanup 2024-05-07 08:19:33 -07:00
Augustin
8c862a8013 Fix tags in metadata.yaml files: declare cdk tags (#35670) 2024-03-07 04:32:29 -06:00
Joe Reuter
0f6f25e9e8 Recreate pypi publish batch3 (#34660) 2024-01-30 11:30:48 -06:00
Joe Reuter
d74471eac0 Revert "Publish to pypi batch3 (#34657)" (#34659) 2024-01-30 09:28:42 -06:00
Joe Reuter
bb477eede5 Publish to pypi batch3 (#34657) 2024-01-30 09:06:23 -06:00
Joe Reuter
f29234a2db airbyte-lib: Refactor connectors (#34552) 2024-01-30 03:22:13 -06:00
Lee Danilek
63e96fb8d5 🐛 Source Convex: full_refresh stops after one page (#33431)
Co-authored-by: Serhii Lazebnyi <serhii.lazebnyi@globallogic.com>
2023-12-18 22:27:28 +01:00
Nipunn Koorapati
eb25eac2e5 🚨 Source Convex - switch the JSON format requested from Convex (#30853)
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
2023-11-28 23:04:00 -03:00
Augustin
368ba78b64 🧹doc: update connectors README and remove acceptance-test-docker.sh (#32209) 2023-11-06 12:36:07 -06:00
Marius Posta
7ae97175a6 gradle: fix repo wide behaviour (#30607) 2023-09-28 05:01:13 -07:00
Ben Church
5c56ac1d84 Airbyte-ci: Remove gradle task connectorAcceptanceTest (#30326) 2023-09-19 15:16:37 -05:00
Ben Church
40781313da Update Internal Fields: update ql levels to better resemble previous high strictness (#29450) 2023-08-15 18:03:10 -05:00
Augustin
00d9462216 cat/connectors-ci: replace docker runner with dagger runner in CAT (#28000) 2023-08-11 17:58:48 +02:00
Ben Church
2f7deaee02 [skip ci] Metadata: Remove leading underscore (#29024)
* DNC

* Add test models

* Add model test

* Remove underscore from metadata files

* Regenerate models

* Add test to check for key transformation

* Allow additional fields on metadata

* Delete transform
2023-08-03 10:56:13 -07:00
Ben Church
e9490e3fb6 Connector Levels: Add new internal metadata fields (#28904)
* Add airbyte internal

* Add tests

* First pass

* Set destinations to same levels as sources

* Best guess at missing statuses

* Best guess at _ql

* Add separate enum class

* Fix support level name

* Update templates

* Add one more test
2023-08-01 18:08:33 -05:00
Lee Danilek
77ea559f33 🚨🚨 🐛 Convex source fix skipped records (#27226)
* update cursor in next_page_token, add request_headers

* .

* fix unit tests

* also fix SyncMode.incremental so it doesn't return duplicate records in race conditions

* fix client version in json_schemas

* fix version number

* fix sync_mode

* cache json_schemas to pass typecheck

* never mind

* fix sync_mode

* update metadata and doc

* backward compatiblity bypass

---------

Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2023-06-21 18:18:34 -03:00
Octavia Squidington III
a858d1ee75 🤖 Cloud Availability updater: new connectors to deploy [20230605] (#27002) 2023-06-05 16:13:54 +02:00
Emma Forman Ling
99a6719cb8 🐛 Convex source connector error messages (#23797)
* format errors and add test

* update changelog

* lint

* fix for integration tests

* bump versions

* auto-bump connector version

* bump version

---------

Co-authored-by: Mal Hancock <mallory@archangelic.space>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2023-05-30 16:06:14 -07:00
Ben Church
1dabc6208e Metadata: add tags field (#26320)
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-05-26 16:13:09 -07:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254)
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084)
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2023-02-24 16:13:42 -05:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Evan Tahler
e39e1898c5 Expected Records to .jsonl format (#20850)
* Expected Records to `.jsonl` format

* fix formatting template

* remove endline

* update templates

* Update docs/connector-development/testing-connectors/source-acceptance-tests-reference.md

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>

Co-authored-by: Pedro S. Lopez <pedroslopez@me.com>
2023-01-03 15:55:36 -08:00
Lee Danilek
29d74fc6fd 🎉 New Source: Convex.dev (#18403)
* convex source

* fixed unit tests

* use the smaller test instance

* fix integration tests and pagination

* fix tableName casing in api call

* fix logo

* more shapes -- thinking about moving this to an internal api

* use new /json_schemas api

* use new APIs

* remove unused start_date

* doc skeleton

* fix deletes with incremental sync

* fix test of json_schema

* fix expected records

* merge

* version and docs

* fix test

* fix docs url

* mention that you need to ask convex to enable it for your account

* docs

* two stage pagination for initial sync. some unit tests not working

* fixed all the unit tests, but we need to push backends before acceptance tests work

* fix snapshot pagination

* fix integration tests

* some checkboxes from the PR description

* Update airbyte-integrations/connectors/source-convex/source_convex/source.py

Co-authored-by: Sujay Jayakar <sujayakar314+github@gmail.com>

* Update airbyte-integrations/connectors/source-convex/source_convex/source.py

Co-authored-by: Sujay Jayakar <sujayakar314+github@gmail.com>

* stop storing the delta_has_more in state

* fix mypy

* use UTC timestamps

* rename instance_name to deployment_name

* include data format request param

* remove dev docker image

* fix unit test

* documentation

* .

* code review

* documentation and change deployment_name to deployment_url

* fix pip dependency

* regenerate the spec file

Co-authored-by: Sujay Jayakar <sujayakar314+github@gmail.com>
2022-11-08 20:53:40 -03:00