1
0
mirror of synced 2026-01-06 06:04:16 -05:00
Commit Graph

77 Commits

Author SHA1 Message Date
Baz
343a45c3b7 🐛 Source Shopify: improve error messages, refactored code (#28700) 2023-07-26 15:44:52 +03:00
Evan Tahler
62d9823cd8 Shopify connector license to Elv2 (#27732)
* Shopify connector license to Elv2

* PR id
2023-06-27 10:59:41 -05:00
Serhii Lazebnyi
d96f6cbcdb Source Shopify: Added new streams (#27315)
* Added new streams

* Delete blocked streams

* Delete unnecessary scopes

* Bump version

* Updated configured catalog

* Fix test_privileges_validation

* Fixed CAT for shopify

* Fix CAT for shopify

* Fix abnormal state

* Firmat code

* Updated doc
2023-06-22 18:13:32 +02:00
Ben Church
1dabc6208e Metadata: add tags field (#26320)
* Add optional tags field

* Remove duplicate icons

* Add programming tags to all

* Update docs

* supportUrl -> documentationUrl

* Ensure one language tag is applied

* Add keyvalue check

* rebase and fix tests

* Format

* Add cache buster

* Improve test

* Automated Commit - Formatting Changes

* Update error

* Fix missing tags

* Fix scaffold

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@sers.noreply.github.com>
Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-05-26 16:13:09 -07:00
Ben Church
248bbf94c1 HACKDAY: Icon CDN (#26158)
* Move icons to connector folder

* Delete old icons

* Update upload logic

* Add icon url to definitions

* Update registry model

* Populate cdn url

* DNC butcher the pipeline

* Low hanging fruit fixes

* Fix bucket name

* Merge old and new approaches

* Fix metadata upload step

* Format

* Fix test
2023-05-24 17:25:41 -07:00
Baz
da60731bda 🐛 Source Shopify: validate shop input (name only, reject urls) (#25961) 2023-05-11 11:11:37 +03:00
Augustin
7310494846 qa-checks: check metadata version matches dockerfile version (#25661) 2023-05-04 16:08:19 -07:00
Baz
26c9ad5062 🐛 Source Shopify: fix None cursor field value, access_scopes keyError issue, JSONDecodeError issue, mark datefields as format of date (#25110) 2023-04-24 23:47:51 +03:00
Ben Church
5563179782 Dagster: rename catalog to registry (#25254)
* rename catalog to registry in metadata service

* rename catalog to registry in metadata files

* Run generate models

* Fix missed renames

* Add github personal access token

* Run black

* Automated Change

---------

Co-authored-by: bnchrch <bnchrch@users.noreply.github.com>
2023-04-18 22:15:11 +02:00
Augustin
ebc907cdf7 create metadata files for all connectors (#24964) 2023-04-13 07:45:04 +02:00
Baz
b7808a3b29 🐛 Source Shopify: fix OOM/memory leak (#23473) 2023-02-27 21:19:44 +02:00
Catherine Noll
7da6a3bb77 Run CATs with local CDK (#23084)
Scripts to 

* Run CATs against the local CDK for one connector

* Run CATs against the local CDK for multiple connectors

* Create a connecter image with the local CDK

---------

Co-authored-by: Alexandre Girard <alexandre@airbyte.io>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
2023-02-24 16:13:42 -05:00
Cole Snodgrass
2e099acc52 update headers from 2022 -> 2023 (#22594)
* It's 2023!

* 2022 -> 2023

---------

Co-authored-by: evantahler <evan@airbyte.io>
2023-02-08 13:01:16 -08:00
Joe Reuter
6a10ae3e05 Rename source acceptance test to connector acceptance test (#21846)
Rename source acceptance test to connector acceptance test
2023-02-02 11:38:19 +01:00
Baz
24285db7bb 🎉 Source Shopify: /publish missing 0.3.1 (#21485) 2023-01-18 15:25:06 +02:00
Baz
5b731d1c8d 🐛 Source Shopify: add discount applications to orders stream (#21461) 2023-01-17 16:49:14 +00:00
Yevhen Sukhomud
2a5d0344e7 Fix formatting (#20570)
* Fix formatting

* try fixing quote escapes?

* unignore sql files

Co-authored-by: Edward Gao <edward.gao@airbyte.io>
2022-12-16 13:43:42 -08:00
Philip Corr
b452d53e97 🎉 Source Shopify: Add a graphql products stream (#19789)
* add graphql stream for shopify products

* Update docs

* add json schema back in

* Fix graphql source tests

* fix: format python files with flake8

* auto-bump connector version

Co-authored-by: Sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-12-04 18:00:56 -05:00
Arsen Losenko
384aabbdf6 Source Shopify: add unit tests (#17944) 2022-10-24 21:41:42 +03:00
Baz
5e302e0a8a 🎉 Source Shopify: update API version to 2022-10 (#18298) 2022-10-24 15:23:15 +03:00
Marcos Marx
70dd9a85cf 🎉 Source Zendesk Chat: engagements data fix infinity looping + gradlew format (#18121)
* fix infinity looping in chats

* added more meaninful to variable name

* bump docker version

* auto-bump connector version

* run format

Co-authored-by: Roberto Bonnet <robertojuarezwp@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-18 15:14:02 -03:00
Artem Inzhyyants
fc8be13d33 🎉 Source Shopify: Add metafield streams (#17962)
* 🎉 Source Shopify: Add metafield streams

* Source Shopify: fix unittest

* Source Shopify: docs update

* Source Shopify: fix backward compatibility test

* Source Shopify: fix schemas

* Source Shopify: fix state filter

* Source Shopify: refactor & optimize

* Source Shopify: fix test privileges

* Source Shopify: fix stream filter

* Source Shopify: fix streams

* Source Shopify: update abnormal state

* Source Shopify: fix abnormal state streams

* Source Shopify: fix streams

* updated methods, formated code

* Source Shopify: typo fix

* auto-bump connector version

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2022-10-17 23:01:10 +02:00
Baz
c04d317e45 🐛 Source Shopify: fix 404 for configured streams, fix missing cursor error for old records (#17777) 2022-10-12 15:16:09 +03:00
Pedro S. Lopez
938436bcc9 update connector specs and definitions with new .com documentation urls (#17585)
* update definitions with new .com docs urls

* update docs urls in specs

* update generators

* regenerate scaffold connectors

* remove unrelated changes

* update more urls

* update specs

* fix tests

* run `:airbyte-config:specs:generateSeedConnectorSpecs` to fix formatting

* revert docs changes to make pr more reviewable

* revert generator readme changes to make more reviewable

* fix mysql strict encrypt expected spec

* fix postgres expected spec
2022-10-11 11:04:23 -04:00
Marcos Marx
dca2256a7c Bump 2022 license version (#13233)
* Bump year in license short to 2022

* remove protocol from cdk
2022-05-26 15:00:42 -03:00
Sherif A. Nada
b8e147538c Update various connector input configs & docs copy (#12500) 2022-05-04 23:37:10 -07:00
Brian Leonard
c302af45ff Upgrade to Python 3.9 (#11763)
* Dockerfile to 3.9

* Python version

* More python updates

* 3.9 on GitHub actions and lint updates

* Test out 3.9.11 on GitHub actions

* install python with an action

* formatting: newline

* Also has python code

* only check first level for changed modules
Previous example (source-google-search-console/credentials)

* Test failure: there is no logger.trace
2022-04-11 20:51:37 -07:00
Christophe Duong
316180c186 format code (#11399) 2022-03-25 09:55:11 +01:00
Harshith Mullapudi
9508f611fb 🎉 Source Shopify: implement BalanceTransactions stream (#10204) 2022-03-22 21:24:24 +02:00
Christophe Duong
744e0d5f13 Refactor Snowflake internal Staging as a base class for other staging classes (#10865)
* Refactor Snowflake internal Staging as model to share staging abilities in jdbc destinations
2022-03-11 15:29:12 +01:00
Baz
0c064f1fbe 🐛 Source Shopify: Improve SubStream state handling (#10915) 2022-03-09 15:24:21 +02:00
Baz
21a88446dd 🐛 Source Shopify: Minor specification re-order, fixed links in documentation (#10794) 2022-03-04 19:26:21 +02:00
Philippe Boyd
10f17ef38b 🐛 Source Shopify: fix wrong field type for tax_exemptions (#10419)
* fix(shopify): wrong type for tax_exemptions

abandoned_checkouts customer tax_exemptions had the wrong field type

* fix(shopify): wrong type for tax_exemptions

abandoned_checkouts customer tax_exemptions had the wrong field type

* bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
2022-02-23 14:38:30 -03:00
Maksym Pavlenok
bbd13802d8 🐛 Fix Python checker configs and Connector Base workflow (#10505) 2022-02-22 19:58:55 +02:00
Baz
67b7fc96ad 🎉 Source Shopify: add tender_transactions stream (#10449) 2022-02-21 20:22:02 +02:00
Baz
26934802a0 🐛 Source Shopify: fixed compatibility issues for legacy user config (#10175) 2022-02-08 16:37:28 +02:00
LiRen Tu
a094142825 Format code (#9892) 2022-01-29 19:56:00 -08:00
Serhii Lazebnyi
d76fe1eb21 🎉 Source Shopify: Add privileges validation (#9648)
* Add handling of scroll param when it expired

* Updated PR number

* Fix typo in docs

* Add unittest

* Updated scroll or standard switch mechanism

* Updated to linters

* Updated spec.yaml and defenitions

* Added privileges validation

* Updated to linter

* Updated PR number

* Updated to review

* Bumped docker version

* Bumped seed version
2022-01-24 21:52:52 +02:00
Harshith Mullapudi
0e5f1a8c21 Publish source shopify: added shop_url to all stream records (#9635)
* add shop url in shopify orders stream

* Add shop url in all streams

* Fix: add shop url in customers schema

* chore: bump version

* chore: added spec

Co-authored-by: Manoj <saimanoj58@gmail.com>
2022-01-20 23:30:54 +05:30
Baz
8b149e8566 🎉 Source Shopify: implement Oauth2.0 for Airbyte-Cloud (#9591) 2022-01-19 22:53:57 +02:00
Iryna Grankova
985e10f05f Update fields in source-connectors specifications: shopify (#9049)
* Files title/description update for issue # 8915

* Version update for issue # 8915

* Changelogs update for PR #9049

* Files title/description update for issue # 8915

* bump version

Co-authored-by: alvova <annalvova05@gmail.com>
2021-12-28 14:28:01 +02:00
Baz
102994541a 🎉 Source Fecebook-Marketing: add asset_feed_spec to ad creatives stream (#8962) 2021-12-21 15:46:52 +02:00
Baz
fb834c9758 🐛 Source Shopify: fix for mismatched number of tables during normalization (#8597) 2021-12-16 17:50:01 +02:00
Ciaran O'Brien
cbe01e9fbe Source Shopify: Add Shop stream (#8297)
* Shop resource

* Dockerfile version and shopify.md

* added PR link to shopify.md

* PR review changes

* version bump to 0.1.25

* change type

* change data type shop stream

* bump version

* run seed file

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-12-08 00:28:49 -03:00
Christophe Duong
b424c1a0e7 🐛 Fix incremental normalization with empty tables (#8394)
* Fix incremental with empty final tables

* upgrade docker images

* Regen SQL

* Bumpversion & format
2021-12-01 23:40:14 +01:00
Baz
a55ef51f48 Source Shopify: fix for missing properties & items in schemas (#7783) 2021-11-30 18:02:06 +02:00
Marcos Marx
6787777497 Publish PR 7973: shopify new stream add items (#8320)
* Adds Inventory Items to the source-shopify connector

* fix: rather use updated_at as cursor

* docs: updates the shopify readme changelog

* fix: use Products parent stream to get the inventory item ids

fix: parse response as json object not array

* feat: get inventory items in 1 batch per Product

* fix: remove cusor_field property - already defined in parent

* other: bump shopify source version number anywhere I could find

* correct ci failure

Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
2021-11-30 00:00:49 -03:00
Christophe Duong
86ca36c5c0 Format code (#7978) 2021-11-15 14:51:10 +01:00
Yuhui Shi
9791a14dda 🎉 Source Shopify: Add FulfillmentOrders and Fulfillments streams (#7107)
* Add FulfillmentOrder stream

* Add fulfillments stream

* Fix schema validation error

* Bump docker version and update doc

* Apply gradlew format

* Fix source_definition

* Fix doc after rebase

* Fix format after rebase

* Remove enum type in schemas

* bump version

* run seed config again

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-05 20:53:57 -03:00
Harshith Mullapudi
e479388de9 Harshith/test pr 7063 (#7382)
* Add location stream to Shopify connector

Add intentory level stream

Apply formatting

* Update doc and version configs

* Update version

* Format after rebasing

* Address review comments

* fix: location stream has no data with the current cred

* Add location stream to Shopify connector

Add intentory level stream

Apply formatting

* Update doc and version configs

* Update version

* Format after rebasing

* Address review comments

* fix: location stream has no data with the current cred

* fix: integration test

* fix: integrationtests

* fix: integrationtests

* Fixed primary key for inventory levels stream

Co-authored-by: Yuhui Shi <yuhui@convect.ai>
2021-10-27 11:35:38 +05:30