jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2026-01-05 12:05:28 -05:00
Code Issues Packages Projects Releases Wiki Activity
8,635 Commits 5,148 Branches 518 Tags
b4dfbdb67006d028c8fdbe0dfd2305273fa6df0d
Commit Graph

54 Commits

Author SHA1 Message Date
Baz
5e302e0a8a 🎉 Source Shopify: update API version to 2022-10 (#18298) 2022-10-24 15:23:15 +03:00
Artem Inzhyyants
fc8be13d33 🎉 Source Shopify: Add metafield streams (#17962) 
* 🎉 Source Shopify: Add metafield streams

* Source Shopify: fix unittest

* Source Shopify: docs update

* Source Shopify: fix backward compatibility test

* Source Shopify: fix schemas

* Source Shopify: fix state filter

* Source Shopify: refactor & optimize

* Source Shopify: fix test privileges

* Source Shopify: fix stream filter

* Source Shopify: fix streams

* Source Shopify: update abnormal state

* Source Shopify: fix abnormal state streams

* Source Shopify: fix streams

* updated methods, formated code

* Source Shopify: typo fix

* auto-bump connector version

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-10-17 23:01:10 +02:00
Baz
c04d317e45 🐛 Source Shopify: fix 404 for configured streams, fix missing cursor error for old records (#17777) 2022-10-12 15:16:09 +03:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) 
This reverts commit a2c194a11f.
 2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369) 
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
 2022-07-08 14:18:27 -05:00
Tomas Perez Alvarez
5689483bfe doc: fix small typo on Shopify documentation (#13992) 2022-06-22 17:58:07 +02:00
Sherif A. Nada
b8e147538c Update various connector input configs & docs copy (#12500) 2022-05-04 23:37:10 -07:00
Harshith Mullapudi
9508f611fb 🎉 Source Shopify: implement BalanceTransactions stream (#10204) 2022-03-22 21:24:24 +02:00
Baz
0c064f1fbe 🐛 Source Shopify: Improve SubStream state handling (#10915) 2022-03-09 15:24:21 +02:00
Baz
21a88446dd 🐛 Source Shopify: Minor specification re-order, fixed links in documentation (#10794) 2022-03-04 19:26:21 +02:00
Philippe Boyd
10f17ef38b 🐛 Source Shopify: fix wrong field type for tax_exemptions (#10419) 
* fix(shopify): wrong type for tax_exemptions

abandoned_checkouts customer tax_exemptions had the wrong field type

* fix(shopify): wrong type for tax_exemptions

abandoned_checkouts customer tax_exemptions had the wrong field type

* bump connector version

Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
 2022-02-23 14:38:30 -03:00
Baz
67b7fc96ad 🎉 Source Shopify: add tender_transactions stream (#10449) 2022-02-21 20:22:02 +02:00
Baz
26934802a0 🐛 Source Shopify: fixed compatibility issues for legacy user config (#10175) 2022-02-08 16:37:28 +02:00
Serhii Lazebnyi
d76fe1eb21 🎉 Source Shopify: Add privileges validation (#9648) 
* Add handling of scroll param when it expired

* Updated PR number

* Fix typo in docs

* Add unittest

* Updated scroll or standard switch mechanism

* Updated to linters

* Updated spec.yaml and defenitions

* Added privileges validation

* Updated to linter

* Updated PR number

* Updated to review

* Bumped docker version

* Bumped seed version
 2022-01-24 21:52:52 +02:00
Harshith Mullapudi
0e5f1a8c21 Publish source shopify: added shop_url to all stream records (#9635) 
* add shop url in shopify orders stream

* Add shop url in all streams

* Fix: add shop url in customers schema

* chore: bump version

* chore: added spec

Co-authored-by: Manoj <saimanoj58@gmail.com>
 2022-01-20 23:30:54 +05:30
Baz
8b149e8566 🎉 Source Shopify: implement Oauth2.0 for Airbyte-Cloud (#9591) 2022-01-19 22:53:57 +02:00
Iryna Grankova
985e10f05f Update fields in source-connectors specifications: shopify (#9049) 
* Files title/description update for issue # 8915

* Version update for issue # 8915

* Changelogs update for PR #9049

* Files title/description update for issue # 8915

* bump version

Co-authored-by: alvova <annalvova05@gmail.com>
 2021-12-28 14:28:01 +02:00
Baz
fb834c9758 🐛 Source Shopify: fix for mismatched number of tables during normalization (#8597) 2021-12-16 17:50:01 +02:00
Ciaran O'Brien
cbe01e9fbe Source Shopify: Add Shop stream (#8297) 
* Shop resource

* Dockerfile version and shopify.md

* added PR link to shopify.md

* PR review changes

* version bump to 0.1.25

* change type

* change data type shop stream

* bump version

* run seed file

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2021-12-08 00:28:49 -03:00
Baz
a55ef51f48 Source Shopify: fix for missing properties & items in schemas (#7783) 2021-11-30 18:02:06 +02:00
Marcos Marx
6787777497 Publish PR 7973: shopify new stream add items (#8320) 
* Adds Inventory Items to the source-shopify connector

* fix: rather use updated_at as cursor

* docs: updates the shopify readme changelog

* fix: use Products parent stream to get the inventory item ids

fix: parse response as json object not array

* feat: get inventory items in 1 batch per Product

* fix: remove cusor_field property - already defined in parent

* other: bump shopify source version number anywhere I could find

* correct ci failure

Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
 2021-11-30 00:00:49 -03:00
Yuhui Shi
9791a14dda 🎉 Source Shopify: Add FulfillmentOrders and Fulfillments streams (#7107) 
* Add FulfillmentOrder stream

* Add fulfillments stream

* Fix schema validation error

* Bump docker version and update doc

* Apply gradlew format

* Fix source_definition

* Fix doc after rebase

* Fix format after rebase

* Remove enum type in schemas

* bump version

* run seed config again

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
 2021-11-05 20:53:57 -03:00
Harshith Mullapudi
e479388de9 Harshith/test pr 7063 (#7382) 
* Add location stream to Shopify connector

Add intentory level stream

Apply formatting

* Update doc and version configs

* Update version

* Format after rebasing

* Address review comments

* fix: location stream has no data with the current cred

* Add location stream to Shopify connector

Add intentory level stream

Apply formatting

* Update doc and version configs

* Update version

* Format after rebasing

* Address review comments

* fix: location stream has no data with the current cred

* fix: integration test

* fix: integrationtests

* fix: integrationtests

* Fixed primary key for inventory levels stream

Co-authored-by: Yuhui Shi <yuhui@convect.ai>
 2021-10-27 11:35:38 +05:30
Samy Pessé
d365f85654 Fix invalid YAML frontmatter (#7088) 2021-10-15 21:25:58 -03:00
Baz
cfae84cbb0 🎉 Source Shopify: support oauth flow (#6951) 2021-10-14 22:37:30 +03:00
Abhi Vaidyanatha
08afd9eea0 Add meta description to Shopify source page. (#7017) 2021-10-13 12:12:41 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
fa871f7300 Add Troubleshooting for Shopify (#6853) 2021-10-06 17:46:12 -07:00
Baz
023a9ba979 📝 🎉 Source Shopify: added the pre_tax_price to orders/line_items schema, update stream_slices logic (#6056) 
* added pre_tax_price property to the orders/line_items schema
* update `stream_slices` logic
* added changelog

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-09-21 16:30:36 +03:00
vitaliizazmic
e04623fdfc 🎉 Source Shopify: convert prices into numbers 
* Source Shopify #4841 - update schemas, transform root properties

* Source Shopify #4841 - transform nested properties

* Source Shopify #4841 - ignore transforming for null values

* Source Shopify #4841 - improving according to PR review

* Source Shopify #4841 - create transformer

* Source Shopify #4841 - reformat

* Source Shopify #4841 - reformat(fix)

* Source Shopify #4841 - improving extracting schemas type

* Source Shopify #4841 - unit tests for transform solution

* Source Shopify #4841 - reformat

* Source Shopify - fix according to review

* Source Shopify - fix DRY

* Source Shopify - fix orders schema (add type)

* Source Shopify - fixing according to PR review

* Source Shopify - bump version

* Source Shopify - update changelogs
 2021-09-17 18:04:22 +03:00
Baz
51e27184e8 🐛 Source Shopify: fix the connector's performance for incremental refresh (#5945) 
* Added ability to run the incremental sync within slicing, by leveraging the cached_state 

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-09-13 18:00:24 +03:00
Baz
1861fb0eb3 🐛 Source Shopify: fix for incorrect amount type in order_refunds schema (#5853) 
* edited order_refunds schema, corrected acceptance-test-config.yml
* bumped version
* added changelog

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-09-06 12:34:16 +03:00
Baz
9c05308d1f 🐛 Source Shopify: Fixed line_items/discount allocations & duties parts of orders schema (#5801) 
* edited orders schema
* added changelog
* formated

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-09-02 13:58:47 +03:00
Baz
f76a135934 🐛 Source Shopify: Fixed rate limits throttling (#5470) 
#5416 - source shopify: confusing error message when rate limit is hit
#5441 - Shopify Connector Rate Limiting
PR: #5470 - https://github.com/airbytehq/airbyte/pull/5470

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-08-24 14:39:06 +03:00
Rodrigo Parra
08626bc0dd 🎉 Source Shopify: Add status property to Products stream (#5276) 
Contributor's PR, additional checks are in: https://github.com/airbytehq/airbyte/pull/5286

Co-authored-by: Oleksandr <oleksandr.bazarnov@globallogic.com>
 2021-08-10 00:20:31 +03:00
LiRen Tu
2906ec287a CI: Add action to check broken doc links (#5254) 
* Add action to check broken doc links

* Ignore localhost

* Update config

* Fix broken links

* Use quiet mode

* Ignore PR link

* Fix more broken links

* Fix more broken links

* Fix more broken links

* Verify pattern

* Fix more broken links

* Separate full and pr check

* Update pattern

* Test invalid link

* Remove invalid link
 2021-08-07 14:28:02 -07:00
Oleksandr
34317cdfb1 🐛 Source Shopify: fix the products schema according to API 2021-07 (#4943) 
#4927 - Shopify integration schema discrepancy (products.json)

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-07-25 00:12:08 +03:00
Oleksandr
84aad359aa 📚 Source Shopify: migrate to new sandbox, update API version to 2021-07 (#4830) 
(#4830) Source Shopify: migrate to new sandbox, update API version to 2021-07

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-07-19 19:57:11 +03:00
Oleksandr
9517fae702 🎉 Source Shopify - change the default stream cursor_field to 'updated_at' where possible (#4472) 
#4472 - Source Shopify - change the default stream cursor_field to 'updated_at' where possible

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-07-05 15:42:35 +03:00
Sherif A. Nada
9079cbdf78 Publish PR (#4121) (#4495) 
Co-authored-by: Rodrigo Parra <rodpar07@gmail.com>
 2021-07-02 13:34:57 -07:00
Rodrigo Parra
4b0c3494ae 🎉 Source Shopify: Add support for draft orders (#4121) 2021-07-02 13:33:47 -07:00
Oleksandr
0e0d0a102e 🐛 Bugfix for pagination in Shopify Source Connector #4284 (#4290) 
#4284 - Bugfix for pagination in Shopify Source Connector

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-06-25 19:45:45 +03:00
Sherif A. Nada
c130465048 Release Shopify source 0.1.6 (#4332) 2021-06-24 16:39:35 -07:00
jacqueskpoty
e01576d461 🎉 Source Shopify: add pages, price rules and discount codes streams (#4009) 
Co-authored-by: jsewawilson <jwilson@pebblepost.com>
 2021-06-24 16:18:15 -07:00
Marcos Marx
88d7953a18 Add CHANGELOG for Sources (#4215) 
* add changelog for postres source

* add changelog for mysql source

* add changelog for mssql source

* add changelog for file source

* add changelog for google sheets

* add full changelog for file source

* add full changelog for google sheet source

* add full changelog for mssql source

* add changelog for http requests

* add changelog for salesforce source

* add changelog for facebook marketing source

* add changelog for google analytics source

* add changelog for shopify native source connector
 2021-06-18 17:45:09 -03:00
Oleksandr
01dc7bbde9 🎉 Add Airbyte-native shopify connector (replaces Singer-based) (#3787) 
* first commit

* Delete source copy.py

File doesn't need

* IAdded Incremental Refresh + stream_slice for Refunds, Transactions

* small changes to source.py

* fixed Incremental Refresh

* Fixed acceptence-tests

* Edited no-refunds-catalog for acceptence-tests

* changed the state

* Commit for Review

* removed spaces

* added parameter to orders stream to read all the records by default

* added parameter to abandoned_checkouts stream to read all the records by default

* minor fix

* minor fix

* changed authentication method from basic http > header based auth, removed usage of api_key

* reformated source.py

* improved source.py, removed dependencies block from build.gradle

* removed unneeded dependencies + formated source.py

* changed Shopify in source_definitions.yaml from singer-based to cdk version, changed years in the documents

* added source_definition for source-shopify cdk json file

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* Add files via upload

* added secret credentials for source-shopify

* Delete 9da77001-af33-4bcd-be46-6252bf9342b9.json

* re-added source_definition file

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* re-added source definition

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* edit source definitions

* source definition change: removed icon block

* ...

* changed source_definition.json

* changed source_definition.json

* Added ability to specify the start_date of data replica.

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed collects to full_refresh by default

* changed collects to full_refresh by default

* Delete airbyte-config/.settings directory

* Delete .classpath

* Delete .project

* Delete .project

* Delete .classpath

* Delete airbyte-config/init/.settings directory

* Delete airbyte-config/init/bin directory

* Delete airbyte-config/models/.settings directory

* Delete airbyte-config/models/bin directory

* Delete .classpath

* Delete .project

* Delete airbyte-config/persistence/.settings directory

* Delete airbyte-config/persistence/bin directory

* Delete .classpath

* Delete .project

* changed python to python3 in README.md

* small changes to code source.py, bump the version, edited .gitignore

* edited spec.json with pattern for start_date

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-06-08 12:46:35 +03:00
Marcos Marx
7c70eb02cd GitBook: [master] 84 pages and 72 assets modified 2021-05-03 12:14:16 +00:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990) 
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
 2021-04-21 11:35:08 +08:00
John Lafleur
2acc3840d0 GitBook: [docs_feature_incremental] 33 pages modified (#1683) 
Co-authored-by: John Lafleur <john@dataline.io>
 2021-01-17 07:32:24 +11:00
John Lafleur
5532aa370a Updating Incremental within docs pages for all sources to make it more explicit (#1381) 
* GitBook: [incremental_update_docs] 79 pages modified

* GitBook: [incremental_update_docs] one page modified

Co-authored-by: John Lafleur <john@dataline.io>
 2020-12-18 21:03:34 +11:00