1
0
mirror of synced 2025-12-23 11:57:55 -05:00
Commit Graph

140 Commits

Author SHA1 Message Date
Harshith Mullapudi
0e5f1a8c21 Publish source shopify: added shop_url to all stream records (#9635)
* add shop url in shopify orders stream

* Add shop url in all streams

* Fix: add shop url in customers schema

* chore: bump version

* chore: added spec

Co-authored-by: Manoj <saimanoj58@gmail.com>
2022-01-20 23:30:54 +05:30
Baz
8b149e8566 🎉 Source Shopify: implement Oauth2.0 for Airbyte-Cloud (#9591) 2022-01-19 22:53:57 +02:00
Iryna Grankova
985e10f05f Update fields in source-connectors specifications: shopify (#9049)
* Files title/description update for issue # 8915

* Version update for issue # 8915

* Changelogs update for PR #9049

* Files title/description update for issue # 8915

* bump version

Co-authored-by: alvova <annalvova05@gmail.com>
2021-12-28 14:28:01 +02:00
Baz
fb834c9758 🐛 Source Shopify: fix for mismatched number of tables during normalization (#8597) 2021-12-16 17:50:01 +02:00
Ciaran O'Brien
cbe01e9fbe Source Shopify: Add Shop stream (#8297)
* Shop resource

* Dockerfile version and shopify.md

* added PR link to shopify.md

* PR review changes

* version bump to 0.1.25

* change type

* change data type shop stream

* bump version

* run seed file

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-12-08 00:28:49 -03:00
Baz
a55ef51f48 Source Shopify: fix for missing properties & items in schemas (#7783) 2021-11-30 18:02:06 +02:00
Marcos Marx
6787777497 Publish PR 7973: shopify new stream add items (#8320)
* Adds Inventory Items to the source-shopify connector

* fix: rather use updated_at as cursor

* docs: updates the shopify readme changelog

* fix: use Products parent stream to get the inventory item ids

fix: parse response as json object not array

* feat: get inventory items in 1 batch per Product

* fix: remove cusor_field property - already defined in parent

* other: bump shopify source version number anywhere I could find

* correct ci failure

Co-authored-by: Jonathan Irwin <jonoirwinrsa@gmail.com>
2021-11-30 00:00:49 -03:00
Yuhui Shi
9791a14dda 🎉 Source Shopify: Add FulfillmentOrders and Fulfillments streams (#7107)
* Add FulfillmentOrder stream

* Add fulfillments stream

* Fix schema validation error

* Bump docker version and update doc

* Apply gradlew format

* Fix source_definition

* Fix doc after rebase

* Fix format after rebase

* Remove enum type in schemas

* bump version

* run seed config again

Co-authored-by: Marcos Marx <marcosmarxm@gmail.com>
2021-11-05 20:53:57 -03:00
Harshith Mullapudi
e479388de9 Harshith/test pr 7063 (#7382)
* Add location stream to Shopify connector

Add intentory level stream

Apply formatting

* Update doc and version configs

* Update version

* Format after rebasing

* Address review comments

* fix: location stream has no data with the current cred

* Add location stream to Shopify connector

Add intentory level stream

Apply formatting

* Update doc and version configs

* Update version

* Format after rebasing

* Address review comments

* fix: location stream has no data with the current cred

* fix: integration test

* fix: integrationtests

* fix: integrationtests

* Fixed primary key for inventory levels stream

Co-authored-by: Yuhui Shi <yuhui@convect.ai>
2021-10-27 11:35:38 +05:30
Samy Pessé
d365f85654 Fix invalid YAML frontmatter (#7088) 2021-10-15 21:25:58 -03:00
Baz
cfae84cbb0 🎉 Source Shopify: support oauth flow (#6951) 2021-10-14 22:37:30 +03:00
Abhi Vaidyanatha
08afd9eea0 Add meta description to Shopify source page. (#7017) 2021-10-13 12:12:41 -07:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Abhi Vaidyanatha
fa871f7300 Add Troubleshooting for Shopify (#6853) 2021-10-06 17:46:12 -07:00
Baz
023a9ba979 📝 🎉 Source Shopify: added the pre_tax_price to orders/line_items schema, update stream_slices logic (#6056)
* added pre_tax_price property to the orders/line_items schema
* update `stream_slices` logic
* added changelog

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-09-21 16:30:36 +03:00
vitaliizazmic
e04623fdfc 🎉 Source Shopify: convert prices into numbers
* Source Shopify #4841 - update schemas, transform root properties

* Source Shopify #4841 - transform nested properties

* Source Shopify #4841 - ignore transforming for null values

* Source Shopify #4841 - improving according to PR review

* Source Shopify #4841 - create transformer

* Source Shopify #4841 - reformat

* Source Shopify #4841 - reformat(fix)

* Source Shopify #4841 - improving extracting schemas type

* Source Shopify #4841 - unit tests for transform solution

* Source Shopify #4841 - reformat

* Source Shopify - fix according to review

* Source Shopify - fix DRY

* Source Shopify - fix orders schema (add type)

* Source Shopify - fixing according to PR review

* Source Shopify - bump version

* Source Shopify - update changelogs
2021-09-17 18:04:22 +03:00
Baz
51e27184e8 🐛 Source Shopify: fix the connector's performance for incremental refresh (#5945)
* Added ability to run the incremental sync within slicing, by leveraging the cached_state 

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-09-13 18:00:24 +03:00
Baz
1861fb0eb3 🐛 Source Shopify: fix for incorrect amount type in order_refunds schema (#5853)
* edited order_refunds schema, corrected acceptance-test-config.yml
* bumped version
* added changelog

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-09-06 12:34:16 +03:00
Baz
9c05308d1f 🐛 Source Shopify: Fixed line_items/discount allocations & duties parts of orders schema (#5801)
* edited orders schema
* added changelog
* formated

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-09-02 13:58:47 +03:00
Baz
f76a135934 🐛 Source Shopify: Fixed rate limits throttling (#5470)
#5416 - source shopify: confusing error message when rate limit is hit
#5441 - Shopify Connector Rate Limiting
PR: #5470 - https://github.com/airbytehq/airbyte/pull/5470

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-08-24 14:39:06 +03:00
Rodrigo Parra
08626bc0dd 🎉 Source Shopify: Add status property to Products stream (#5276)
Contributor's PR, additional checks are in: https://github.com/airbytehq/airbyte/pull/5286

Co-authored-by: Oleksandr <oleksandr.bazarnov@globallogic.com>
2021-08-10 00:20:31 +03:00
LiRen Tu
2906ec287a CI: Add action to check broken doc links (#5254)
* Add action to check broken doc links

* Ignore localhost

* Update config

* Fix broken links

* Use quiet mode

* Ignore PR link

* Fix more broken links

* Fix more broken links

* Fix more broken links

* Verify pattern

* Fix more broken links

* Separate full and pr check

* Update pattern

* Test invalid link

* Remove invalid link
2021-08-07 14:28:02 -07:00
Oleksandr
34317cdfb1 🐛 Source Shopify: fix the products schema according to API 2021-07 (#4943)
#4927 - Shopify integration schema discrepancy (products.json)

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-07-25 00:12:08 +03:00
Oleksandr
84aad359aa 📚 Source Shopify: migrate to new sandbox, update API version to 2021-07 (#4830)
(#4830) Source Shopify: migrate to new sandbox, update API version to 2021-07

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-07-19 19:57:11 +03:00
Oleksandr
9517fae702 🎉 Source Shopify - change the default stream cursor_field to 'updated_at' where possible (#4472)
#4472 - Source Shopify - change the default stream cursor_field to 'updated_at' where possible

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-07-05 15:42:35 +03:00
Sherif A. Nada
9079cbdf78 Publish PR (#4121) (#4495)
Co-authored-by: Rodrigo Parra <rodpar07@gmail.com>
2021-07-02 13:34:57 -07:00
Rodrigo Parra
4b0c3494ae 🎉 Source Shopify: Add support for draft orders (#4121) 2021-07-02 13:33:47 -07:00
Oleksandr
0e0d0a102e 🐛 Bugfix for pagination in Shopify Source Connector #4284 (#4290)
#4284 - Bugfix for pagination in Shopify Source Connector

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-06-25 19:45:45 +03:00
Sherif A. Nada
c130465048 Release Shopify source 0.1.6 (#4332) 2021-06-24 16:39:35 -07:00
jacqueskpoty
e01576d461 🎉 Source Shopify: add pages, price rules and discount codes streams (#4009)
Co-authored-by: jsewawilson <jwilson@pebblepost.com>
2021-06-24 16:18:15 -07:00
Marcos Marx
88d7953a18 Add CHANGELOG for Sources (#4215)
* add changelog for postres source

* add changelog for mysql source

* add changelog for mssql source

* add changelog for file source

* add changelog for google sheets

* add full changelog for file source

* add full changelog for google sheet source

* add full changelog for mssql source

* add changelog for http requests

* add changelog for salesforce source

* add changelog for facebook marketing source

* add changelog for google analytics source

* add changelog for shopify native source connector
2021-06-18 17:45:09 -03:00
Oleksandr
01dc7bbde9 🎉 Add Airbyte-native shopify connector (replaces Singer-based) (#3787)
* first commit

* Delete source copy.py

File doesn't need

* IAdded Incremental Refresh + stream_slice for Refunds, Transactions

* small changes to source.py

* fixed Incremental Refresh

* Fixed acceptence-tests

* Edited no-refunds-catalog for acceptence-tests

* changed the state

* Commit for Review

* removed spaces

* added parameter to orders stream to read all the records by default

* added parameter to abandoned_checkouts stream to read all the records by default

* minor fix

* minor fix

* changed authentication method from basic http > header based auth, removed usage of api_key

* reformated source.py

* improved source.py, removed dependencies block from build.gradle

* removed unneeded dependencies + formated source.py

* changed Shopify in source_definitions.yaml from singer-based to cdk version, changed years in the documents

* added source_definition for source-shopify cdk json file

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* Add files via upload

* added secret credentials for source-shopify

* Delete 9da77001-af33-4bcd-be46-6252bf9342b9.json

* re-added source_definition file

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* re-added source definition

* Delete airbyte-config/init/bin/main/config/STANDARD_SOURCE_DEFINITION directory

* edit source definitions

* source definition change: removed icon block

* ...

* changed source_definition.json

* changed source_definition.json

* Added ability to specify the start_date of data replica.

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed docker version to 0.1.1 - bumped version on image, aedited request_params for metafields

* changed collects to full_refresh by default

* changed collects to full_refresh by default

* Delete airbyte-config/.settings directory

* Delete .classpath

* Delete .project

* Delete .project

* Delete .classpath

* Delete airbyte-config/init/.settings directory

* Delete airbyte-config/init/bin directory

* Delete airbyte-config/models/.settings directory

* Delete airbyte-config/models/bin directory

* Delete .classpath

* Delete .project

* Delete airbyte-config/persistence/.settings directory

* Delete airbyte-config/persistence/bin directory

* Delete .classpath

* Delete .project

* changed python to python3 in README.md

* small changes to code source.py, bump the version, edited .gitignore

* edited spec.json with pattern for start_date

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
2021-06-08 12:46:35 +03:00
Marcos Marx
7c70eb02cd GitBook: [master] 84 pages and 72 assets modified 2021-05-03 12:14:16 +00:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990)
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
2021-04-21 11:35:08 +08:00
John Lafleur
2acc3840d0 GitBook: [docs_feature_incremental] 33 pages modified (#1683)
Co-authored-by: John Lafleur <john@dataline.io>
2021-01-17 07:32:24 +11:00
John Lafleur
5532aa370a Updating Incremental within docs pages for all sources to make it more explicit (#1381)
* GitBook: [incremental_update_docs] 79 pages modified

* GitBook: [incremental_update_docs] one page modified

Co-authored-by: John Lafleur <john@dataline.io>
2020-12-18 21:03:34 +11:00
Shrif Nada
b8f2b33dfa GitBook: [master] 10 pages modified 2020-12-18 00:49:56 +00:00
Shrif Nada
1fb29d88a0 GitBook: [master] 8 pages and 21 assets modified 2020-11-12 19:17:40 +00:00
John Lafleur
25557d216e Add Shopify to changelogs (#917) 2020-11-11 14:26:42 -08:00
Jared Rhizor
dde61db796 add shopify integration (#861)
* shopify integration

* fix for spotless

* gcc

* get syncs working

* don't include pii in replication for testing

* add documetation about private app api keys

* switch to api password

* fix credential checking

* remove unused gitignore

* finish configuring standard test

* remove orders from integration test catalog

* Update airbyte-integrations/connectors/source-shopify-singer/setup.py

Co-authored-by: Charles <giardina.charles@gmail.com>

* add secret for CI

* allow py files to start with def to fix generated test case

* fmt

* add gcc to test image

* limit catalog for faster tests

* fmt

Co-authored-by: Charles <giardina.charles@gmail.com>
2020-11-10 15:49:52 -08:00