jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 19:11:14 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,480 Commits 5,109 Branches 518 Tags
yarden/source-mongodb-support-dynamic-arrays
Commit Graph

26035 Commits

Author SHA1 Message Date
Dmytro
5f697ac44a 🐛 Fix okta incremental stream (#5905) 
* Fix okta incremental stream
 2021-09-10 09:02:32 +03:00
Dmytro
2ecc7a6a8d 🎉 Sendgrind add single send stats (#5910) 
* Sendgrind source: add single send stream
 2021-09-09 20:25:03 +03:00
Yaroslav Dudar
70513bcff3 :tada:Source Bing Ads: Add Report streams (#5750) 
added bing ads report streams
 2021-09-09 19:35:32 +03:00
irynakruk
ffecc1c9a2 🎉 New source: MongoDb ported to java (#5530) 
* New abstraction for NoSql database sources

* New MongoDbSource: partial impl

* Added MongoDataType

* Improved MongoDatabase and fixed read method

* code review changes;

* merge clean up;

* Renamed NoSqlDatabase to AbstractDatabase

* formatter changes;

* code review changes: changed mongodb-new to mongodb-v2; left only new connector info in all docs

* code review changes: changed mongodb-new to mongodb-v2; left only new connector info in all docs

* updated spec.json and toDatabaseConfig() method

* updated doc accordingly to spec.json changes

Co-authored-by: Iryna Kruk <iryna.o.kruk@globallogic.com>
 2021-09-09 08:14:16 -04:00
Maksym Pavlenok
984cebe129 🐛 Source Zendesk Support: fix incremental logic for ticket_comments stream (#5787) 
* fix negative backoff

* correct incremental logic for comments

* remove test logs

* bump version

* fix spec

* remove old non-relevant test

* correct backoff default value

* correction a test

* save addl export cursor field

* fix incorrect optinal date-time

* add format date-time again

* correction after review

* fix integration test

* fix unit test

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
 2021-09-09 14:55:39 +03:00
Yevhenii
9b71c28902 🎉 Source Github: add reaction streams (#5860) 
* Source Github: add reaction streams

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-09 13:13:29 +03:00
Serhii Lazebnyi
d7f23f1be6 🐛 Source Intercom: Fix schema ts and array issue (#5908) 
* Fix schema ts and array issue
 2021-09-08 18:59:30 +03:00
Yevhenii
fdb4c852a8 🎉 Salesforce Native Connector: init version (#5619) 
* Native Salesforce Connector

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-08 14:00:08 +03:00
Charles
8ad43afb07 SSH for Postgres Destination (#5743) 
Co-authored-by: George Claireaux <phlair@users.noreply.github.com>
 2021-09-07 17:06:25 -07:00
Yaroslav Dudar
5e3b24ff4e 🐛 Source Hubspot: fix array fields in schema with missed items property (#5834) 
fixed array schemas in companies
 2021-09-07 22:17:03 +03:00
Arthur Galuza
17fd9c7f4f Source Facebook Pages: update documentation (#5876) 
* [WIP] Add basic facebook pages support

* Upd schema

* Hardcode metrics to reduce API call amount

* Refactoring

* Upd test configs

* Add secrets to CI

* Fix typo

* Add a source definition

* fix secrets in CI

* Cleanup with black

* Upd metrics

* Cleanup

* Rm start_date, add test

* Upd schema

* Cleanup

* Upd docs

* Upd docs

Co-authored-by: Eugene Kulak <kulak.eugene@gmail.com>
 2021-09-07 18:09:41 +03:00
Michele Zuccala
fe38f69276 :bug:Source Typeform: add support for multiple choices in responses (#5799) 
* fix(connectors/source-typeform): add support for multiple choices in responses

Co-authored-by: Yaroslav Dudar <flayingfog@gmail.com>
Signed-off-by: Michele Zuccala <michele@zuccala.com>

* upd docs and schema; bump version

* apply format

Co-authored-by: Yaroslav Dudar <flayingfog@gmail.com>
 2021-09-06 14:48:26 -03:00
Baz
1861fb0eb3 🐛 Source Shopify: fix for incorrect amount type in order_refunds schema (#5853) 
* edited order_refunds schema, corrected acceptance-test-config.yml
* bumped version
* added changelog

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-09-06 12:34:16 +03:00
Dmytro
60fd9d5ab9 🐛 Fix hubspot datetime empty string (#5798) 
* Fix hubspot datetime empty string
 2021-09-06 10:11:48 +03:00
Maksym Pavlenok
e5c44e64b1 🎉 Source S3: support of Parquet format (#5305) 
* add parquet parser

* add integration tests for partquet formats

* add unit tests for parquet

* update docs and secrets

* fix incorrect import for tests

* add lib pandas for unit tests

* revert changes of foreign connectors

* update secret settings

* fix config values

* Update airbyte-integrations/connectors/source-s3/source_s3/source_files_abstract/formats/parquet_spec.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* Update airbyte-integrations/connectors/source-s3/source_s3/source_files_abstract/formats/parquet_spec.py

Co-authored-by: George Claireaux <george@claireaux.co.uk>

* remove some unused default options

* update tests

* update docs

* bump its version

* fix expected test

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
Co-authored-by: George Claireaux <george@claireaux.co.uk>
 2021-09-05 02:40:49 +03:00
LiRen Tu
a1de8f2361 Format code and add missing doc links (#5847) 
* Fix format

* Fix documentation links

* Add missing documentation
 2021-09-04 11:17:13 -07:00
Serhii Lazebnyi
898e2c890c 🐛 Source Slack: Fix sync operations hang forever issue (#5830) 
* Add user-defined backoff

* Update airbyte-integrations/connectors/source-slack/source_slack/source.py

* Bumped version

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-09-03 12:19:38 +03:00
Charles
7bf531a967 SSH for Postgres Source (#5742) 2021-09-02 11:32:04 -07:00
Davin Chia
65efaa587a 🎉 Oracle specify schema(s) to discover. (#5779) 
Closes #4944 .
 2021-09-02 23:48:29 +08:00
vovavovavovavova
7216de8b42 Jira structure: back to swagger schemas, but fix incorrect (#5523) 
* revert schemas from response to previous

* fixing: newlines; permission_scheme normalization failure

* add nulls
 2021-09-02 18:22:24 +03:00
Yevhenii
441d7cde76 🐛 Source Github: handling empty repos, check method using RepositoryStats stream (#5788) 
* update error handling for empty repositories, update check method using RepositoryStats stream

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-02 16:31:44 +03:00
vitaliizazmic
d3b2e8a46a 🐛 Source Jira: changed cursor field from created to updated 
* Source Jira #4505 - change cursor field for Issues streams from fields.started to fields.updated, update IssuesWorklogs slicing

* Source Jira #4505 - reformat

* Jira #4505 - made issues worklog stream full refresh

* Jira #4505 - reformat

* Jira #4505 - bump version and updating documentation
 2021-09-02 14:22:40 +03:00
Baz
9c05308d1f 🐛 Source Shopify: Fixed line_items/discount allocations & duties parts of orders schema (#5801) 
* edited orders schema
* added changelog
* formated

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-09-02 13:58:47 +03:00
Yevhenii
d74c47a863 🎉Source GitHub: Add more streams (#5757) 
* Add Organizations stream to Github Source
* Add Repositories stream
* Add Repositories stream spec
* Add Branches stream
* Add Tags stream
* Add ReviewComments stream
* Add users stream
* Add pull request stats stream

Co-authored-by: Chris Wu <chris@faros.ai>
Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
 2021-09-01 15:02:08 +03:00
Serhii Lazebnyi
ff70fd390e 🐛 Source Slack: Fix max retries issue (#5697) 
* Increased max retries to 10

* Add docs

* Increased timeout seconds for acceptance tests

* Fixed for pass tests

* Updated to default backoff

* Add sample config
 2021-08-31 13:43:09 +03:00
vovavovavovavova
90ca4fd686 Source Harvest: upd version and doc (#5749) 
* upd version and doc

* upd dockerfile
 2021-08-31 11:03:21 +03:00
jacqueskpoty
4e8f7af777 🎉 New Source: BigCommerce (#5521) 
Commits
* add new source connector BigCommerce
* all tests passed source-bigcommerce
* Documentation added
* PR number update

Co-authored-by: jsewawilson <jwilson@pebblepost.com>
 2021-08-28 14:38:49 -07:00
Abhi Vaidyanatha
01b905a383 Add note to source-file about changing the parsed data type(s) (#5690) 
Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-27 18:36:49 -07:00
Abhi Vaidyanatha
d63f884e1f Add Bing Ads to connector grading table (#5680) 
* Add Bing ads to connector grading

* Fix short.io title

Co-authored-by: Abhi Vaidyanatha <abhivaidyanatha@Abhis-MacBook-Pro.local>
 2021-08-27 18:35:53 -07:00
oleh.zorenko
61f3963f5e 🐛 Source GitHub: handle negative backoff values (#5696) 
* Handle negative backoff values + update docs

* Bump connector version to `0.1.7`
 2021-08-27 18:41:59 +03:00
haliva-firmbase
82f16382a4 🎉 New Source: Bamboo HR (#5054) 
* add bamboo hr

* Update configs

* Add build status

* Update doc

* Update code

* Fix integration test

Co-authored-by: LiRen Tu <tuliren@gmail.com>
 2021-08-27 03:48:19 -07:00
Marcos Marx
e873129fe4 remove all date-time schemas (#5685) 2021-08-26 21:59:23 -03:00
Marcos Marx
b3c8214b72 Bump version for File connector (#5689) 
* source-file: adding support to XLSB format

* contributor pr + bump connector version

Co-authored-by: Muutech <info@muutech.com>
 2021-08-26 21:25:32 -03:00
Marcos Marx
ceb916d874 Source Pipedrive: correct schema removing timestamp from fields (#5642) 
* update schema

* update docs and bump version

* rollback frontend change
 2021-08-26 14:49:34 -03:00
Maksym Pavlenok
b0be38fc08 🐛 Source Cart: fixing of testing for a lot of data (#5465) 
* add the end_date spec field

* bump version

* Update cart.md

* fix descriptions

* fix descriptions

* handle a data parsing

* correction after merging

* remove end_date from spec

Co-authored-by: Maksym Pavlenok <maksym.pavlenok@globallogic.com>
 2021-08-26 16:28:28 +03:00
Dmytro
3630cdeded 🎉 New Source: Amazon Ads (initial version) (#5023) 
* 3772: Amazon Ads source, initial version


Co-authored-by: Dmytro Rezchykov <dmitry.rezchykov@zazmic.com>
Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-08-26 11:15:38 +03:00
Serhii Lazebnyi
cfb4f422c1 🐛 Source Google Analytics v4: Fix validation of empty custom reports issue (#5655) 2021-08-26 01:07:25 +03:00
Serhii Lazebnyi
2ee462a9a1 🎉 New Source-connector for Google Analytics v4 (#5290) 
* Add Google Analytics v4 implementation

* Add docs and connector index

* Fix a broken link to Airbyte CDK

* Fix a broken link to source acceptance tests docs

* Add condition for a full refresh or incremental stream

* Add unit tests

* Fix formatting to flake8

* Updated to review

* Added logger for custom reports validation

* Add comments to code

* Updated to format
 2021-08-25 17:55:08 +03:00
Serhii Lazebnyi
ce5d8d6758 🎉 New Source: Trello (#5501) 
* Add Trello implementation

* Add doc string to TrelloAuthenticator

* Add spaces to Docker file

* Add rate limit balancer

* Add loger to load balancer
 2021-08-25 14:29:50 +03:00
Baz
f76a135934 🐛 Source Shopify: Fixed rate limits throttling (#5470) 
#5416 - source shopify: confusing error message when rate limit is hit
#5441 - Shopify Connector Rate Limiting
PR: #5470 - https://github.com/airbytehq/airbyte/pull/5470

Co-authored-by: Oleksandr Bazarnov <oleksandr.bazarnov@globallogic.com>
 2021-08-24 14:39:06 +03:00
Marcos Marx
93032a8dcc 🎉 Source Cart.com: add order_items stream (#5582) 
* add order_items stream

* run format

* add order_items in integration_tests
 2021-08-23 23:38:29 -03:00
Damian Legawiec
1954284f6f Update spree-commerce.md (#5572) 2021-08-23 12:31:04 -03:00
Serhii Lazebnyi
61140e4a2e 🐛 Source Intercom: Fixed pagination issue (#5531) 
* Fixed pagination issue
 2021-08-23 11:18:36 +03:00
irynakruk
954d7ccbb2 🐛 Source Postgres: fix CDC OOM issue (#5304) 
* Added functionality for pgoutput plugin

* Updated docs and tests

* refactoring

* bumped version;
fixed test

* updated description;

* bumped version;

Co-authored-by: Iryna Kruk <iryna.o.kruk@globallogic.com>
 2021-08-19 14:49:57 +03:00
Dmytro
5560df7747 Add Braintree source connector (#5362) 
* 5236: Add Braintree source connector

- Add Braintree source connector based on airbyte CDK
- Remove Braintree singer based connector

Co-authored-by: Dmytro Rezchykov <dmitry.rezchykov@zazmic.com>
 2021-08-19 11:49:45 +03:00
Arthur Galuza
000d1a77ff Source Github: bump version, update changelog (#5519) 
* Add multiple token authenticator

* Add MultipleTokenAuthenticator

* Upd docs

* Refactor

* Upd docs

* Fix merge typo

* Upd multiple token support: switch to list of tokens

* Upd multiple token support: refactoring

* Update airbyte-integrations/connectors/source-github/source_github/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Update airbyte-integrations/connectors/source-github/source_github/spec.json

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* Cleanup, switch to MultipleTokenAuthenticator completely

* Upd changelog

* Bump version, upd changelog

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
 2021-08-19 08:58:51 +03:00
Marcos Marx
11bddd1119 Source Google Ads: enable additional params spec.json (#5509) 
* enable additioanl params spec.json

* removed duplicated tests

* add docs

* format keen
 2021-08-19 00:16:07 -03:00
Marcos Marx
8c1a5d57c7 Source Mailchimp: correct output schema to handle date-time values (#5481) 
* correct output schema to handle date-time values

* add docs
 2021-08-18 19:13:50 -03:00
Baz
0f55bf63d5 📝 🎉 Source Dixa: Migrated to CI Sandbox, refactored code structure for future support (#5367) 2021-08-18 21:59:33 +03:00
Marcos Marx
729dacd1d9 Bump Google Ads (connector skip dates) (#5502) 
* Fix issue 5411: Connector skipping dates

* bump version

Co-authored-by: MaxKrog <krog.max@gmail.com>
 2021-08-18 15:23:31 -03:00