1
0
mirror of synced 2025-12-21 02:51:29 -05:00
Commit Graph

195 Commits

Author SHA1 Message Date
Sherif A. Nada
df47987cd6 📕 source salesforce: fix broken page anchor in spec.json & add guide for adding read only user (#10751) 2022-03-01 10:42:37 -08:00
Sherif A. Nada
9e941f3818 Improve note in salesforce docs about creating a RO user 2022-02-27 20:53:40 -08:00
Sherif A. Nada
5691434073 📖 improve salesforce docs & reorder properties in the spec (#10679) 2022-02-27 20:08:46 -08:00
Maksym Pavlenok
2bba529803 🎉 Source Salesforce: speed up discovery >20x by leveraging parallel API calls (#10516) 2022-02-27 19:03:39 -08:00
Anna Lvova
ce5c007540 🎉 Salesforce Source: Support "Replicate Incremental Deletes" (#10454) 2022-02-21 15:03:50 +02:00
Maksym Pavlenok
5bc8ec205e 🐛 Source salesforce: processing of failed jobs (#10141) 2022-02-10 19:49:08 +02:00
Serhii Chvaliuk
84d7323d43 🐛 Source Salesforce: increase CSV field_size_limit (#10012)
* Increase CSV field_size_limit

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-02-04 21:06:33 +02:00
augan-rymkhan
cb69017ec8 Source Salesforce: finish the sync with success if rate limit is reached (#9499)
* finish the sync with success if rate limit is reached

* todo

* added rate_limit_handler

* added rate_limit_handler decorator

* removed TODO

* deleted rate_limit_hanlder decorator

* unit tests for rate limit is reached

* format code

* bump version

* format code

* updated spec and def yaml

Co-authored-by: auganbay <auganenu@gmail.com>
2022-01-28 11:17:31 +06:00
Serhii Chvaliuk
2629098390 🐛 Source Salesforce: parse CSV with "unix" dialect (#9757)
* improve csv parsing
* test_csv_reader_dialect_unix added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-01-25 19:27:25 +02:00
Iryna Grankova
579923d2f8 Update fields in source-connectors specifications: posthog, recurly, redshift, salesforce, salesloft (#8617)
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
Co-authored-by: Sergey Chvalyuk <grubberr@gmail.com>
2022-01-25 16:14:02 +02:00
Serhii Lazebnyi
0ed20bca61 🐛 Source Salesforce: Fix error during generating schema (#9478)
* Add filtering by queryable flag for available streams

* Updated PR number and version

* add logs for failed bulk jobs

* Added logs for collect stream objects options if code 404

* Fixed unittests

* Fixed integration tests

* Bumped docker version

* Update version in seed

* Update streams.py

* Added logger for print not queriable streams

Co-authored-by: antixar <antixar@gmail.com>
2022-01-24 10:54:24 +02:00
augan-rymkhan
0a3713a5a5 Source Salesforce: Deprecate API Type parameter (#9302)
* use BULK for the first sync, REST for incremental sync

* if stream contains compound data or/and base64 use always REST

* fix get stream state from connector state

* fix integration test

* refactor catalog name

* format code

* refactor unit tests

* refactor unit tests 2

* format code 2

* Set additionalProperties to true not to break test temporarily

* fix unit test and remove unnecessary filtering fields

* bump version

* updated spec and def yaml

Co-authored-by: auganbay <auganenu@gmail.com>
2022-01-19 16:23:54 +06:00
augan-rymkhan
62c433eeb1 Source Salesforce: fix pagination in REST API streams (#9151)
* fix next_page_token

* fix BULK API

* fix BUlk incremental stream

* added unit test and comments

* format code

* bump version

* updated spec and def yaml

Co-authored-by: auganbay <auganenu@gmail.com>
2022-01-18 20:42:21 +06:00
Yevhenii
791f39aee9 🐛 Salesforce Connector: Correcting the presence of an extra 'else' handler in the error handling (#9409)
* Correcting the presence of an extra 'else' handler in the error handling
2022-01-11 12:45:22 +02:00
Yevhenii
b5d24106a3 🐛 Salesforce Connector: handling 400 error, while sobject doesn't support query or queryAll requests (#9386)
* Salesforce Connector: handling 400 error, while sobject doesn't support query or queryAll requests
2022-01-11 12:08:54 +02:00
vitaliizazmic
f466986f34 🎉 Source Salesforce: Support oauth'ing into sandbox environment, switching to advanced_auth (#8797)
* Source Salesforce #7722 - change spec to use advanced_auth

* Source Salesforce #7722 - update oauth flow

* Source Salesforce #7722 - reformat

* Source Salesforce #7722 - fixing get environment in oauth flow

* Source Salesforce #7722 - improve spec

* Source Salesforce #7722 - reformat

* Source Salesforce #7722 - bump version and update docs
2022-01-11 11:36:19 +02:00
Yevhenii
432d9f77ed Source Salesforce: add note about possible to creating custom user for using Airbyte (#9185) 2021-12-29 17:30:48 +02:00
Yevhenii
ea578e8f10 🎉 Source Salesforce: Add the ability to filter streams (#8871)
* Source Salesforce: Add the ability to filter streams (version 0.1.11)
* Source Salesforce: fix examples for new field in specification (version 0.1.12)
2021-12-23 13:54:18 +02:00
Maksym Pavlenok
a4be492111 🐛 Source Salesforce: 400 error for non-queryable streams (#9005) 2021-12-23 02:42:23 +02:00
Serhii Chvaliuk
dfdd2c5fb5 🐛 Source Salesforce: filter 'null' byte(s) in HTTP responses (#8405)
* filter_null_byte added

Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
2021-12-07 19:20:28 +02:00
augan-rymkhan
4e44166d0f Salesforce make start_date optional and change format to YYYY-MM-DD (#8191)
* Make `start_date` optional

* start_date can take format `2021-07-25`

* added title to all spec input properties and changed version in Dockerfile

* added a new item into salesforce.md changelogs

* fixed case when start_date is None

* formatted code

* changed comments in unit test fixtures

* changed spec title fields

* updated source and spec yaml

Co-authored-by: Auganbay <auganenu@gmail.com>
2021-12-03 14:38:47 +06:00
Yevhenii
81d66a6388 Source Salesforce: Handling 400 error when using BULK API (#8206)
* Source Salesforce: Handling 400 error when using BULK API
2021-11-24 15:42:10 +02:00
Maksym Pavlenok
9a3a32711c 🐛 Source salesforce: failed async bulk jobs (#8009)
* update dockerfile

* update version

* update changelogs

* remove test config

* fix after flake8

* bump versio to 0.1.6

* remove secrets from config

* update source specs
2021-11-18 01:45:35 +02:00
Yevhenii
d9135b0f13 🎉 Source Salesforce: Add Transform for output records (#7885)
* Source Salesforce: Add Transform for output records
2021-11-15 15:41:29 +02:00
Yevhenii
3d4f730a9a 🐛 Source Salesforce: Fix types for anyType fields (#7778)
* Fix types for anyType fields
2021-11-09 16:08:37 +02:00
Yevhenii
2efef3c04d 🐛 Source Salesforce: Fix getting anyType fields using BULK API (#7592)
* Source Salesforce: Fix getting anyType fields using BULK API
2021-11-06 00:42:06 +02:00
Abhi Vaidyanatha
ae32ecbb27 GitBook: [master] 186 pages and 77 assets modified 2021-10-08 21:17:47 +00:00
Yevhenii
65d62eb560 🎉 Declare Oauth init parameters for 4 connector (#6438)
* Annotate Oauth init parameters for connectors: Facebook Marketing/Pages, Instagram, Salesforce
2021-09-30 18:29:51 +03:00
Yevhenii
c114ec85dc 🐛 Source Salesforce: fix bug with pagination for BULK API (#6209)
* Source Salesforce: fix bug with pagination for BULK API
2021-09-21 14:48:42 +03:00
Yevhenii
e915448a14 update salesforce docs (#6081) 2021-09-15 16:40:50 +03:00
Yevhenii
fdb4c852a8 🎉 Salesforce Native Connector: init version (#5619)
* Native Salesforce Connector

Co-authored-by: ykurochkin <y.kurochkin@zazmic.com>
2021-09-08 14:00:08 +03:00
vovavovavovavova
3b08175d99 Source salesforce: add configuration values for quota limit (#5100)
* save: exit instead of raised err

* format

* upd type is spec (allow null that is default)

* bump version

* rm default; add title

* upd base-singer (dont raise uninformative json-decode error if no output in stdout

* upd docs
2021-08-03 12:27:23 +03:00
Marcos Marx
6201100e72 Add entrypoint and bump version for remaining connectors. (#4539)
See the PR descriptions for all the connectors published.
2021-07-07 17:37:22 +08:00
Marcos Marx
88d7953a18 Add CHANGELOG for Sources (#4215)
* add changelog for postres source

* add changelog for mysql source

* add changelog for mssql source

* add changelog for file source

* add changelog for google sheets

* add full changelog for file source

* add full changelog for google sheet source

* add full changelog for mssql source

* add changelog for http requests

* add changelog for salesforce source

* add changelog for facebook marketing source

* add changelog for google analytics source

* add changelog for shopify native source connector
2021-06-18 17:45:09 -03:00
Davin Chia
42686add8a Release connectors with namespace change. (#2990)
Release all connectors affected by namespace change. Includes all JDBC sources and destinations.

Also add documentation for normalisation. Prerequisite to actually releasing 0.21.0-alpha.
2021-04-21 11:35:08 +08:00
John Lafleur
2acc3840d0 GitBook: [docs_feature_incremental] 33 pages modified (#1683)
Co-authored-by: John Lafleur <john@dataline.io>
2021-01-17 07:32:24 +11:00
John Lafleur
a293cf19a1 GitBook: [master] 3 pages modified 2021-01-07 02:58:42 +00:00
vitaliizazmic
538f993589 1375 Salesforce incremental sync (#1511) 2021-01-06 15:28:06 -08:00
Shrif Nada
1fb29d88a0 GitBook: [master] 8 pages and 21 assets modified 2020-11-12 19:17:40 +00:00
John Lafleur
25557d216e Add Shopify to changelogs (#917) 2020-11-11 14:26:42 -08:00
John Lafleur
f20e574e8e Update connector changelog and relative links (#903) 2020-11-10 19:26:24 -08:00
Michel Tricot
5ecdfeb012 GitBook: [master] 8 pages and 42 assets modified 2020-11-11 02:46:18 +00:00
Sherif A. Nada
d2517ceef3 add notes to salesforce documentation (#896) 2020-11-10 18:00:52 -08:00
John Lafleur
9a1452e1c2 Restructured the left column of the documentation (#733) 2020-10-29 11:10:20 -07:00
Charles
ef629aabfe salesforce source (#698) 2020-10-26 10:39:04 -07:00