jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-21 11:01:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
41,485 Commits 5,109 Branches 518 Tags
bmoric/schema-mapping-postgres
Commit Graph

195 Commits

Author SHA1 Message Date
Roman Yermilov [GL]
dd607dcdf0 🎉Source Salesforce: add checkpointing (#24888) 
* Source Salesforce: add checkpointing

* Source-Iterable: fix integration tests

* Source Salesforce: fix integration test s;ices

* Source Salesforce: wait for latest record to be accessible

* Source Salesforce: retry for 10 times for everything

* Source Salesforce: refactoring. Add checkpointing for all incremental

* Source Salesforce: small fixes

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-24 15:26:43 +04:00
Roman Yermilov [GL]
0ce5ccbbde Source Salesforce: set default start date (#24660) 
* Source Salesforce: set default start date

* Source Salesforce: bump version

* Source Salesforce: update unittests

* Source Salesforce: fix imports

* Source Salesforce: update documentation and spec

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-04-03 16:17:17 +04:00
Roman Yermilov [GL]
15f3ff6b9d Source Salesforce: handle rate limit for bulk operations (#24690) 
* Source Salesforce: handle rate limit for bulk operations

* Source Salesforce: bump version
 2023-03-31 18:10:47 +04:00
Arsen Losenko
13bdee013b Source Salesforce: update regex pattern, specify format to date-time (#24071) 
* Source Salesforce: remove regex pattern, specify format to date-time

* Update changelog

* Automated Change

* Add updated regex pattern for additional validation

* Automated Change

* auto-bump connector version

---------

Co-authored-by: arsenlosenko <arsenlosenko@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-16 17:38:03 +02:00
Sophia Wiley
76df2f240a Docs: Update broken links (#23940) 
* updated_links_in_docs

* updated more links

* typo

* removed backticks

* deleted links in deploying on cloud and local deployment
 2023-03-13 20:38:25 +01:00
Sophia Wiley
5512befeb1 Docs: updated links from .io to .com (#23652) 
* updated links

* edited contributors link

* deleted line about CDK in docs
 2023-03-06 17:27:55 +01:00
Arsen Losenko
0572e0536f Source Salesforce: Mark datefields in spec as dates (#22891) 
* Source Salesforce: Mark datefields in spec as dates

* Update changelog

* Add allowedHosts

* Update Dockerfile

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-03 21:56:33 +02:00
Denys Davydov
6e985c0765 Source Salesforce: change the sequence of requests (#23610) 
* #1571 source salesforce: change the sequence of requests

* #1571 source Salesforce: format

* #1571 source salesforce: fix endless loop

* #1571 source salesforce: update unit tests

* fix infinite loop for streams with no records and refactor properties into a helper object to organize state

* auto-bump connector version

---------

Co-authored-by: brianjlai <brian.lai@airbyte.io>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-03-03 10:31:57 +02:00
Serhii Chvaliuk
3e9c42c4cd Source Salesforce: turn on default HttpAvailabilityStrategy (#22636) 
Signed-off-by: Serhii Chvaliuk <grubberr@gmail.com>
 2023-02-27 20:52:58 +02:00
Denys Davydov
ca165029a9 Source Salesforce: include primary key in every chunk (#23190) 
* #20703 source salesforce: include primary key in every chunk

* #20703 source salesforce: upd changelog

* #20703 source salesforce: review fix

* auto-bump connector version

* #20703 source salesforce: upd connectors.md

---------

Co-authored-by: Serhii Lazebnyi <53845333+lazebnyi@users.noreply.github.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-02-23 20:17:51 +02:00
Denys Davydov
53a5bd880b Source Salesforce: fix properties chunk length count (#22896) 
* #20703 Source Salesforce: fix properties chunk length count

* #20703 Source Salesforce: upd changelog

* #20703: source salesforce - add allowedHosts

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-02-15 08:26:45 -06:00
Denys Davydov
b9d4f129b8 Source Salesforce: handle too many properties (#22597) 
* #1403 source Salesforce: handle too many properties

* #1403 source Salesforce: update changelog

* #1403 source salesforce: log warning and skip inconsistent records

* #1403 source salesforce: review fixes

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-02-09 15:31:54 +02:00
Denys Davydov
e7d7b23b69 Source Salesforce: drop ActivityMetricRollup stream (#22322) 
* #1330 source salesforce: drop activitymetricrollup stream

* #1330 source salesforce: upd changelog

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-02-08 16:57:47 +02:00
Ella Rohm-Ensing
86c0f664b4 Turn off default httpavailabilitystrategy for source-salesforce (GA) (#22016) 
* Turn off default for source-salesforce (GA)

* Update streams.py

* Update salesforce.md

* Update salesforce.md

* auto-bump connector version

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-28 00:49:20 -05:00
Denys Davydov
4897bbc983 Source Salesforce: remove ActivityMetric stream (#20886) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2023-01-05 15:51:33 +02:00
Artem Inzhyyants
6176ecbb46 Source Salesforce: fix tests (#20927) 
* Source Salesforce: fix tests

* Source Salesforce: update expected records

* Source Salesforce: update expected records

* Source Salesforce: update docs; bump version

* Source Salesforce: update acceptance test reason

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2023-01-04 22:06:18 +01:00
Denys Davydov
8ac5d50293 Source Salesforce: make AccountHistory support BULK API (#19869) 
* #17503 source salesforce: make AccountHistory support BULK API

* #17503 source salesforce: upd changelog

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-29 12:11:56 +02:00
Arnaud Jeannin
0164355635 🎨 Add oss/cloud tags on doc for GA connectors (#19118) 
* feat: add cloud and oss tags

* put headers back

* fix: rm prettier style

* fix: aws styles
 2022-11-17 17:01:20 +01:00
Denys Davydov
217a651663 Source Salesforce: add more unsupported bulk entities, fix fallback to rest (#19286) 
* #985 source salesforce: add more unsupported bulk entities, fix fallback to rest

* #985 source salesforce: upd changelog

* #985 source salesforce - add docstring for a test

* #985 source Salesforce: bump version

* #985 source salesforce: move SATs to high level strictness

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-15 13:40:27 +02:00
Pierre Kerschgens
fae29ee2ab 🐛 Source Salesforce: Use Apparent Encoding (#19294) 
* fix: prefer response body encoding over header encoding

* bump: source-salesforce version

* Update salesforce.md

* auto-bump connector version

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-14 13:42:33 -05:00
Artem Inzhyyants
54218f595b 🐛 Source SalesForce: fix Bulk API unsupported list (#18799) 
* 🐛 Source SalesForce: fix Bulk API unsupported list

* 🐛 Source SalesForce: bump version

* 🐛 Source Facebook Marketing: docs update

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-11-04 12:34:25 +01:00
Serhii Chvaliuk
77223167bd Source Salesforce: add get_error_display_message for ConnectionError (#18753) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-11-01 15:48:04 +02:00
Serhii Chvaliuk
981190a005 🐛 Source Salesforce: make paging work, if cursor_field is not changed inside one page (#17615) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-10-13 09:05:19 +03:00
Augustin
1a36074818 source-salesforce: add EventWhoRelation to UNSUPPORTED_BULK_API_SALESFORCE_OBJECTS (#17778) 2022-10-11 21:08:35 +02:00
Artem Inzhyyants
5edf4ce8a0 🐛 Source Salesforce: filter out objects not supported by the Bulk API (#17453) 
* 🐛 Source Salesforce: filter out objects not supported by the Bulk API

* 🐛 Source Salesforce: Docs update & Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-30 21:30:48 +02:00
Augustin
ff4ea3961a Republish connectors using CDK 0.1.88 to 0.1.89 (#17304) 2022-09-28 18:18:59 +02:00
Denys Davydov
d62f88196f Source Salesforce: perform call to objects list in connection check (#17094) 
* #629 oncall - source salesforce: perform call to objects list in connection check

* source salesforce: upd changelog

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-23 21:57:11 +03:00
Denys Davydov
596a4367af Source salesforce: handle japanese characters (#17001) 
* #454 oncall source salesforce: handle japanese characters

* source salesforce: upd changelog

* source salesforce: flake fix

* #454 source salesforce: adjust public interface to CDK, do not take into account state when choosing the API type

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-09-22 14:27:28 +03:00
Serhii Chvaliuk
aab03770c9 🐛 Source SalesForce: better detect API type (#16086) 
Signed-off-by: Sergey Chvalyuk <grubberr@gmail.com>
 2022-08-31 01:06:26 +03:00
Edward Gao
ab98441488 Source Salesforce: exclude KnowledgeArticleVersion from bulk api (#16119) 
* exclude KnowledgeArticleVersion from bulk api

* version bump + changelog

* add other affected KnowledgeArticle streams

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>

* auto-bump connector version [ci skip]

Co-authored-by: Sherif A. Nada <snadalive@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-29 19:49:59 -07:00
Jagruti Tiwari
8288c16485 fix: replace airbyte oss with airbyte open source (#15885) 
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
 2022-08-24 01:01:53 -03:00
Liren Tu
35b0b1be4b 🐛 Salesforce source: exclude knowledge-article from bulk api (#15901) 
* Exclude KnowledgeArticle from bulk api

* Bump version

* auto-bump connector version [ci skip]

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-08-23 19:49:53 -07:00
Baz
959d862e5b 🐛 Source SalesForce: changed DEFAULT_WAIT_TIMEOUT_SECONDS to 24-hour limit (#15444) 2022-08-10 19:20:22 +03:00
Topher Lubaway
9c6c092a22 Revert "Improving docusaurus sidebar generation (#1927) (#14369)" (#14596) 
This reverts commit a2c194a11f.
 2022-07-11 15:27:14 -05:00
Mykyta Serbynevskiy
a2c194a11f Improving docusaurus sidebar generation (#1927) (#14369) 
* Improving docusaurus sidebar generation (#1927)

* Added "Career & open positions" folder to sidebar, adjusted "Project overview" folder

* Deleted "career-and-open-positions" folder from sidebar
 2022-07-08 14:18:27 -05:00
Amruta Ranade
d4071a0ae5 source-salesforce,source-google-sheet,destination-snowflake: Updated field descriptions(#13729) 2022-07-07 15:55:52 +02:00
Amruta Ranade
c42576440d Update salesforce.md 
Fixed broken link
 2022-06-21 10:55:40 -04:00
Marcos Marx
669e6ed39d Source Salesforce: fix sync capped streams with more records than page size (#13658) 
* change logic for counting records

* update doc

* correct unit test

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-06-14 09:08:38 -03:00
Amruta Ranade
7ecfa13ee0 Updated BigQuery, Google Sheets, Facebook Marketing, Salesforce docs (#13717) 
* initial changes

* Edited google Sheets doc

* More edits

* edited the intro and prereqs for BigQuery

* edited the data loading section

* more edits

* Grammatical edits

* Formatting edits
 2022-06-13 14:25:41 -04:00
Pedro S. Lopez
816fece247 bump GA connectors to latest version of python cdk (#12685) 
* bump GA connectors to latest version of python cdk

* update changelogs

* fix changelogs

* more changelog fixes

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-05-06 20:52:59 -04:00
Alexandre Girard
22b67d8528 source salesforce: use utf8 by default and iso as fallback (#12576) 
* use utf8 by default and iso as fallback

* test both

* add comment

* Bump version
 2022-05-04 11:04:18 -07:00
Alexandre Girard
90162b6e76 Encoding is ISO-8859-1 (#12552) 
* Encoding is ISO-8859-1

* rename test

* bump

* auto-bump connector version

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-05-03 19:23:41 -07:00
Brian Lai
bb2da42fde source freshdesk, hubspot, mixpanel, paypal-transaction, salesforce, zendesk-support: adding fixtures to mock time.sleep for connectors that explicitly sleep (#12335) 
* adding fixtures to mock time.sleep for connectors that explicitly sleep

* bump connector versions

* update changelog doc for each connector

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* auto-bump connector version

* remove version bump for freshdesk because connector tests are in a bad state

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
 2022-04-28 12:21:45 -07:00
Baz
644ace4036 🐛 [On call / 171] Source Salesforce: fixed the bug when Bulk fetch took all memory of kube pods (#11692) 2022-04-13 20:35:10 +03:00
Topher Lubaway
17407da1e6 Add docusaurus tool not pipeline logic (#11716) 
* Adds docusaurs tooling

tooling works
broken links still exist

needs the pipeline to work with GH pages
merging sooner means that we won't have forked problems from
the relatively frequently updated docs folder

* Updates readme

* Update docusaurus/README.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update docusaurus/README.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update docusaurus/README.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update docusaurus/README.md

Co-authored-by: Davin Chia <davinchia@gmail.com>

* Update docusaurus/docusaurus.config.js

Co-authored-by: Davin Chia <davinchia@gmail.com>

Co-authored-by: Davin Chia <davinchia@gmail.com>
 2022-04-06 10:32:36 -07:00
Topher Lubaway
03ed894917 Updated GA connector docs and connector (#11640) 
pipeline trigger because gitbook is sad

This reverts commit 230134068f.
 2022-03-31 15:29:34 -05:00
Topher Lubaway
230134068f Revert "Updated GA connector docs and connector " (#11639) 
gitbook pipelines failed.  reverting to trigger gitbook pipeline again
This reverts commit 6aa7e4ce79.
 2022-03-31 15:24:17 -05:00
Amruta Ranade
6aa7e4ce79 Updated GA connector docs and connector stages (#11628) 
* updated GA connector docs and README

* minor edit
 2022-03-31 10:07:03 -04:00
Sherif Nada
ed10c700d6 Fix typo in salesforce docs 2022-03-01 14:57:01 -08:00
Sherif Nada
b3546be317 fix salesforce docs markdown formatting 2022-03-01 14:55:36 -08:00