jprdonnelly/airbyte
1
0
Fork 0
mirror of synced 2025-12-25 02:09:19 -05:00
Code Issues Packages Projects Releases Wiki Activity

Source Pardot: Fix pagination when >100K records returned (#66592)

Browse Source 
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
This commit is contained in:
Justin Beasley
2025-09-24 13:08:46 -05:00
committed by GitHub
parent 457810290c
commit fa7e42b7f2
3 changed files with 821 additions and 603 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1414
airbyte-integrations/connectors/source-pardot/manifest.yaml
View File

File diff suppressed because it is too large Load Diff

2
airbyte-integrations/connectors/source-pardot/metadata.yaml
View File

@@ -2,7 +2,7 @@ data:
connectorSubtype: api
connectorType: source
definitionId: ad15c7ba-72a7-440b-af15-b9a963dc1a8a
dockerImageTag: 1.0.24
dockerImageTag: 1.0.25
dockerRepository: airbyte/source-pardot
githubIssueLabel: source-pardot
icon: salesforcepardot.svg

8
docs/integrations/sources/pardot.md
View File

@@ -15,6 +15,7 @@ This page contains the setup guide and reference information for the [Pardot (Sa
## Setup Guide
### Required configuration options
- **Pardot Business Unit ID** (`pardot_business_unit_id`): This value uniquely identifies your account, and can be found at Setup > Pardot > Pardot Account Setup
- **Client ID** (`client_id`): The Consumer Key that can be found when viewing your app in Salesforce
@@ -24,9 +25,8 @@ This page contains the setup guide and reference information for the [Pardot (Sa
- **Refresh Token** (`refresh_token`): Salesforce Refresh Token used for Airbyte to access your Salesforce account. If you don't know what this is, follow [this guide](https://medium.com/@bpmmendis94/obtain-access-refresh-tokens-from-salesforce-rest-api-a324fe4ccd9b) to retrieve it.
### Optional configuration options
- **Start Date** (`start_date`): UTC date and time in the format `2020-01-25T00:00:00Z`. Any data before this date will not be replicated. Defaults to `2007-01-01T00:00:00Z` (the year Pardot was launched)
- **Page Size Limit** (`page_size`): The default page size to return; defaults to `1000` (which is Pardot's maximum). Does not apply to the Email Clicks stream which uses the v4 API and is limited to 200 per page.
- **Start Date** (`start_date`): UTC date and time in the format `2020-01-25T00:00:00Z`. Any data before this date will not be replicated. Defaults to `2007-01-01T00:00:00Z` (the year Pardot was launched)
- **Is Sandbox App?** (`is_sandbox`): Whether or not the app is in a Salesforce sandbox. If you do not know what this is, assume it is false.
@@ -87,12 +87,14 @@ Several output streams are available from this source. Unless noted otherwise, s
- [Visitor Page Views](https://developer.salesforce.com/docs/marketing/pardot/guide/visitor-page-view-v5.html) (incremental)
- [Visits](https://developer.salesforce.com/docs/marketing/pardot/guide/visit-v5.html) (incremental)
If there are more endpoints you'd like Airbyte to support, please [create an issue](https://github.com/airbytehq/airbyte/issues/new/choose).
## Changelog
| Version | Date | Pull Request | Subject |
| :------ | :--------- | :------------------------------------------------------- | :-------------------- |
| 1.0.25 | 2025-09-23 | [65782](https://github.com/airbytehq/airbyte/pull/66592) | Fix pagination when >100K records returned |
| 1.0.24 | 2025-09-09 | [65782](https://github.com/airbytehq/airbyte/pull/65782) | Update dependencies |
| 1.0.23 | 2025-08-23 | [65172](https://github.com/airbytehq/airbyte/pull/65172) | Update dependencies |
| 1.0.22 | 2025-08-16 | [64794](https://github.com/airbytehq/airbyte/pull/64794) | Update dependencies |
@@ -141,4 +143,4 @@ If there are more endpoints you'd like Airbyte to support, please [create an iss
| 0.1.3 | 2024-06-04 | [39087](https://github.com/airbytehq/airbyte/pull/39087) | [autopull] Upgrade base image to v1.2.1 |
| 0.1.2 | 2024-05-21 | [38521](https://github.com/airbytehq/airbyte/pull/38521) | [autopull] base image + poetry + up_to_date |
| 0.1.1 | 2022-12-16 | [19618](https://github.com/airbytehq/airbyte/pull/19618) | Fix `visitors` stream |
| 0.1.0 | 2021-11-19 | [7091](https://github.com/airbytehq/airbyte/pull/7091) | 🎉 New Source: Pardot |
| 0.1.0 | 2021-11-19 | [7091](https://github.com/airbytehq/airbyte/pull/7091) | 🎉 New Source: Pardot |