1
0
mirror of synced 2025-12-20 18:39:31 -05:00
Commit Graph

117 Commits

Author SHA1 Message Date
octavia-bot-hoard[bot]
ea1eb6e275 🐙 source-iterable: run up-to-date pipeline [2025-10-21] (#68545)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-21 12:15:18 -04:00
devin-ai-integration[bot]
1dbd573f50 docs(source-iterable): improve documentation clarity and fix broken issue link (#68168)
## What

This PR improves the Iterable source connector documentation by:
- Removing a broken link to internal issue #24968 that is not accessible
to end users
- Clarifying prerequisites and API key requirements
- Adding detailed documentation about incremental sync behavior and
error handling

The changes were requested by ian.alton@airbyte.io to verify and improve
the connector documentation.

**Link to Devin run**:
https://app.devin.ai/sessions/4570bbfaf450476782d6f5dfe1e30cab

## How

The documentation updates include:

1. **Fixed broken issue reference** (line 77): Replaced link to
non-existent issue #24968 with a clear explanation of the List Users
error handling behavior
2. **Enhanced Prerequisites section** (lines 5-9): Clarified that only
Server-side API keys with Standard permissions are supported (not Mobile
or Browser keys)
3. **Added Performance and data retrieval section** (lines 77-91):
- Documents 90-day interval slicing for Users stream with
`profileUpdatedAt` cursor
   - Explains adaptive slicing for Event streams
   - Documents Templates stream incremental sync with `updatedAt` cursor
- Details retry logic with exponential backoff (10 retries, 20-400
second delays)

Changes were based on code review of:
- `source_iterable/manifest.yaml` (Users stream configuration)
- `source_iterable/streams.py` (retry logic, error handling)

## Review guide

1. **docs/integrations/sources/iterable.md** - Focus on:
- Lines 83-84: Verify the 90-day interval and `profileUpdatedAt` cursor
field are accurate for Users stream
- Lines 91: Confirm retry delays (20-400 seconds) and max retries (10)
match the implementation
- Lines 89-90: Ensure List Users error handling description is accurate
- Overall: Check if the new technical details are helpful for end users
vs too implementation-specific

## User Impact

**Positive:**
- End users now have clearer guidance on API key requirements
- Better understanding of how incremental syncs work and how much data
will be requested at once
- No longer confused by a broken link to an inaccessible internal issue

**Neutral:**
- More detailed technical information may be helpful for troubleshooting
but could also be overwhelming

## Can this PR be safely reverted and rolled back?

- [x] YES 💚

This is a documentation-only change with no code modifications.
Reverting would simply restore the previous documentation state.

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: ian.alton@airbyte.io <ian.alton@airbyte.io>
2025-10-17 11:24:48 -07:00
octavia-bot-hoard[bot]
092b29373d 🐙 source-iterable: run up-to-date pipeline [2025-10-14] (#67947)
# Update source-iterable

This PR was autogenerated by running `airbyte-ci connectors
--name=source-iterable up_to_date --pull`

We've set the `auto-merge` label on it, so it will be automatically
merged if the CI pipelines pass.
If you don't want to merge it automatically, please remove the
`auto-merge` label.
Please reach out to the Airbyte Connector Tooling team if you have any
questions or concerns.


## Operations

- Upgrade the base image to the latest version in metadata.yaml: Skipped

- Update versions of libraries in poetry: Successful

- PATCH bump source-iterable version to 0.6.52: Successful

- Build source-iterable docker image for platform(s) linux/amd64,
linux/arm64: Successful

- Get dependency updates: Successful

- Create or update pull request on Airbyte repository: Successful

- Add changelog entry: Successful




## Dependency updates

We use [`syft`](https://github.com/anchore/syft) to generate a SBOM for
the latest connector version and the one from the PR.
It allows us to spot the dependencies that have been updated at all
levels and for all types of dependencies (system, python, java etc.).
Here are the dependencies that have been updated compared to
`airbyte/source-iterable:latest`.
Keep in mind that `:latest` does not always match the connector code on
the main branch.
It is the latest released connector image when the head commit of this
branch was created.

| Type | Name | State | Previous Version | New Version |
|------|------|-------|-------------|------------------|
| python | MarkupSafe | updated | 3.0.2 | **3.0.3** |
| python | PyYAML | updated | 6.0.2 | **6.0.3** |
| python | anyio | updated | 4.10.0 | **4.11.0** |
| python | attrs | updated | 25.3.0 | **25.4.0** |
| python | cachetools | updated | 6.1.0 | **6.2.1** |
| python | cattrs | updated | 25.1.1 | **25.3.0** |
| python | certifi | updated | 2025.8.3 | **2025.7.9** |
| python | cffi | updated | 1.17.1 | **2.0.0** |
| python | charset-normalizer | updated | 3.4.3 | **3.4.4** |
| python | idna | updated | 3.10 | **3.11** |
| python | orjson | updated | 3.11.2 | **3.11.3** |
| python | platformdirs | updated | 4.3.8 | **4.4.0** |
| python | pycparser | updated | 2.22 | **2.23** |
| python | pydantic | updated | 2.11.7 | **2.12.1** |
| python | pydantic_core | updated | 2.33.2 | **2.41.3** |
| python | requests | updated | 2.32.4 | **2.32.5** |
| python | typing-inspection | updated | 0.4.1 | **0.4.2** |
| python | typing_extensions | updated | 4.14.1 | **4.15.0** |
| python | source-iterable | removed | 0.6.46 | **not present** |

> [!IMPORTANT]
> **Auto-merge enabled.**
> 
> _This PR is set to merge automatically when all requirements are met._

Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-14 16:19:11 -04:00
devin-ai-integration[bot]
388735eccb docs(source-iterable): Fix grammar and remove duplicate changelog entry (#67606)
## What

This PR fixes minor documentation issues in the Iterable source
connector documentation following recent schema changes. Specifically:

1. **Grammar correction**: Fixed "when meet" → "when meeting" in the
Additional notes section
2. **Duplicate removal**: Removed duplicate changelog entry for version
0.2.1

These changes improve documentation readability and accuracy as part of
the connector documentation review process.

## How

- Updated the grammar in the "Additional notes" section to use proper
English
- Removed the duplicate changelog entry that was identical to the line
above it

## Review guide

1. `docs/integrations/sources/iterable.md` - Review the grammar fix in
the "Additional notes" section and verify the removed changelog entry
was indeed a duplicate

## User Impact

- **Positive**: Improved documentation readability and reduced confusion
from duplicate changelog entries
- **Negative**: None - these are minor editorial improvements

## Can this PR be safely reverted and rolled back?

- [x] YES 💚

---

**Link to Devin run**:
https://app.devin.ai/sessions/8d9f082822de4013a9db18269039dca4

**Requested by**: User via automated documentation review process

**Note**: I am an AI agent and have proposed these documentation updates
based on review of the connector documentation. Reviewers can merge this
PR, modify it, or close it if they disagree with the changes.

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2025-10-10 10:20:10 -07:00
Vai Ignatavicius
8f59f03e81 🐛 Source Iterable: Fix schema issues in campaigns, email send, and subscriptions (#67602)
## What
Fixes array column serialization errors in source-iterable streams by
properly defining array item types in JSONSchema definitions.

**Problem:** Array columns (e.g., `campaigns.labels`, `emailListIds`,
`channelIds`, `categories`) were being written as null values to the S3
Data Lake destination with `DESTINATION_SERIALIZATION_ERROR` in the
`_airbyte_meta` column.

**Root Cause:** Multiple stream schemas had array definitions with empty
`items: {}`, which is ambiguous and prevents proper type mapping to
destinations like Iceberg/Glue.

**Affected Streams:**
- `email_unsubscribe` (emailListIds, channelIds)
- `email_send` (categories)
- `email_send_skip` (categories)  
- `email_subscribe` (emailListIds)
- `campaigns` (listIds, suppressionListIds, labels)


## How
Updated JSONSchema definitions across affected stream schema files to
specify explicit item types for all array fields:

**Before:**

```
"emailListIds": {
  "type": ["null", "array"],
  "items": {}  
}
```

After:

```
"emailListIds": {
  "type": ["null", "array"],
  "items": {
    "type": "integer" 
  }
}
```

## Review guide
source_iterable/schemas/campaigns.json - Check listIds,
suppressionListIds, labels
source_iterable/schemas/email_unsubscribe.json - Check emailListIds,
channelIds
source_iterable/schemas/email_send.json - Check categories (in
transactional data)
source_iterable/schemas/email_send_skip.json - Check categories (in
transactional data)
source_iterable/schemas/email_subscribe.json - Check emailListIds

Verify that all "items": {} instances have been replaced with proper
type definitions.

## User Impact
None expected - this is a schema clarification that aligns with actual
data types.

## Can this PR be safely reverted and rolled back?

- [X] YES 💚
- [ ] NO 

---------

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
2025-10-10 15:35:00 +01:00
octavia-bot-hoard[bot]
cda1fff41b 🐙 source-iterable: run up-to-date pipeline [2025-10-07] (#67361)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-10-07 14:13:25 -04:00
octavia-bot-hoard[bot]
df15c3a6b3 🐙 source-iterable: run up-to-date pipeline [2025-09-30] (#66798)
Co-authored-by: octavia-bot-hoard[bot] <230633153+octavia-bot-hoard[bot]@users.noreply.github.com>
2025-09-30 08:15:23 -04:00
Airbyte
e16bbb3324 🐙 source-iterable: run up-to-date pipeline [2025-09-09] (#66107) 2025-09-09 12:14:09 -04:00
Airbyte
e1df701368 🐙 source-iterable: run up-to-date pipeline [2025-08-23] (#65380) 2025-08-23 16:10:40 -04:00
Airbyte
8194e3c740 🐙 source-iterable: run up-to-date pipeline [2025-08-16] (#64970) 2025-08-16 20:06:37 +02:00
Airbyte
744f0dfac8 🐙 source-iterable: run up-to-date pipeline [2025-08-09] (#64604) 2025-08-09 16:07:22 +02:00
Airbyte
626d9a1711 🐙 source-iterable: run up-to-date pipeline [2025-08-02] (#64284) 2025-08-02 18:07:25 +02:00
Airbyte
e607fd0246 🐙 source-iterable: run up-to-date pipeline [2025-07-26] (#63868) 2025-07-26 18:10:19 +02:00
Airbyte
57d5c98344 🐙 source-iterable: run up-to-date pipeline [2025-07-19] (#63451) 2025-07-19 18:09:36 +02:00
Airbyte
3c6456d6da 🐙 source-iterable: run up-to-date pipeline [2025-07-12] (#63141) 2025-07-12 13:07:22 -07:00
Airbyte
0a2cfa4298 🐙 source-iterable: run up-to-date pipeline [2025-07-05] (#62665) 2025-07-05 11:11:40 -07:00
Airbyte
fadb81c525 🐙 source-iterable: run up-to-date pipeline [2025-06-28] (#62174) 2025-06-28 09:19:06 -07:00
Airbyte
6f20f88891 🐙 source-iterable: run up-to-date pipeline [2025-06-21] (#61814) 2025-06-21 11:10:43 -07:00
Airbyte
6bf9feef35 🐙 source-iterable: run up-to-date pipeline [2025-06-14] (#61119) 2025-06-16 11:51:56 -07:00
Airbyte
0b93b46500 🐙 source-iterable: run up-to-date pipeline [2025-05-24] (#58772) 2025-05-24 20:03:11 +03:00
Danylo Jablonski
8ae9eee859 Source Iterable: expected records update for stream Events (#60854) 2025-05-22 18:49:22 +03:00
Airbyte
11b5171b81 🐙 source-iterable: run up-to-date pipeline [2025-04-12] (#57737) 2025-04-12 23:11:49 +03:00
Airbyte
90e5ba45d5 🐙 source-iterable: run up-to-date pipeline [2025-04-05] (#57057) 2025-04-05 17:09:02 +03:00
Airbyte
7a810faebc 🐙 source-iterable: run up-to-date pipeline [2025-03-29] (#56655) 2025-03-30 00:17:14 +02:00
Airbyte
7fa6e68ce1 🐙 source-iterable: run up-to-date pipeline [2025-03-22] (#56015) 2025-03-22 20:16:31 +02:00
Airbyte
9f4688c155 🐙 source-iterable: run up-to-date pipeline [2025-03-08] (#55510) 2025-03-09 02:29:34 +02:00
Airbyte
7dc90b555a 🐙 source-iterable: run up-to-date pipeline [2025-03-01] (#54759) 2025-03-01 16:11:07 +02:00
Airbyte
6afb6128b9 🐙 source-iterable: run up-to-date pipeline [2025-02-22] (#54287) 2025-02-22 18:09:01 +02:00
Airbyte
31339b6fcb 🐙 source-iterable: run up-to-date pipeline [2025-02-15] (#53814) 2025-02-18 07:59:35 +02:00
Airbyte
3ab3bb1112 🐙 source-iterable: run up-to-date pipeline [2025-02-01] (#52726) 2025-02-01 16:10:45 +02:00
Airbyte
c8a025f613 🐙 source-iterable: run up-to-date pipeline [2025-01-25] (#52277) 2025-01-25 20:24:49 +02:00
Airbyte
2032930f5f 🐙 source-iterable: run up-to-date pipeline [2025-01-11] (#51163) 2025-01-11 20:15:51 +02:00
Airbyte
16669d8b1f 🐙 source-iterable: run up-to-date pipeline [2025-01-04] (#50889) 2025-01-04 16:07:47 +02:00
Airbyte
66b1f0aa90 🐙 source-iterable: run up-to-date pipeline [2024-12-28] (#50608) 2024-12-28 22:13:48 +02:00
Airbyte
19914f09d2 🐙 source-iterable: run up-to-date pipeline [2024-12-21] (#50101) 2024-12-21 20:13:10 +02:00
Airbyte
b48725d0cf 🐙 source-iterable: run up-to-date pipeline [2024-12-14] (#49211) 2024-12-14 22:17:30 +02:00
Airbyte
f517be94f5 🐙 source-iterable: run up-to-date pipeline [2024-12-12] (#48993) 2024-12-12 12:10:54 +02:00
Airbyte
158ef21c62 🐙 source-iterable: run up-to-date pipeline [2024-11-04] (#48294) 2024-11-05 04:29:49 +02:00
Airbyte
a1c966aaf5 🐙 source-iterable: run up-to-date pipeline [2024-10-29] (#47803) 2024-10-29 16:08:41 +02:00
Airbyte
fe2799ffb7 🐙 source-iterable: run up-to-date pipeline [2024-10-28] (#47487) 2024-10-28 14:13:09 +02:00
Airbyte
48707f3a4f 🐙 source-iterable: run up-to-date pipeline [2024-10-23] (#47057) 2024-10-23 23:08:42 +03:00
Airbyte
640c2fa149 🐙 source-iterable: run up-to-date pipeline [2024-10-12] (#46814) 2024-10-13 03:19:39 +03:00
Airbyte
d281ae0519 🐙 source-iterable: run up-to-date pipeline [2024-10-05] (#46399) 2024-10-06 03:22:15 +03:00
Airbyte
def9024537 🐙 source-iterable: run up-to-date pipeline [2024-09-28] (#46155) 2024-09-29 03:20:59 +03:00
Airbyte
8c1af9b84a 🐙 source-iterable: run up-to-date pipeline [2024-09-21] (#45828) 2024-09-22 03:18:18 +03:00
Airbyte
73d8073d33 🐙 source-iterable: run up-to-date pipeline [2024-09-14] (#45518) 2024-09-15 03:21:08 +03:00
Airbyte
583f9f6a85 🐙 source-iterable: run up-to-date pipeline [2024-09-07] (#45221) 2024-09-08 03:22:11 +03:00
Airbyte
506649133b 🐙 source-iterable: run up-to-date pipeline [2024-08-31] (#45029) 2024-09-01 03:19:59 +03:00
Airbyte
174ca7aa42 🐙 source-iterable: run up-to-date pipeline [2024-08-24] (#44636) 2024-08-25 03:21:58 +03:00
Airbyte
62c4941e95 🐙 source-iterable: run up-to-date pipeline [2024-08-17] (#44260) 2024-08-18 03:21:19 +03:00