60322fa0c4
* Fixed dedupeot working correctly Due to delete only containing id, the deduped dbt could not work properly, so we also fill the cursor field with the current date so it does have a properly end * bump connector version * auto-bump connector version --------- Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com> Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
3.7 KiB
Microsoft Dataverse
Sync overview
This source can sync data for the Microsoft Dataverse API to work with Microsoft Dataverse.
This connector currently uses version v9.2 of the API
Output schema
This source will automatically discover the schema of the Entities of your Dataverse instance using the API
https://<url>/api/data/v9.2/EntityDefinitions?$expand=Attributes
Data type mapping
| Integration Type | Airbyte Type | Notes |
|---|---|---|
String |
string |
|
UniqueIdentifier |
string |
|
DateTime |
timestamp with timezone |
|
Integer |
integer |
|
BigInt |
integer |
|
Money |
number |
|
Boolean |
boolean |
|
Double |
number |
|
Decimal |
number |
|
Status |
integer |
|
State |
integer |
|
Virtual |
None | We skip virtual types |
Other types are defined as string.
Features
| Feature | Supported?(Yes/No) | Notes |
|---|---|---|
| Full Refresh Sync | Yes | |
| Incremental Sync | Yes | |
| CDC | Yes | Not all entities support it. Deleted data only have the ID |
| Replicate Incremental Deletes | Yes | |
| SSL connection | Yes | |
| Namespaces | No |
Getting started
Requirements
- Application (client) ID
- Directory (tenant) ID
- Client secrets
Setup guide
The Microsoft Dataverse API uses OAuth2 for authentication. We need a 'client_credentials' type, that we usually get by using an App Registration. https://learn.microsoft.com/en-us/power-apps/developer/data-platform/authenticate-oauth
The procedure to generate the credentials and setup the necessary permissions is well described in this post from Magnetism blog: https://blog.magnetismsolutions.com/blog/paulnieuwelaar/2021/9/21/setting-up-an-application-user-in-dynamics-365
CHANGELOG
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.1.1 | 2023-03-16 | 22805 | Fixed deduped cursor field value update |
| 0.1.0 | 2022-11-14 | 18646 | 🎉 New Source: Microsoft Dataverse [python cdk] |