1
0
mirror of synced 2025-12-25 02:09:19 -05:00
Files
airbyte/docs/integrations/sources/datadog.md
2024-05-07 08:19:33 -07:00

5.6 KiB

Datadog

This is a setup guide for the Datadog source connector which collects data from its API.

Prerequisites

An API key is required as well as an API application key. See the Datadog API and Application Keys section for more information.

Setup guide

Step 1: Set up the Datadog connector in Airbyte

For Airbyte Cloud:

  1. Log into your Airbyte Cloud account.
  2. In the left navigation bar, click Sources. In the top-right corner, click +new source.
  3. On the Set up the source page, enter the name for the Datadog connector and select Datadog from the Source type dropdown.
  4. Enter your api_key - Datadog API key.
  5. Enter your application_key - Datadog application key.
  6. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
  7. Enter your limit - Number of records to collect per request.
  8. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
  9. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
  10. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Optional. Query Name.
    2. Select the data_source from dropdown - Optional. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Optional. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
  11. Click Set up source.

For Airbyte OSS:

  1. Navigate to the Airbyte Open Source dashboard.
  2. Set the name for your source.
  3. Enter your api_key - Datadog API key.
  4. Enter your application_key - Datadog application key.
  5. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
  6. Enter your limit - Number of records to collect per request.
  7. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
  8. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
  9. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Required. Query Name.
    2. Select the data_source - Required. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Required. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
  10. Click Set up source.

Supported sync modes

The Datadog source connector supports the following sync modes:

Feature Supported?
Full Refresh Sync Yes
Incremental Sync Yes
SSL connection Yes
Namespaces No

Supported Streams

Changelog

Version Date Pull Request Subject
0.4.0 2023-12-04 30999 Add monitors and service_level_objectives Streams
0.3.0 2023-08-27 29885 Migrate to low code
0.2.2 2023-07-10 28089 Additional stream and query details in response
0.2.1 2023-06-28 26534 Support multiple query streams and pulling data from different datadog sites
0.2.0 2023-06-28 27784 Add necessary fields to schemas
0.1.1 2023-04-27 25562 Update testing dependencies
0.1.0 2022-10-18 18150 New Source: Datadog