Datadog

Availability:

Airbyte Cloud Airbyte OSS PyAirbyte

Support Level:

community

Connector Version:

0.4.3(Last updated 5 days ago)

CDK Version:

1.3.3

This is a setup guide for the Datadog source connector which collects data from its API.

Prerequisites

An API key is required as well as an API application key. See the Datadog API and Application Keys section for more information.

Setup guide

Step 1: Set up the Datadog connector in Airbyte

For Airbyte Cloud:

1. Log into your Airbyte Cloud account.
2. In the left navigation bar, click Sources. In the top-right corner, click +new source.
3. On the Set up the source page, enter the name for the Datadog connector and select Datadog from the Source type dropdown.
4. Enter your api_key - Datadog API key.
5. Enter your application_key - Datadog application key.
6. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
7. Enter your limit - Number of records to collect per request.
8. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
9. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
10. Enter your queries - Optional. Multiple queries resulting in multiple streams.
    1. Enter the name- Optional. Query Name.
    2. Select the data_source from dropdown - Optional. Supported data sources - metrics, cloud_cost, logs, rum.
    3. Enter the query- Optional. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
11. Click Set up source.

For Airbyte OSS:

1. Navigate to the Airbyte Open Source dashboard.
2. Set the name for your source.
3. Enter your api_key - Datadog API key.
4. Enter your application_key - Datadog application key.
5. Enter your query - Optional. Type your query to filter records when collecting data from Logs and AuditLogs stream.
6. Enter your limit - Number of records to collect per request.
7. Enter your start_date - Optional. Start date to filter records when collecting data from Logs and AuditLogs stream.
8. Enter your end_date - Optional. End date to filter records when collecting data from Logs and AuditLogs stream.
9. Enter your queries - Optional. Multiple queries resulting in multiple streams.
   1. Enter the name- Required. Query Name.
   2. Select the data_source - Required. Supported data sources - metrics, cloud_cost, logs, rum.
   3. Enter the query- Required. A classic query string. Example - "kubernetes_state.node.count{*}", "@type:resource @resource.status_code:>=400 @resource.type:(xhr OR fetch)"
10. Click Set up source.

Supported sync modes

The Datadog source connector supports the following sync modes:

Feature	Supported?
Full Refresh Sync	Yes
Incremental Sync	Yes
SSL connection	Yes
Namespaces	No

Supported Streams

• AuditLogs
• Dashboards
• Downtimes
• IncidentTeams
• Incidents
• Logs
• Metrics
• Monitors
• ServiceLevelObjectives
• SyntheticTests
• Users
• Series

Reference

Config fields reference

Field

Type

Property name

string

api_key

string

application_key

string

query

string

start_date

string

site

string

end_date

integer

max_records_per_request

array<object>

queries

Changelog

Expand to review

Version	Date	Pull Request	Subject
0.4.3	2024-06-13	37590	Change last_records to last_record
0.4.2	2024-06-04	39060	[autopull] Upgrade base image to v1.2.1
0.4.1	2024-05-20	38424	[autopull] base image + poetry + up_to_date
0.4.0	2023-12-04	30999	Add monitors and service_level_objectives Streams
0.3.0	2023-08-27	29885	Migrate to low code
0.2.2	2023-07-10	28089	Additional stream and query details in response
0.2.1	2023-06-28	26534	Support multiple query streams and pulling data from different datadog sites
0.2.0	2023-06-28	27784	Add necessary fields to schemas
0.1.1	2023-04-27	25562	Update testing dependencies
0.1.0	2022-10-18	18150	New Source: Datadog