Skip to content

Commit 04ee02f

Browse files
Update WarpStream integration
1 parent ba5d278 commit 04ee02f

2 files changed

Lines changed: 20 additions & 5 deletions

File tree

warpstream/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ WarpStream is a data streaming platform compatible with Apache Kafka®, designed
99
### Installation
1010

1111
1. [Install the Datadog Agent][1].
12-
2. Manually install the WarpStream integration. See [Use Community Integrations][2] for more details based on the environment.
12+
2. Manually install the WarpStream integration. For environment-specific instructions, see [Use Community Integrations][2].
1313

1414
### Configuration
1515

@@ -23,9 +23,9 @@ The WarpStream integration has two components:
2323

2424
The WarpStream integration's [metrics][3] come from both the Agent and StatsD portions.
2525

26-
#### Configure the Datadog Agent WarpStream integration
26+
#### Configure the WarpStream integration for the Datadog Agent
2727

28-
Edit the `url` in `warpstream.d/conf.yaml`, in the `conf.d/` folder at the root of your Agent's configuration directory. See the [sample `warpstream.d/conf.yaml`][4] for all available configuration options.
28+
Edit the `url` in `warpstream.d/conf.yaml`, located in the `conf.d/` folder at the root of your Agent's configuration directory. See the [sample `warpstream.d/conf.yaml`][4] for all available configuration options.
2929

3030
The `url` value must match your WarpStream Agent HTTP server (port 8080 by default).
3131

warpstream/metadata.csv

Lines changed: 17 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -99,8 +99,8 @@ warpstream.consumer_group_num_partitions,gauge,,,,number of partitions in each c
9999
warpstream.consumer_group_num_topics,gauge,,,,number of topics in each consumer group,0,warpstream,consumer_group_num_topics,
100100
warpstream.consumer_group_state,gauge,,,,"indicates state of consumer group, tagged by 'consumer_group' and 'group_state'",0,warpstream,consumer_group_state,
101101
warpstream.container_running,gauge,,,,gauge set to 1 to indicate that the container is running,0,warpstream,container_running,
102-
warpstream.cpu_utilization_go_runtime,gauge,,,,current process's CPU utilization from the go runtime's perspective,0,warpstream,cpu_utilization_go_runtime,
103-
warpstream.cpu_utilization_os,gauge,,,,current process's CPU utilization from the operating system's perspective,0,warpstream,cpu_utilization_os,
102+
warpstream.cpu_utilization_go_runtime,gauge,,,,"current process's CPU utilization from the Go runtime's perspective, recorded as a ratio between 0 and 1",0,warpstream,cpu_utilization_go_runtime,
103+
warpstream.cpu_utilization_os,gauge,,,,"current process's CPU utilization from the operating system's perspective, recorded as a ratio between 0 and 1",0,warpstream,cpu_utilization_os,
104104
warpstream.diagnostic_status,gauge,,,,"diagnostic status, tagged by 'diagnostic_name', 'diagnostic_type', 'successful' and 'muted'. This metric is deprecated, you should use 'diagnostic_failure' instead.",0,warpstream,diagnostic_status,
105105
warpstream.error_count,count,,,,counts the number of errors logged,0,warpstream,error_count,
106106
warpstream.fast_retrier_execution,count,,,,counts the number of times the fast retrier was used,1,warpstream,fast_retrier_execution,
@@ -277,3 +277,18 @@ warpstream.bento_output_connection_failed,count,,,,counts the number of times th
277277
warpstream.tableflow_ingestion_lag_seconds,gauge,,second,,measures how far behind the ingestion process is from the source Kafka topic,0,warpstream,tableflow_ingestion_lag_seconds,
278278
warpstream.tableflow_query_lag_seconds,gauge,,second,,measures the time from when data is produced to Kafka until it is queryable (ingestion lag and catalog sync delay),0,warpstream,tableflow_query_lag_seconds,
279279
warpstream.bento_output_error,count,,,,counts the number of send attempts that have failed in Managed Data Pipelines. On failed batched sends this count is incremented once only,1,warpstream,bento_output_error,
280+
warpstream.cpu_utilization_go_runtime_moving_average_sample,count,,,,counts each value appended to the Go runtime CPU utilization moving average,1,warpstream,cpu_utilization_go_runtime_moving_average_sample,
281+
warpstream.cpu_utilization_go_runtime_moving_average_sample_utilization_distribution,gauge,,,,"distribution of the values appended to the Go runtime CPU utilization moving average, recorded as ratios between 0 and 1",0,warpstream,cpu_utilization_go_runtime_moving_average_sample_utilization_distribution,
282+
warpstream.agent_kafka_produce_forwarded_records_counter,count,,,,counts the number of records successfully forwarded to the source Kafka cluster during auto migration,1,warpstream,agent_kafka_produce_forwarded_records_counter,
283+
warpstream.agent_kafka_produce_forwarded_compressed_bytes,gauge,,byte,,distribution of the number of compressed bytes successfully forwarded to the source Kafka cluster during auto migration,0,warpstream,agent_kafka_produce_forwarded_compressed_bytes,
284+
warpstream.agent_kafka_produce_forwarded_compressed_bytes_counter,count,,byte,,counts the number of compressed bytes successfully forwarded to the source Kafka cluster during auto migration,1,warpstream,agent_kafka_produce_forwarded_compressed_bytes_counter,
285+
warpstream.agent_cpu,gauge,,percent,,latest CPU usage percentage reported by a live agent heartbeat,0,warpstream,agent_cpu,
286+
warpstream.min_offset,gauge,,,,oldest offset still retained for a topic partition,1,warpstream,min_offset,
287+
warpstream.max_offset,gauge,,,,high watermark offset (next offset to be written) for a topic partition,1,warpstream,max_offset,
288+
warpstream.consumer_group_commit_ts,gauge,,nanosecond,,timestamp (nanoseconds since epoch) of the last offset commit for a partition consumed by a Kafka consumer group,0,warpstream,consumer_group_commit_ts,
289+
warpstream.partition_size_estimated_compressed_bytes,gauge,,byte,,estimated compressed size in bytes of a topic partition's retained data,0,warpstream,partition_size_estimated_compressed_bytes,
290+
warpstream.agent_num_vcpus,gauge,,,,number of vCPUs reported by a live agent heartbeat,0,warpstream,agent_num_vcpus,
291+
warpstream.produced_records,count,,,,monotonically increasing count of records produced to a topic partition,1,warpstream,produced_records,
292+
warpstream.partition_size_uncompressed_bytes,gauge,,byte,,uncompressed size in bytes of a topic partition's retained data,0,warpstream,partition_size_uncompressed_bytes,
293+
warpstream.consumer_group_max_offset,gauge,,,,high watermark offset for a partition consumed by a Kafka consumer group,1,warpstream,consumer_group_max_offset,
294+
warpstream.agent_heartbeat,gauge,,,,"one sample per live agent heartbeat. Always 1; labels identify the agent, role set, group, availability zone, and other placement metadata",0,warpstream,agent_heartbeat,

0 commit comments

Comments
 (0)