- Metricbeat Reference: other versions:
- Overview
- Getting started with Metricbeat
- Setting up and running Metricbeat
- Upgrading Metricbeat
- How Metricbeat works
- Configuring Metricbeat
- Specify which modules to run
- Specify general settings
- Load external configuration files
- Configure the internal queue
- Configure the output
- Configure index lifecycle management
- Specify SSL settings
- Filter and enhance the exported data
- Define processors
- Add cloud metadata
- Add fields
- Add labels
- Add the local time zone
- Add tags
- Decode JSON fields
- Decode Base64 fields
- Decompress gzip fields
- Community ID Network Flow Hash
- Convert
- Drop events
- Drop fields from events
- Extract array
- Keep fields from events
- Registered Domain
- Rename fields from events
- Add Kubernetes metadata
- Add Docker metadata
- Add Host metadata
- Add Observer metadata
- Dissect strings
- DNS Reverse Lookup
- Add process metadata
- Parse data by using ingest node
- Enrich events with geoIP information
- Configure project paths
- Configure the Kibana endpoint
- Load the Kibana dashboards
- Load the Elasticsearch index template
- Configure logging
- Use environment variables in the configuration
- Autodiscover
- YAML tips and gotchas
- Regular expression support
- HTTP Endpoint
- metricbeat.reference.yml
- Beats central management
- Modules
- Aerospike module
- Apache module
- aws module
- Beat module
- Ceph module
- CockroachDB module
- consul module
- coredns module
- Couchbase module
- couchdb module
- Docker module
- Dropwizard module
- Elasticsearch module
- Elasticsearch ccr metricset
- Elasticsearch cluster_stats metricset
- Elasticsearch index metricset
- Elasticsearch index_recovery metricset
- Elasticsearch index_summary metricset
- Elasticsearch ml_job metricset
- Elasticsearch node metricset
- Elasticsearch node_stats metricset
- Elasticsearch pending_tasks metricset
- Elasticsearch shard metricset
- envoyproxy module
- Etcd module
- Golang module
- Graphite module
- HAProxy module
- HTTP module
- Jolokia module
- Kafka module
- Kibana module
- Kubernetes module
- Kubernetes apiserver metricset
- Kubernetes container metricset
- Kubernetes controllermanager metricset
- Kubernetes event metricset
- Kubernetes node metricset
- Kubernetes pod metricset
- Kubernetes proxy metricset
- Kubernetes scheduler metricset
- Kubernetes state_container metricset
- Kubernetes state_cronjob metricset
- Kubernetes state_deployment metricset
- Kubernetes state_node metricset
- Kubernetes state_pod metricset
- Kubernetes state_replicaset metricset
- Kubernetes state_statefulset metricset
- Kubernetes system metricset
- Kubernetes volume metricset
- kvm module
- Logstash module
- Memcached module
- MongoDB module
- MSSQL module
- Munin module
- MySQL module
- Nats module
- Nginx module
- Oracle module
- PHP_FPM module
- PostgreSQL module
- Prometheus module
- RabbitMQ module
- Redis module
- Statsd module
- System module
- System core metricset
- System cpu metricset
- System diskio metricset
- System entropy metricset
- System filesystem metricset
- System fsstat metricset
- System load metricset
- System memory metricset
- System network metricset
- System process metricset
- System process_summary metricset
- System raid metricset
- System socket metricset
- System socket_summary metricset
- System uptime metricset
- traefik module
- uwsgi module
- vSphere module
- Windows module
- ZooKeeper module
- Exported fields
- Aerospike fields
- Apache fields
- aws fields
- Beat fields
- Beat fields
- Ceph fields
- Cloud provider metadata fields
- CockroachDB fields
- Common fields
- consul fields
- coredns fields
- Couchbase fields
- couchdb fields
- Docker fields
- Docker fields
- Dropwizard fields
- ECS fields
- Elasticsearch fields
- envoyproxy fields
- Etcd fields
- Golang fields
- Graphite fields
- HAProxy fields
- Host fields
- HTTP fields
- Jolokia fields
- Jolokia Discovery autodiscover provider fields
- Kafka fields
- Kibana fields
- Kubernetes fields
- Kubernetes fields
- kvm fields
- Logstash fields
- Memcached fields
- MongoDB fields
- MSSQL fields
- Munin fields
- MySQL fields
- Nats fields
- Nginx fields
- Oracle fields
- PHP_FPM fields
- PostgreSQL fields
- Process fields
- Prometheus fields
- RabbitMQ fields
- Redis fields
- Statsd fields
- System fields
- traefik fields
- uwsgi fields
- vSphere fields
- Windows fields
- ZooKeeper fields
- Monitoring Metricbeat
- Securing Metricbeat
- Troubleshooting
- Get help
- Debug
- Common problems
- "open /compat/linux/proc: no such file or directory" error on FreeBSD
- Metricbeat collects system metrics for interfaces you didn’t configure
- Metricbeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Contributing to Beats
Kafka fields
editKafka fields
editKafka module
kafka
editbroker
editBroker Consumer Group Information have been read from (Broker handling the consumer group).
-
kafka.broker.id -
Broker id
type: long
-
kafka.broker.address -
Broker advertised address
type: keyword
-
kafka.topic.name -
Topic name
type: keyword
-
kafka.topic.error.code -
Topic error code.
type: long
-
kafka.partition.id -
Partition id.
type: long
-
kafka.partition.topic_id -
Unique id of the partition in the topic.
type: keyword
-
kafka.partition.topic_broker_id -
Unique id of the partition in the topic and the broker.
type: keyword
consumergroup
editconsumergroup
broker
editBroker Consumer Group Information have been read from (Broker handling the consumer group).
-
kafka.consumergroup.broker.id -
Broker id
type: long
-
kafka.consumergroup.broker.address -
Broker address
type: keyword
-
kafka.consumergroup.id -
Consumer Group ID
type: keyword
-
kafka.consumergroup.topic -
[6.5] Deprecated in 6.5.
Topic name
type: keyword
-
kafka.consumergroup.partition -
[6.5] Deprecated in 6.5.
Partition ID
type: long
-
kafka.consumergroup.offset -
consumer offset into partition being read
type: long
-
kafka.consumergroup.meta -
custom consumer meta data string
type: keyword
-
kafka.consumergroup.error.code -
kafka consumer/partition error code.
type: long
client
editAssigned client reading events from partition
-
kafka.consumergroup.client.id -
Client ID (kafka setting client.id)
type: keyword
-
kafka.consumergroup.client.host -
Client host
type: keyword
-
kafka.consumergroup.client.member_id -
internal consumer group member ID
type: keyword
partition
editpartition
offset
editAvailable offsets of the given partition.
-
kafka.partition.offset.newest -
Newest offset of the partition.
type: long
-
kafka.partition.offset.oldest -
Oldest offset of the partition.
type: long
partition
editPartition data.
-
kafka.partition.partition.id -
[6.5] Deprecated in 6.5.
Partition id.
type: long
-
kafka.partition.partition.leader -
Leader id (broker).
type: long
-
kafka.partition.partition.isr -
List of isr ids.
type: keyword
-
kafka.partition.partition.replica -
Replica id (broker).
type: long
-
kafka.partition.partition.insync_replica -
Indicates if replica is included in the in-sync replicate set (ISR).
type: boolean
-
kafka.partition.partition.is_leader -
Indicates if replica is the leader
type: boolean
-
kafka.partition.partition.error.code -
Error code from fetching partition.
type: long
-
kafka.partition.topic.error.code -
[6.5] Deprecated in 6.5.
topic error code.
type: long
-
kafka.partition.topic.name -
[6.5] Deprecated in 6.5.
Topic name
type: keyword
-
kafka.partition.broker.id -
[6.5] Deprecated in 6.5.
Broker id
type: long
-
kafka.partition.broker.address -
[6.5] Deprecated in 6.5.
Broker address
type: keyword