- Metricbeat Reference: other versions:
- Overview
- Getting started with Metricbeat
- Setting up and running Metricbeat
- Upgrading Metricbeat
- How Metricbeat works
- Configuring Metricbeat
- Specify which modules to run
- Specify general settings
- Load external configuration files
- Configure the internal queue
- Configure the output
- Configure index lifecycle management
- Specify SSL settings
- Filter and enhance the exported data
- Define processors
- Add cloud metadata
- Add fields
- Add labels
- Add the local time zone
- Add tags
- Decode JSON fields
- Decode Base64 fields
- Decompress gzip fields
- Community ID Network Flow Hash
- Convert
- Drop events
- Drop fields from events
- Extract array
- Keep fields from events
- Registered Domain
- Rename fields from events
- Add Kubernetes metadata
- Add Docker metadata
- Add Host metadata
- Add Observer metadata
- Dissect strings
- DNS Reverse Lookup
- Add process metadata
- Parse data by using ingest node
- Enrich events with geoIP information
- Configure project paths
- Configure the Kibana endpoint
- Load the Kibana dashboards
- Load the Elasticsearch index template
- Configure logging
- Use environment variables in the configuration
- Autodiscover
- YAML tips and gotchas
- Regular expression support
- HTTP Endpoint
- metricbeat.reference.yml
- Beats central management
- Modules
- Aerospike module
- Apache module
- aws module
- Beat module
- Ceph module
- CockroachDB module
- consul module
- coredns module
- Couchbase module
- couchdb module
- Docker module
- Dropwizard module
- Elasticsearch module
- Elasticsearch ccr metricset
- Elasticsearch cluster_stats metricset
- Elasticsearch index metricset
- Elasticsearch index_recovery metricset
- Elasticsearch index_summary metricset
- Elasticsearch ml_job metricset
- Elasticsearch node metricset
- Elasticsearch node_stats metricset
- Elasticsearch pending_tasks metricset
- Elasticsearch shard metricset
- envoyproxy module
- Etcd module
- Golang module
- Graphite module
- HAProxy module
- HTTP module
- Jolokia module
- Kafka module
- Kibana module
- Kubernetes module
- Kubernetes apiserver metricset
- Kubernetes container metricset
- Kubernetes controllermanager metricset
- Kubernetes event metricset
- Kubernetes node metricset
- Kubernetes pod metricset
- Kubernetes proxy metricset
- Kubernetes scheduler metricset
- Kubernetes state_container metricset
- Kubernetes state_cronjob metricset
- Kubernetes state_deployment metricset
- Kubernetes state_node metricset
- Kubernetes state_pod metricset
- Kubernetes state_replicaset metricset
- Kubernetes state_statefulset metricset
- Kubernetes system metricset
- Kubernetes volume metricset
- kvm module
- Logstash module
- Memcached module
- MongoDB module
- MSSQL module
- Munin module
- MySQL module
- Nats module
- Nginx module
- Oracle module
- PHP_FPM module
- PostgreSQL module
- Prometheus module
- RabbitMQ module
- Redis module
- Statsd module
- System module
- System core metricset
- System cpu metricset
- System diskio metricset
- System entropy metricset
- System filesystem metricset
- System fsstat metricset
- System load metricset
- System memory metricset
- System network metricset
- System process metricset
- System process_summary metricset
- System raid metricset
- System socket metricset
- System socket_summary metricset
- System uptime metricset
- traefik module
- uwsgi module
- vSphere module
- Windows module
- ZooKeeper module
- Exported fields
- Aerospike fields
- Apache fields
- aws fields
- Beat fields
- Beat fields
- Ceph fields
- Cloud provider metadata fields
- CockroachDB fields
- Common fields
- consul fields
- coredns fields
- Couchbase fields
- couchdb fields
- Docker fields
- Docker fields
- Dropwizard fields
- ECS fields
- Elasticsearch fields
- envoyproxy fields
- Etcd fields
- Golang fields
- Graphite fields
- HAProxy fields
- Host fields
- HTTP fields
- Jolokia fields
- Jolokia Discovery autodiscover provider fields
- Kafka fields
- Kibana fields
- Kubernetes fields
- Kubernetes fields
- kvm fields
- Logstash fields
- Memcached fields
- MongoDB fields
- MSSQL fields
- Munin fields
- MySQL fields
- Nats fields
- Nginx fields
- Oracle fields
- PHP_FPM fields
- PostgreSQL fields
- Process fields
- Prometheus fields
- RabbitMQ fields
- Redis fields
- Statsd fields
- System fields
- traefik fields
- uwsgi fields
- vSphere fields
- Windows fields
- ZooKeeper fields
- Monitoring Metricbeat
- Securing Metricbeat
- Troubleshooting
- Get help
- Debug
- Common problems
- "open /compat/linux/proc: no such file or directory" error on FreeBSD
- Metricbeat collects system metrics for interfaces you didn’t configure
- Metricbeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Contributing to Beats
MySQL fields
editMySQL fields
editMySQL server status metrics collected from MySQL.
mysql
editmysql
contains the metrics that were obtained from MySQL query.
galera_status
editgalera_status
contains the metrics that were obtained by the status SQL query on Galera.
apply
editApply status fields.
-
mysql.galera_status.apply.oooe
-
How often applier started write-set applying out-of-order (parallelization efficiency).
type: double
-
mysql.galera_status.apply.oool
-
How often write-set was so slow to apply that write-set with higher seqno’s were applied earlier. Values closer to 0 refer to a greater gap between slow and fast write-sets.
type: double
-
mysql.galera_status.apply.window
-
Average distance between highest and lowest concurrently applied seqno.
type: double
cert
editCertification status fields.
-
mysql.galera_status.cert.deps_distance
-
Average distance between highest and lowest seqno value that can be possibly applied in parallel (potential degree of parallelization).
type: double
-
mysql.galera_status.cert.index_size
-
The number of entries in the certification index.
type: long
-
mysql.galera_status.cert.interval
-
Average number of transactions received while a transaction replicates.
type: double
cluster
editCluster status fields.
-
mysql.galera_status.cluster.conf_id
-
Total number of cluster membership changes happened.
type: long
-
mysql.galera_status.cluster.size
-
Current number of members in the cluster.
type: long
-
mysql.galera_status.cluster.status
-
Status of this cluster component. That is, whether the node is part of a PRIMARY or NON_PRIMARY component.
type: keyword
commit
editCommit status fields.
-
mysql.galera_status.commit.oooe
-
How often a transaction was committed out of order.
type: double
-
mysql.galera_status.commit.window
-
Average distance between highest and lowest concurrently committed seqno.
type: long
-
mysql.galera_status.connected
-
If the value is OFF, the node has not yet connected to any of the cluster components. This may be due to misconfiguration. Check the error log for proper diagnostics.
type: keyword
evs
editEvs Fields.
-
mysql.galera_status.evs.evict
-
Lists the UUID’s of all nodes evicted from the cluster. Evicted nodes cannot rejoin the cluster until you restart their mysqld processes.
type: keyword
-
mysql.galera_status.evs.state
-
Shows the internal state of the EVS Protocol.
type: keyword
flow_ctl
editFlow Control fields.
-
mysql.galera_status.flow_ctl.paused
-
The fraction of time since the last FLUSH STATUS command that replication was paused due to flow control. In other words, how much the slave lag is slowing down the cluster.
type: double
-
mysql.galera_status.flow_ctl.paused_ns
-
The total time spent in a paused state measured in nanoseconds.
type: long
-
mysql.galera_status.flow_ctl.recv
-
Returns the number of FC_PAUSE events the node has received, including those the node has sent. Unlike most status variables, the counter for this one does not reset every time you run the query.
type: long
-
mysql.galera_status.flow_ctl.sent
-
Returns the number of FC_PAUSE events the node has sent. Unlike most status variables, the counter for this one does not reset every time you run the query.
type: long
-
mysql.galera_status.last_committed
-
The sequence number, or seqno, of the last committed transaction.
type: long
local
editNode specific Cluster status fields.
-
mysql.galera_status.local.bf_aborts
-
Total number of local transactions that were aborted by slave transactions while in execution.
type: long
-
mysql.galera_status.local.cert_failures
-
Total number of local transactions that failed certification test.
type: long
-
mysql.galera_status.local.commits
-
Total number of local transactions committed.
type: long
recv
editNode specific recv fields.
-
mysql.galera_status.local.recv.queue
-
Current (instantaneous) length of the recv queue.
type: long
-
mysql.galera_status.local.recv.queue_avg
-
Recv queue length averaged over interval since the last FLUSH STATUS command. Values considerably larger than 0.0 mean that the node cannot apply write-sets as fast as they are received and will generate a lot of replication throttling.
type: double
-
mysql.galera_status.local.recv.queue_max
-
The maximum length of the recv queue since the last FLUSH STATUS command.
type: long
-
mysql.galera_status.local.recv.queue_min
-
The minimum length of the recv queue since the last FLUSH STATUS command.
type: long
-
mysql.galera_status.local.replays
-
Total number of transaction replays due to asymmetric lock granularity.
type: long
send
editNode specific sent fields.
-
mysql.galera_status.local.send.queue
-
Current (instantaneous) length of the send queue.
type: long
-
mysql.galera_status.local.send.queue_avg
-
Send queue length averaged over time since the last FLUSH STATUS command. Values considerably larger than 0.0 indicate replication throttling or network throughput issue.
type: double
-
mysql.galera_status.local.send.queue_max
-
The maximum length of the send queue since the last FLUSH STATUS command.
type: long
-
mysql.galera_status.local.send.queue_min
-
The minimum length of the send queue since the last FLUSH STATUS command.
type: long
-
mysql.galera_status.local.state
-
Internal Galera Cluster FSM state number.
type: keyword
-
mysql.galera_status.ready
-
Whether the server is ready to accept queries.
type: keyword
received
editWrite-Set receive status fields.
-
mysql.galera_status.received.count
-
Total number of write-sets received from other nodes.
type: long
-
mysql.galera_status.received.bytes
-
Total size of write-sets received from other nodes.
type: long
repl
editReplication status fields.
-
mysql.galera_status.repl.data_bytes
-
Total size of data replicated.
type: long
-
mysql.galera_status.repl.keys
-
Total number of keys replicated.
type: long
-
mysql.galera_status.repl.keys_bytes
-
Total size of keys replicated.
type: long
-
mysql.galera_status.repl.other_bytes
-
Total size of other bits replicated.
type: long
-
mysql.galera_status.repl.count
-
Total number of write-sets replicated (sent to other nodes).
type: long
-
mysql.galera_status.repl.bytes
-
Total size of write-sets replicated.
type: long
status
editstatus
contains the metrics that were obtained by the status SQL query.
aborted
editAborted status fields.
-
mysql.status.aborted.clients
-
The number of connections that were aborted because the client died without closing the connection properly.
type: long
-
mysql.status.aborted.connects
-
The number of failed attempts to connect to the MySQL server.
type: long
binlog
edit-
mysql.status.binlog.cache.disk_use
-
type: long
-
mysql.status.binlog.cache.use
-
type: long
bytes
editBytes stats.
-
mysql.status.bytes.received
-
The number of bytes received from all clients.
type: long
format: bytes
-
mysql.status.bytes.sent
-
The number of bytes sent to all clients.
type: long
format: bytes
threads
editThreads stats.
-
mysql.status.threads.cached
-
The number of cached threads.
type: long
-
mysql.status.threads.created
-
The number of created threads.
type: long
-
mysql.status.threads.connected
-
The number of connected threads.
type: long
-
mysql.status.threads.running
-
The number of running threads.
type: long
-
mysql.status.connections
-
type: long
created
edit-
mysql.status.created.tmp.disk_tables
-
type: long
-
mysql.status.created.tmp.files
-
type: long
-
mysql.status.created.tmp.tables
-
type: long
delayed
edit-
mysql.status.delayed.errors
-
type: long
-
mysql.status.delayed.insert_threads
-
type: long
-
mysql.status.delayed.writes
-
type: long
-
mysql.status.flush_commands
-
type: long
-
mysql.status.max_used_connections
-
type: long
open
edit-
mysql.status.open.files
-
type: long
-
mysql.status.open.streams
-
type: long
-
mysql.status.open.tables
-
type: long
-
mysql.status.opened_tables
-
type: long
command
edit-
mysql.status.command.delete
-
The number of DELETE queries since startup.
type: long
-
mysql.status.command.insert
-
The number of INSERT queries since startup.
type: long
-
mysql.status.command.select
-
The number of SELECT queries since startup.
type: long
-
mysql.status.command.update
-
The number of UPDATE queries since startup.
type: long
-
mysql.status.queries
-
The number of statements executed by the server. This variable includes statements executed within stored programs, unlike the Questions variable. It does not count COM_PING or COM_STATISTICS commands.
type: long
-
mysql.status.questions
-
The number of statements executed by the server. This includes only statements sent to the server by clients and not statements executed within stored programs, unlike the Queries variable. This variable does not count COM_PING, COM_STATISTICS, COM_STMT_PREPARE, COM_STMT_CLOSE, or COM_STMT_RESET commands.
type: long
handler
edit-
mysql.status.handler.commit
-
The number of internal COMMIT statements.
type: long
-
mysql.status.handler.delete
-
The number of times that rows have been deleted from tables.
type: long
-
mysql.status.handler.external_lock
-
The server increments this variable for each call to its external_lock() function, which generally occurs at the beginning and end of access to a table instance.
type: long
-
mysql.status.handler.mrr_init
-
The number of times the server uses a storage engine’s own Multi-Range Read implementation for table access.
type: long
-
mysql.status.handler.prepare
-
A counter for the prepare phase of two-phase commit operations.
type: long
read
edit-
mysql.status.handler.read.first
-
The number of times the first entry in an index was read.
type: long
-
mysql.status.handler.read.key
-
The number of requests to read a row based on a key.
type: long
-
mysql.status.handler.read.last
-
The number of requests to read the last key in an index.
type: long
-
mysql.status.handler.read.next
-
The number of requests to read the next row in key order.
type: long
-
mysql.status.handler.read.prev
-
The number of requests to read the previous row in key order.
type: long
-
mysql.status.handler.read.rnd
-
The number of requests to read a row based on a fixed position.
type: long
-
mysql.status.handler.read.rnd_next
-
The number of requests to read the next row in the data file.
type: long
-
mysql.status.handler.rollback
-
The number of requests for a storage engine to perform a rollback operation.
type: long
-
mysql.status.handler.savepoint
-
The number of requests for a storage engine to place a savepoint.
type: long
-
mysql.status.handler.savepoint_rollback
-
The number of requests for a storage engine to roll back to a savepoint.
type: long
-
mysql.status.handler.update
-
The number of requests to update a row in a table.
type: long
-
mysql.status.handler.write
-
The number of requests to insert a row in a table.
type: long
innodb
editbuffer_pool
edit-
mysql.status.innodb.buffer_pool.dump_status
-
The progress of an operation to record the pages held in the InnoDB buffer pool, triggered by the setting of innodb_buffer_pool_dump_at_shutdown or innodb_buffer_pool_dump_now.
type: long
-
mysql.status.innodb.buffer_pool.load_status
-
The progress of an operation to warm up the InnoDB buffer pool by reading in a set of pages corresponding to an earlier point in time, triggered by the setting of innodb_buffer_pool_load_at_startup or innodb_buffer_pool_load_now.
type: long
bytes
edit-
mysql.status.innodb.buffer_pool.bytes.data
-
The total number of bytes in the InnoDB buffer pool containing data.
type: long
-
mysql.status.innodb.buffer_pool.bytes.dirty
-
The total current number of bytes held in dirty pages in the InnoDB buffer pool.
type: long
pages
edit-
mysql.status.innodb.buffer_pool.pages.data
-
he number of pages in the InnoDB buffer pool containing data.
type: long
-
mysql.status.innodb.buffer_pool.pages.dirty
-
The current number of dirty pages in the InnoDB buffer pool.
type: long
-
mysql.status.innodb.buffer_pool.pages.flushed
-
The number of requests to flush pages from the InnoDB buffer pool.
type: long
-
mysql.status.innodb.buffer_pool.pages.free
-
The number of free pages in the InnoDB buffer pool.
type: long
-
mysql.status.innodb.buffer_pool.pages.latched
-
The number of latched pages in the InnoDB buffer pool.
type: long
-
mysql.status.innodb.buffer_pool.pages.misc
-
The number of pages in the InnoDB buffer pool that are busy because they have been allocated for administrative overhead, such as row locks or the adaptive hash index.
type: long
-
mysql.status.innodb.buffer_pool.pages.total
-
The total size of the InnoDB buffer pool, in pages.
type: long
read
edit-
mysql.status.innodb.buffer_pool.read.ahead
-
The number of pages read into the InnoDB buffer pool by the read-ahead background thread.
type: long
-
mysql.status.innodb.buffer_pool.read.ahead_evicted
-
The number of pages read into the InnoDB buffer pool by the read-ahead background thread that were subsequently evicted without having been accessed by queries.
type: long
-
mysql.status.innodb.buffer_pool.read.ahead_rnd
-
The number of "random" read-aheads initiated by InnoDB.
type: long
-
mysql.status.innodb.buffer_pool.read.requests
-
The number of logical read requests.
type: long
pool
edit-
mysql.status.innodb.buffer_pool.pool.reads
-
The number of logical reads that InnoDB could not satisfy from the buffer pool, and had to read directly from disk.
type: long
-
mysql.status.innodb.buffer_pool.pool.resize_status
-
The status of an operation to resize the InnoDB buffer pool dynamically, triggered by setting the innodb_buffer_pool_size parameter dynamically.
type: long
-
mysql.status.innodb.buffer_pool.pool.wait_free
-
Normally, writes to the InnoDB buffer pool happen in the background. When InnoDB needs to read or create a page and no clean pages are available, InnoDB flushes some dirty pages first and waits for that operation to finish. This counter counts instances of these waits.
type: long
-
mysql.status.innodb.buffer_pool.write_requests
-
The number of writes done to the InnoDB buffer pool.
type: long
On this page