- Filebeat Reference: other versions:
- Overview
- Getting Started With Filebeat
- Setting up and running Filebeat
- Upgrading Filebeat
- How Filebeat works
- Configuring Filebeat
- Specify which modules to run
- Configure inputs
- Manage multiline messages
- Specify general settings
- Load external configuration files
- Configure the internal queue
- Configure the output
- Configure index lifecycle management
- Load balance the output hosts
- Specify SSL settings
- Filter and enhance the exported data
- Define processors
- Add cloud metadata
- Add fields
- Add labels
- Add the local time zone
- Add tags
- Decode CEF
- Decode CSV fields
- Decode JSON fields
- Decode Base64 fields
- Decompress gzip fields
- Community ID Network Flow Hash
- Convert
- Drop events
- Drop fields from events
- Extract array
- Keep fields from events
- Registered Domain
- Rename fields from events
- Add Kubernetes metadata
- Add Docker metadata
- Add Host metadata
- Add Observer metadata
- Dissect strings
- DNS Reverse Lookup
- Add process metadata
- Script Processor
- Timestamp
- Parse data by using ingest node
- Enrich events with geoIP information
- Configure project paths
- Configure the Kibana endpoint
- Load the Kibana dashboards
- Load the Elasticsearch index template
- Configure logging
- Use environment variables in the configuration
- Autodiscover
- YAML tips and gotchas
- Regular expression support
- HTTP Endpoint
- filebeat.reference.yml
- Beats central management
- Modules
- Modules overview
- Apache module
- Auditd module
- AWS module
- CEF module
- Cisco module
- Coredns Module
- Elasticsearch module
- Envoyproxy Module
- Google Cloud module
- haproxy module
- IBM MQ module
- Icinga module
- IIS module
- Iptables module
- Kafka module
- Kibana module
- Logstash module
- MongoDB module
- MSSQL module
- MySQL module
- nats module
- NetFlow module
- Nginx module
- Osquery module
- Palo Alto Networks module
- PostgreSQL module
- RabbitMQ module
- Redis module
- Santa module
- Suricata module
- System module
- Traefik module
- Zeek (Bro) Module
- Exported fields
- Apache fields
- Auditd fields
- AWS fields
- Beat fields
- Decode CEF processor fields fields
- CEF fields
- Cisco fields
- Cloud provider metadata fields
- Coredns fields
- Docker fields
- ECS fields
- elasticsearch fields
- Envoyproxy fields
- Google Cloud fields
- haproxy fields
- Host fields
- ibmmq fields
- Icinga fields
- IIS fields
- iptables fields
- Jolokia Discovery autodiscover provider fields
- Kafka fields
- kibana fields
- Kubernetes fields
- Log file content fields
- logstash fields
- mongodb fields
- mssql fields
- MySQL fields
- nats fields
- NetFlow fields
- NetFlow fields
- Nginx fields
- Osquery fields
- panw fields
- PostgreSQL fields
- Process fields
- RabbitMQ fields
- Redis fields
- s3 fields
- Google Santa fields
- Suricata fields
- System fields
- Traefik fields
- Zeek fields
- Monitoring Filebeat
- Securing Filebeat
- Troubleshooting
- Get help
- Debug
- Common problems
- Can’t read log files from network volumes
- Filebeat isn’t collecting lines from a file
- Too many open file handlers
- Registry file is too large
- Inode reuse causes Filebeat to skip lines
- Log rotation results in lost or duplicate events
- Open file handlers cause issues with Windows file rotation
- Filebeat is using too much CPU
- Dashboard in Kibana is breaking up data fields incorrectly
- Fields are not indexed or usable in Kibana visualizations
- Filebeat isn’t shipping the last line of a file
- Filebeat keeps open file handlers of deleted files for a long time
- Filebeat uses too much bandwidth
- Error loading config file
- Found unexpected or unknown characters
- Logstash connection doesn’t work
- @metadata is missing in Logstash
- Not sure whether to use Logstash or Beats
- SSL client fails to connect to Logstash
- Monitoring UI shows fewer Beats than expected
- Contributing to Beats
Nginx fields
editNginx fields
editModule for parsing the Nginx log files.
nginx
editFields from the Nginx log files.
access
editContains fields for the Nginx access logs.
-
nginx.access.remote_ip_list -
An array of remote IP addresses. It is a list because it is common to include, besides the client IP address, IP addresses from headers like
X-Forwarded-For. Real source IP is restored tosource.ip.type: array
-
nginx.access.body_sent.bytes -
type: alias
alias to: http.response.body.bytes
-
nginx.access.user_name -
type: alias
alias to: user.name
-
nginx.access.method -
type: alias
alias to: http.request.method
-
nginx.access.url -
type: alias
alias to: url.original
-
nginx.access.http_version -
type: alias
alias to: http.version
-
nginx.access.response_code -
type: alias
alias to: http.response.status_code
-
nginx.access.referrer -
type: alias
alias to: http.request.referrer
-
nginx.access.agent -
type: alias
alias to: user_agent.original
-
nginx.access.user_agent.device -
type: alias
alias to: user_agent.device.name
-
nginx.access.user_agent.name -
type: alias
alias to: user_agent.name
-
nginx.access.user_agent.os -
type: alias
alias to: user_agent.os.full_name
-
nginx.access.user_agent.os_name -
type: alias
alias to: user_agent.os.name
-
nginx.access.user_agent.original -
type: alias
alias to: user_agent.original
-
nginx.access.geoip.continent_name -
type: alias
alias to: source.geo.continent_name
-
nginx.access.geoip.country_iso_code -
type: alias
alias to: source.geo.country_iso_code
-
nginx.access.geoip.location -
type: alias
alias to: source.geo.location
-
nginx.access.geoip.region_name -
type: alias
alias to: source.geo.region_name
-
nginx.access.geoip.city_name -
type: alias
alias to: source.geo.city_name
-
nginx.access.geoip.region_iso_code -
type: alias
alias to: source.geo.region_iso_code
error
editContains fields for the Nginx error logs.
-
nginx.error.connection_id -
Connection identifier.
type: long
-
nginx.error.level -
type: alias
alias to: log.level
-
nginx.error.pid -
type: alias
alias to: process.pid
-
nginx.error.tid -
type: alias
alias to: process.thread.id
-
nginx.error.message -
type: alias
alias to: message