Breaking Changes
editBreaking Changes
editThis section discusses the changes that you need to be aware of when migrating to Logstash 6.0.0 from the previous major releases.
See also:
Changes in Logstash Core
editThese changes can impact any instance of Logstash and are plugin agnostic, but only if you are using the features that are impacted.
Application Settings
edit-
The setting
config.reload.intervalhas been changed to use time value strings such as5m,10setc. Previously, users had to convert this to a millisecond time value themselves.
RPM/Deb package changes
edit-
For
rpmanddebrelease artifacts, config files that match the*.confglob pattern must be in the conf.d folder, or the files will not be loaded. If there are non-configuration files in this folder this can be problematic.
Command Line Interface behavior
edit-
The
-eand-fCLI options are now mutually exclusive. This also applies to the corresponding long form optionsconfig.stringandpath.config. This means any configurations provided via-ewill no longer be appended to the configurations provided via-f. -
Configurations provided with
-forconfig.pathwill not be appended withstdininput andstdoutoutput automatically.
Plugin Changes
editNote that the list of plugins included with Logstash has changed. Please check that the new plugin list still includes all plugins you use.
Elasticsearch output changes
edit-
The default
document_typehas changed fromlogstodocfor consistency with Beats. Furthermore, users are advised that Elasticsearch 6.0 deprecates doctypes, and 7.0 will remove them. See Removal of Mapping Types for more info. -
The options
flush_sizeandidle_flush_timeare now obsolete. - Please note that the _all field is deprecated in 6.0. The new mapping template has been updated to reflect that. If you are using a custom mapping template you may need to update it to reflect that.
Kafka input changes
edit-
Upgraded Kafka client support to v0.11.0.0, which only supports Kafka brokers v0.10.x or later.
- Please refer to Kafka input plugin documentation for information about Kafka compatibility with Logstash.
-
Decorated fields are now nested under
@metadatato avoid mapping conflicts with Beats.-
See the
Metadata Fieldssection in the Kafka input plugin documentation for more details.
-
See the
-
The
ssloption is now obsolete.
Kafka output changes
edit-
Upgraded Kafka client support to v0.11.0.0, which only supports Kafka brokers v0.10.x or later.
- Please refer to Kafka output plugin documentation for information about Kafka compatibility with Logstash.
-
The options
block_on_buffer_full,ssl, andtimeout_msare now obsolete.
Beats input changes
edit-
Logstash will no longer start when Multiline codec plugin is used with the Beats input plugin.
- It is recommended to use the multiline support in Filebeat as a replacement - see configuration options available in Filebeat for details.
-
The options
congestion_thresholdandtarget_field_for_codecare now obsolete.
TCP Input Changes
edit- Changed the behaviour of the host field to contain the resolved peer hostname for a connection instead of its peer IP.
-
Removed the
data_timeoutandssl_cacertoptions because they are now obsolete. -
Moved the peer’s IP to the new field
ip_address.
TCP Output Changes
edit-
Breaking: removed the
message_formatoption because it is now obsolete.
SQS Output Changes
edit-
Breaking: removed the
batchandbatch_timeoutoptions because they are now obsolete.
Redis Output Changes
edit-
Removed the
nameandqueueoptions because they are now obsolete.
RabbitMQ Input/Output Changes
edit-
Removed the
debug,tls_certificate_path, andtls_certificate_passwordoptions because they are now obsolete.
Logstash Output HTTP
edit-
Removed the
ssl_certificate_verifyoption because it is now obsolete.
Logstash Input HTTP Poller
edit-
Removed the
ssl_certificate_verifyoption because it is now obsolete.
GeoIP Changes
edit-
Removed the
lru_cache_sizeoption because it is now obsolete.
CEF Codec Changes
edit-
Removed the
sevanddeprecated_v1_fieldsoptions because they are now obsolete.
List of plugins bundled with Logstash
editThe following plugins were removed from the 6.0 default bundle based on usage data. You can still install these plugins manually:
- logstash-codec-oldlogstashjson
- logstash-input-couchdb_changes
- logstash-input-irc
- logstash-input-log4j
- logstash-input-lumberjack
- logstash-filter-uuid
- logstash-output-xmpp
- logstash-output-irc
- logstash-output-statsd