5.5.0 Release Notes

edit

See Multi data path bug in Elasticsearch 5.3.0.

Also see Breaking changes in 5.5.

Breaking changes

edit
Plugins
  • Remove hidden file leniency from spawner #24079 (issue: #23980)
Settings

Breaking Java changes

edit
Aggregations
  • Remove the unused SignificantTerms.compareTerm() method #24714
  • Make SignificantTerms.Bucket an interface rather than an abstract class #24670 (issue: #24492)
  • Make Terms.Bucket an interface rather than an abstract class #24492
Plugin Delete By Query
  • Move DeleteByQuery and Reindex requests into core #24578

Deprecations

edit
Index APIs
  • Deprecated use of + in index expressions #24585 (issue: #24515)
Packaging
  • Add deprecation warnings for $ES_USER and $ES_GROUP #24190 (issue: #23989)
Plugin Repository S3
  • S3 Repository: Deprecate remaining repositories.s3.* settings #24144 (issue: #24143)
REST
  • Add deprecation logging for comma-separated feature parsing #25040 (issue: #24723)
Scripting
  • Scripting: Deprecate native scripts #24692 (issue: #19966)
  • Scripting: Deprecate index lookup #24691 (issue: #19359)
  • Deprecate Fine Grain Settings for Scripts #24573 (issue: #24532)
  • Scripting: Deprecate file script settings #24555 (issue: #21798)
  • Scripting: Deprecate file scripts #24552 (issue: #21798)
Settings
  • Settings: Update settings deprecation from yml to yaml #24663 (issue: #19391)
  • Deprecate settings in .yml and .json #24059 (issue: #19391)
Tribe Node

New features

edit
Mapping
  • Add new ip_range field type #24433
Plugin Analysis ICU
  • Add ICUCollationFieldMapper #24126

Enhancements

edit
Aggregations
  • Add superset size to Significant Term REST response #24865
  • Add document count to Matrix Stats aggregation response #24776
  • Share XContent rendering code in significant terms aggregations #24677
  • Add count to rest output of geo_centroid #24387 (issue: #24366)
  • Allow scripted metric agg to access _score #24295
Aliases
  • Handle multiple aliases in _cat/aliases api #23698 (issue: #23661)
Circuit Breakers
  • Closing a ReleasableBytesStreamOutput closes the underlying BigArray #23941
Cluster
  • Add a cluster block that allows to delete indices that are read-only #24678
  • Extract a common base class to allow services to listen to remote cluster config updates #24367
Core
Engine
  • Add refresh stats tracking for realtime get #25052 (issue: #24806)
  • Engine: store maxUnsafeAutoIdTimestamp in commit #24149
Exceptions
  • IllegalStateException: Only duplicated jar instead of classpath #24953
Index APIs
  • Open and close index to honour allow_no_indices option #24222 (issue: #24031)
Ingest
  • add exclude_keys option to KeyValueProcessor #24876 (issue: #23856)
Inner Hits
Internal
  • "shard started" should show index and shard ID #25157
  • Add the ability to set eager_global_ordinals in the new parent-join field #25019
  • Add assertions enabled helper #24834
  • Add cross cluster support to _field_caps #24463 (issue: #24334)
  • Log JVM arguments on startup #24451
  • Preserve cluster alias throughout search execution to lookup nodes by cluster and ID #24438
  • Move RemoteClusterService into TransportService #24424
  • Enum related performance additions. #24274 (issue: #24226)
Java API
  • Always Accumulate Transport Exceptions #25017 (issue: #23099)
Java High Level REST Client
Logging
  • Warn on not enough masters during election #20063 (issue: #8362)
Mapping
  • Do not index _type when there is at most one type. #24363
  • Only allow one type on 6.0 indices #24317 (issue: #15613)
  • token_count type : add an option to count tokens (fix #23227) #24175 (issue: #23227)
Network
Packaging
  • Set number of processes in systemd unit file #24970 (issue: #20874)
Plugin Lang Painless
  • Optimize instance creation in LambdaBootstrap #24618
  • Allow painless to load stored fields #24290
Plugin Repository GCS
  • GCS Repository: Add secure storage of credentials #24697
Plugins
  • Add purge option to remove plugin CLI #24981
  • Move ReindexAction class to core #24684 (issue: #24578)
  • Plugins: Add support for platform specific plugins #24265
REST
  • Make ObjectParser support string to boolean conversion #24668 (issue: #21802)
  • Allow passing single scrollID in clear scroll API body #24242 (issue: #24233)
Scripting
  • Add Ability to Specify No Types/Contexts Allowed For Scripts #24782
  • Add New Security Script Settings #24637 (issue: #24532)
Search
  • Eliminate array access in tight loops when profiling is enabled. #24959
  • Support Multiple Inner Hits on a Field Collapse Request #24517
  • Expand cross cluster search indices for search requests to the concrete index or to it’s aliases #24502
  • Remove leniency when merging fetched hits in a search response phase #24158
Search Templates
Settings
  • Emit settings deprecation logging at most once #25457
Snapshot/Restore
  • Improves snapshot logging and snapshot deletion error handling #25264
  • Enhances get snapshots API to allow retrieving repository index only #24477 (issue: #24288)
  • Ensure every repository has an incompatible-snapshots blob #24403 (issue: #22267)
  • Change snapshot status error to use generic SnapshotException #24355 (issue: #24225)
Stats
Suggesters
  • Provide informative error message in case of unknown suggestion context. #24241
  • Allow different data types for category in Context suggester #23491 (issue: #22358)
Upgrade API
  • Allow plugins to upgrade templates and index metadata on startup #24379

Bug fixes

edit
Aggregations
  • Terms aggregation should remap global ordinal buckets when a sub-aggregator is used to sort the terms #24941 (issue: #24788)
  • Correctly set doc_count when MovAvg "predicts" values on existing buckets #24892 (issue: #24327)
  • InternalPercentilesBucket should not rely on ordered percents array #24336 (issue: #24331)
  • Align behavior HDR percentiles iterator with percentile() method #24206
  • DateHistogram: Fix extended_bounds with offset #23789 (issue: #23776)
  • Fix ArrayIndexOutOfBoundsException when no ranges are specified in the query #23241 (issue: #22881)
Aliases
  • GET aliases should 404 if aliases are missing #25043 (issue: #24644)
Allocation
  • Discard stale node responses from async shard fetching #24434 (issue: #24007)
Analysis
  • PatternAnalyzer should lowercase wildcard queries when lowercase is true. #24967
Bulk
Cache
  • fix bug of weight computation #24856
Circuit Breakers
  • Checks the circuit breaker before allocating bytes for a new big array #25010 (issue: #24790)
Core
  • Fix cache expire after access #24546
  • Check for default.path.data included in path.data #24285 (issue: #24283)
Geo
  • Fix GeoPoint FieldStats ternary logic bug #25211 (issue: #24275)
  • Fix GeoDistance Ordinal for BWC #25033 (issue: #24816)
Highlighting
  • Higlighters: Fix MultiPhrasePrefixQuery rewriting #25103 (issue: #25088)
Index APIs
  • Rollover max docs should only count primaries #24977 (issue: #24217)
  • Fix legacy GeoPointField decoding in FieldStats #24534 (issue: #24275)
  • Validates updated settings on closed indices #24487 (issue: #23787)
  • Fixes restore of a shrunken index when initial recovery node is gone #24322 (issue: #24257)
Ingest
  • fix grok’s pattern parsing to validate pattern names in expression #25063 (issue: #22831)
  • Fix floating-point error when DateProcessor parses UNIX #24947
  • add option for _ingest.timestamp to use new ZonedDateTime (5.x backport) #24030 (issues: #23168, #23174)
Inner Hits
  • Fix Source filtering in new field collapsing feature #24068 (issue: #24063)
Internal
  • Fix race condition in RemoteClusterConnection node supplier #25432
  • Initialise empty lists in BaseTaskResponse constructor #25290
  • Extract a common base class for scroll executions #24979 (issue: #16555)
  • Ensure remote cluster is connected before fetching _field_caps #24845 (issue: #24763)
  • Obey lock order if working with store to get metadata snapshots #24787 (issue: #24481)
  • Remove _UNRELEASED from Version constants for released versions #24764
  • Fix _field_caps serialization in order to support cross cluster search #24722
  • Avoid race when shutting down controller processes #24579
  • Fix NPE if field caps request has a field that exists not in all indices #24504
More Like This
  • Pass over _routing value with more_like_this items to be retrieved #24679 (issue: #23699)
Nested Docs
  • In case of a single type the _id field should be added to the nested document instead of _uid field #25149
Network
  • Ensure pending transport handlers are invoked for all channel failures #25150
  • Notify onConnectionClosed rather than onNodeDisconnect to prune transport handlers #24639 (issues: #24557, #24575, #24632)
  • SniffNodesSampler should close connection after handling responses #24632 (issues: #22828, #24557, #24575)
Packaging
  • When stopping via systemd only kill the JVM, not its control group #25195
  • Handle parentheses in batch file path #24731 (issue: #24712)
Percolator
  • Fix range queries with date range based on current time in percolator queries. #24666 (issue: #23921)
  • For legacy indices rewrite percolator query upon percolation time #24617 (issue: #24485)
  • Fix memory leak when percolator uses bitset or field data cache #24115 (issue: #24108)
Plugin Lang Painless
  • painless: Fix method references to ctor with the new LambdaBootstrap and cleanup code #24406
  • Fix Painless Lambdas for Java 9 #24070 (issue: #23473)
Plugins
  • X-Pack plugin download fails on Windows desktop #24570
  • Fix plugin installation permissions #24527 (issue: #24480)
  • Fix delete of plugin directory on remove plugin #24266 (issue: #24252)
  • Use a marker file when removing a plugin #24252 (issue: #24231)
  • Remove hidden file leniency from plugin service #23982 (issue: #12465)
Query DSL
  • Thread falls into infinite loop when processing Indices query #24736 (issue: #24735)
REST
  • Fix handling of exceptions thrown on HEAD requests #25172 (issue: #21125)
  • Fixed NPEs caused by requests without content. #23497 (issue: #24701)
  • Fix get mappings HEAD requests #23192 (issue: #21125)
Recovery
  • Provide target allocation id as part of start recovery request #24333 (issue: #24167)
Reindex API
  • Reindex: don’t duplicate _source parameter #24629 (issue: #24628)
  • Add qa module that tests reindex-from-remote against pre-5.0 versions of Elasticsearch #24561 (issues: #23828, #24520)
Scroll
  • Fix single shard scroll within a cluster with nodes in version >= 5.3 and <= 5.3 #24512
Search
  • Adds check for negative search request size #25397 (issue: #22530)
  • Do not search locally if remote index pattern resolves to no indices #25436 (issue: #25426)
  • Make sure range queries are correctly profiled. #25108
  • Compute the took time of the query after the expand phase of field collapsing #24902 (issue: #24900)
  • Fix RangeFieldMapper rangeQuery to properly handle relations #24808 (issue: #24744)
  • Fix ExpandSearchPhase when response contains no hits #24688 (issue: #24672)
  • Include all aliases including non-filtering in _search_shards response #24489
  • Cross Cluster Search: propagate original indices per cluster #24328
Search Templates
  • No longer add illegal content type option to stored search templates #24251 (issue: #24227)
Settings
  • Keystore CLI should use the AddFileKeyStoreCommand for files #25298
  • Settings: Fix setting groups to include secure settings #25076 (issue: #25069)
  • Allow resetting settings that use an IP validator #24713 (issue: #24709)
  • Do not set path.data in environment if not set #24132 (issue: #24099)
Snapshot/Restore
  • Output all empty snapshot info fields if in verbose mode #25455 (issue: #24477)
  • Remove redundant and broken MD5 checksum from repository-s3 #25270 (issue: #25269)
  • Consolidates the logic for cleaning up snapshots on master election #24894 (issue: #24605)
  • Removes completed snapshot from cluster state on master change #24605 (issue: #24452)
  • Fix inefficient (worst case exponential) loading of snapshot repository #24510 (issue: #24509)
  • Fixes maintaining the shards a snapshot is waiting on #24289
Stats
  • _nodes/stats should not fail due to concurrent AlreadyClosedException #25016 (issue: #23099)
  • Avoid double decrement on current query counter #24922 (issues: #22996, #24872)
Suggesters
  • Fix context suggester to read values from keyword type field #24200 (issue: #24129)
Task Manager
  • Task Management: Make TaskInfo parsing forwards compatible #24073 (issue: #23250)

Regressions

edit
Highlighting
  • Fix Fast Vector Highlighter NPE on match phrase prefix #25116 (issue: #25088)

Upgrades

edit
Core
  • Upgrade to Lucene 6.5.1 #24399
Network
  • Upgrade to Netty 4.1.11.Final #24652
  • Upgrade Netty to 4.1.10.Final #24414