What’s new in 8.13
editWhat’s new in 8.13
editComing in 8.13.
Here are the highlights of what’s new and improved in Elasticsearch 8.13! For detailed information about this release, see the Release notes and Migration guide.
Other versions:
8.12 | 8.11 | 8.10 | 8.9 | 8.8 | 8.7 | 8.6 | 8.5 | 8.4 | 8.3 | 8.2 | 8.1 | 8.0
Improve storage efficiency for non-metric fields in TSDB
editAdds a new doc_values
encoding for non-metric fields in TSDB that takes advantage of TSDB’s index sorting.
While terms that are used in multiple documents (such as the host name) are already stored only once in the terms dictionary,
there are a lot of repetitions in the references to the terms dictionary that are stored in doc_values
(ordinals).
In TSDB, documents (and therefore doc_values
) are implicitly sorted by dimenstions and timestamp.
This means that for each time series, we are storing long consecutive runs of the same ordinal.
With this change, we are introducing an encoding that detects and efficiently stores runs of the same value (such as 1 1 1 2 2 2 …
),
and runs of cycling values (such as 1 2 1 2 …
).
In our testing, we have seen a reduction in storage size by about 13%.
The effectiveness of this encoding depends on how many non-metric fields, such as dimensions, are used.
The more non-metric fields, the more effective this improvement will be.
GA Release of Synonyms API
editRemoves the beta label for the Synonyms API to make it GA.
Flag in _field_caps
to return only fields with values in index
editWe added support for filtering the field capabilities API output by removing
fields that don’t have a value. This can be done through the newly added
include_empty_fields
parameter, which defaults to true.
New Lucene 9.10 release
edit- https://github.com/apache/lucene/pull/13090: Prevent humongous allocations in ScalarQuantizer when building quantiles.
- https://github.com/apache/lucene/pull/12962: Speedup concurrent multi-segment HNSW graph search
-
https://github.com/apache/lucene/pull/13033: Range queries on numeric/date/ip fields now exit earlier on segments whose values don’t intersect with the query range. This should especially help when there are other required clauses in the
bool
query and when the range filter is narrow, e.g. filtering on the last 5 minutes. -
https://github.com/apache/lucene/pull/13026:
bool
queries that mixfilter
andshould
clauses will now propagate minimum competitive scores through theshould
clauses. This should yield speedups when sorting by descending score.