- Enterprise Search Guide: other versions:
- Getting started
- Prerequisites
- Ingestion
- Document level security
- Web crawler
- Connectors
- Native connectors
- Connector clients
- Elastic connector framework
- Workplace Search connectors
- Using connectors
- Known issues
- Troubleshooting
- Logs
- Security
- Content syncs
- Sync rules
- Content extraction
- Reference: Azure Blob Storage
- Reference: Confluence
- Reference: Dropbox
- Reference: Google Cloud Storage
- Reference: Jira
- Reference: Microsoft SQL
- Reference: MongoDB
- Reference: MySQL
- Reference: Network drive
- Reference: Oracle
- Reference: PostgreSQL
- Reference: S3
- Reference: ServiceNow
- Reference: SharePoint Online
- Reference: SharePoint Server
- Ingestion APIs
- Ingest pipelines
- Document enrichment with ML
- ELSER text expansion
- Indices, engines, content sources
- Programming language clients
- Behavioral analytics
- Search UI
- App Search and Workplace Search
- Search Applications
- Enterprise Search server
- Run using Docker images
- Run using downloads (packages)
- Enterprise Search server known issues
- Troubleshooting
- Troubleshooting setup
- Monitoring
- Read-only mode
- Management APIs
- Monitoring APIs
- Read-only mode API
- Storage API
- Configuration
- Configuring encryption keys
- Configuring a mail service
- Configuring SSL/TLS
- Upgrading and migrating
- Upgrading self-managed deployments
- Upgrading from Enterprise Search 7.x
- Upgrading from Enterprise Search 7.11 and earlier
- Migrating from App Search on Elastic Cloud
- Migrating from App Search on Swiftype.com
- Migrating from self-managed App Search
- Logs and logging
- Known issues
- Troubleshooting
- Help, support, and feedback
- Release notes
- 8.9.2 release notes
- 8.9.1 release notes
- 8.9.0 release notes
- 8.8.2 release notes
- 8.8.1 release notes
- 8.8.0 release notes
- 8.7.1 release notes
- 8.7.0 release notes
- 8.6.2 release notes
- 8.6.1 release notes
- 8.6.0 release notes
- 8.5.3 release notes
- 8.5.2 release notes
- 8.5.1 release notes
- 8.5.0 release notes
- 8.4.3 release notes
- 8.4.2 release notes
- 8.4.1 release notes
- 8.4.0 release notes
- 8.3.3 release notes
- 8.3.2 release notes
- 8.3.1 release notes
- 8.3.0 release notes
- 8.2.3 release notes
- 8.2.2 release notes
- 8.2.1 release notes
- 8.2.0 release notes
- 8.1.3 release notes
- 8.1.2 release notes
- 8.1.1 release notes
- 8.1.0 release notes
- 8.0.1 release notes
- 8.0.0 release notes
- 8.0.0-rc2 release notes
- 8.0.0-rc1 release notes
- 8.0.0-beta1 release notes
- 8.0.0-alpha2 release notes
- 8.0.0-alpha1 release notes
8.9.0 release notes
edit8.9.0 release notes
editUpgrading to Enterprise Search 8.9.0? See Upgrading and migrating.
Breaking changes
edit-
Running self-managed connectors in "native" mode is deprecated starting in 8.9.0.
- Create new native connectors exclusively on Elastic Cloud.
- Convert existing self-managed connectors running in native mode to connector clients.
make run
no longer works on a fresh clone of the connectors-python
repo.
If you have an unmodified default configuration, you will be prompted to modify the placeholder changeme
value for connector_id
and service_type
.
Modify these values in your config.yml
file, before starting your connector service.
-
As of 8.9.0, the original SharePoint connector now supports only SharePoint Server.
- For new SharePoint Online use cases, refer to the new SharePoint Online connector.
New features
edit-
We’ve added a new Elasticsearch Relevance Engine (ESRE) getting started page to Enterprise Search.
- Get up and running quickly with semantic search powered by Elastic Learned Sparse Encoder, without the need to call third-party APIs or generate your own embeddings.
- You can now quickly build hybrid search experiences by combining lexical search and semantic search, using reciprocal rank fusion (RRF) with sub searches. RRF provides best-in-class hybrid scoring out of the box, without the need to write custom scoring functions or tweak model parameters.
- Read the Elasticsearch Relevance Engine (ESRE) documentation to learn all about our AI and machine learning powered features, and ask questions on our new ESRE Discuss forum.
- Check out the Elasticsearch labs repository, which contains sample apps and executable Python notebooks you can test for yourself.
-
New Microsoft E5 embedding model support is now available.
- Upload and manage E5 embedding models for semantic search including multilingual search use cases.
-
Our new SharePoint Online connector is generally available as both a native connector and a connector client. The following features are available for this connector by default:
- Document level security (DLS)
- Local content extraction of large files for self managed connector clients
- Incremental sync support helps speed up and simplify data updates
- Advanced sync rules support
-
Document level security (DLS):
- We’ve upgraded the connectors framework to make it easier for developers to include DLS features in their own customized connectors.
- Available by default for the SharePoint Online connector in 8.9.
-
Content extraction for large files (technical preview)
- Extract large files by running a local service that allows connectors-python to extract text on-the-fly without sending files to the default ingest pipeline.
- Available only for the SharePoint Online connector client in 8.9.
- We’ve enhanced the connector framework with incremental sync support to make it easier for developers to speed up and simplify updates for customized connectors. Incremental sync is supported out of the box for SharePoint Online in 8.9.
-
We’ve added the following brand new connectors, available as self-managed connector clients in 8.9.0:
- ServiceNow connector client (beta)
- Dropbox connector client (beta)
-
Search Applications have moved from tech preview to beta. We’ve introduced the following new features:
- Secure your public search endpoint by creating a scoped, search-only API key. This simplifies building validation flows and managing public access to your search applications.
- Use our new Javascript client (technical preview) to manage your search application. Refer to this how-to guide to building a search experience with a search application using the client. Read our how to guide to learn more.
- Developers can now combine searches like kNN and ELSER text expansion with traditional text search using reciprocal rank fusion (RRF). Refer to this search template example.
- The Dev Tools Console now has autocomplete support for Search Application and Behavioral Analytics APIs.
Bug fixes
edit- Fixed an issue where users were unable to complete configuration of the PostgresSQL connector client due to a mislabeled config key.
Known issues
edit-
The following native connectors will not run correctly on Elastic Cloud in 8.9.0. They continue to be available as self-managed connector clients.
- Azure Blob Storage
- Confluence Cloud & Server
- Jira Cloud & Server
-
Workaround: Use the
Convert connector
button from the connector’s configuration page to convert the native connector to a connector client, to be run locally in a self-managed environment. (This issue will be fixed in 8.9.1.)
Refer to the Enterprise Search Known issues for a full list of known issues and workarounds.