Enhancements and bug fixes - Early May 2024

The following changes are included in this release.

Add new designs to the trial onboarding flow. Adds new designs to the trial onboarding flow

Allow to specify which fields to return in deployment searches in order to handle searching for more deployments. The new query parameter minimal_metadata when searching for deployments allows retrieving only a subset of the fields for each deployment found. This is particularly useful retrieving many hits in one response.

BYOK: Create and View only. Bring Your Own Key (BYOK) UI for creating a deployment and then viewing the key afterwards

Deep-links to Security Hub when users choose "Security" as their use case and when the chosen stack version is 8.13.0+. Deep-links to Security Hub when users choose "Security" as their use case and when the chosen stack version is 8.13.0+.

Switch from performance_control to search_lake. The UI now uses the search_lake field instead of the deprecated performance_control field, for those project types that support it.

[ML] Add ml-gitops-managed tags to ML assets and update "Starting elasticsearch" rule to alert on status change. This PR adds ml-gitops-managed tags to ML assets and updates "Starting elasticsearch" rule to alert on status change

[ML] Update ML assets with "ml-gitops-managed" tag. This PR updates ML assets with "ml-gitops-managed" tag

Remove unused endpoints, get connection_id on health checks. Set connection_id everywhere for easier Proxy request tracking. Remove legacy health check endpoints /__elb_health__/zk and /_health/zk as duplicates of /__elb_health__ and /_health, which are duplicates of each other but both currently used.

[Kibana Reporting / CSV] Support for xpack.reporting.csv.enablePanelActionDownload. Added support for xpack.reporting.csv.enablePanelActionDownload in Kibana User Settings. This allows the cluster to use deprecated functionality for exporting data as CSV file from a saved search dashboard panel without generating a report. We recommend using the default setting, which is false which allows users to generate a CSV reports that are downloadable from Stack Management > Reporting.

[Kibana Reporting / CSV] Support for xpack.reporting.csv.enablePanelActionDownload. Added support for xpack.reporting.csv.enablePanelActionDownload in Kibana User Settings. This allows the cluster to use deprecated functionality for exporting data as CSV file from a saved search dashboard panel without generating a report. We recommend using the default setting, which is false which allows users to generate a CSV reports that are downloadable from Stack Management > Reporting.

Fix ML dashboards type migration. Fix ML dashboards type migration causing issues in production environment

Revert removal of restoreSourcesListFile filter. Reverts the removal of the restoreSourcesListFile filter that was mistakenly introduced in PR #125837

Only backup sources.list if it exists. Fixes the issue where some Ubuntu images (such as python) lack the main sources.list file causing dockerBaseImageBuild to fail

Always show deployment settings, because autoops status is not optional. Deployment settings should be included in responses, also when autoops status is the only non-null setting

Redirect to security hub only if use case is security [#125424]. Fixes a bug that causes all deployments to be directed to the security hub when the corresponding flag is enabled

Fix RCS 1.0 self-managed bug for display. Fixing a display bug where self-managed, certificate based trusted environments were being shown as API Keys instead of Certificate based in the UI

[region build] update docs for aws-eu-central-2 and gcp-me-west1. Αdds the Cloud docs for AWS Zurich eu-central-2.

"Elasticsearch Service is now available in the AWS region Zurich (eu-central-2). You can select the new region when you create new deployments."

Αdds the Cloud docs for GCP Tel Aviv me-west1.

"Elasticsearch Service is now available in the GCP region Tel Aviv (me-west1). You can select the new region when you create new deployments."