New

The executive guide to generative AI

Read more

Detections and alerts

edit

Use the detection engine to create and manage rules and view the alerts these rules create. Rules periodically search indices (such as logs-* and filebeat-*) for suspicious source events and create alerts when a rule’s conditions are met. When an alert is created, its status is Open. To help track investigations, an alert’s status can be set as Open, Acknowledged, or Closed.

Alerts page

In addition to creating your own rules, enable Elastic prebuilt rules to immediately start detecting suspicious activity. For detailed information on all the prebuilt rules, see the Prebuilt rule reference section. Once the prebuilt rules are loaded and running, Tune detection rules and Add and manage exceptions explain how to modify the rules to reduce false positives and get a better set of actionable alerts. You can also use exceptions and value lists when creating or modifying your own rules.

There are several special prebuilt rules you need to know about:

  • Endpoint protection rules: Automatically create alerts based on Elastic Defend’s threat monitoring and prevention.
  • External Alerts: Automatically creates an alert for all incoming third-party system alerts (for example, Suricata alerts).

If you want to receive notifications via external systems, such as Slack or email, when alerts are created, use the Kibana Alerting and Actions framework.

To use Kibana Alerting for detection alert notifications, you need the appropriate license.

After rules have started running, you can monitor their executions to verify they are functioning correctly, as well as view, manage, and troubleshoot alerts (see Manage detection alerts and Monitor and troubleshoot rule executions).

You can create and manage rules and alerts via the UI or the Detections API.

To make sure you can access Detections and manage rules, see Detections requirements.

Compatibility with cold and frozen tier nodes

edit

Cold and frozen data tiers hold time series data that is only accessed occasionally. In Elastic Stack version >=7.11.0, Elastic Security supports cold but not frozen tier data for the following Elasticsearch indices:

  • Index patterns specified in securitySolution:defaultIndex
  • Index patterns specified in the definitions of detection rules, except for indicator match rules
  • Index patterns specified in the data sources selector on various Elastic Security app pages

Elastic Security does NOT support either cold or frozen tier data for the following Elasticsearch indices:

  • Index patterns controlled by Elastic Security, including alerts and list indices
  • Index patterns specified in the definition of indicator match rules

Using either cold or frozen tier data for unsupported indices may result in detection rule timeouts and overall performance degradation.

Limited support for indicator match rules

edit

Indicator match rules provide a powerful capability to search your security data; however, their queries can consume significant deployment resources. When creating an indicator match rule, we recommend limiting the time range of the indicator index query to the minimum period necessary for the desired rule coverage. For example, the default indicator index query @timestamp > "now-30d/d" searches specified indicator indices for indicators ingested during the past 30 days and rounds the query start time down to the nearest day (resolves to UTC 00:00:00). Without this limitation, the rule will include all of the indicators in your indicator indices, which may extend the time it takes for the indicator index query to complete.

In addition, the following support restrictions are in place:

  • Indicator match rules don’t support cold or frozen data. Cold or frozen data in indices queried by indicator match rules must be older than the time range queried by the rule. If your data’s timestamps are unreliable, you can exclude cold and frozen tier data using a Query DSL filter.
  • Indicator match rules with an additional look-back time value greater than 24 hours are not supported.

Detections configuration and index privilege prerequisites

edit

Detections requirements provides detailed information on all the permissions required to initiate and use the Detections feature.

Resolve UI error messages

edit

Depending on your privileges and whether detection system indices have already been created for the Kibana space, you might get one of these error messages when you open the Alerts or Rules page: