New

The executive guide to generative AI

Read more
About usPartnersSupport|Login
IMPORTANT: No additional bug fixes or documentation updates will be released for this version. For the latest information, see the current release documentation.
« Set up connectors for large language models (LLM) Connect to Azure OpenAI »
Elastic Docs ›Elastic Security Solution [8.14] ›AI for security ›Set up connectors for large language models (LLM)

Large language model performance matrix

edit
IMPORTANT: This documentation is no longer updated. Refer to Elastic's version policy and the latest documentation.

Large language model performance matrix

edit

This table describes the performance of various large language models (LLMs) for different use cases in Elastic Security, based on our internal testing. To learn more about these use cases, refer to Attack discovery or AI Assistant.

Feature Model

Claude 3: Opus

Claude 3.5: Sonnet

Claude 3: Haiku

GPT-4o

GPT-4 Turbo

Assistant - General

Excellent

Excellent

Excellent

Excellent

Excellent

Assistant - ES|QL generation

Great

Great

Poor

Excellent

Poor

Assistant - Alert questions

Excellent

Excellent

Excellent

Excellent

Poor

Attack discovery

Excellent

Excellent

Poor

Poor

Good
« Set up connectors for large language models (LLM) Connect to Azure OpenAI »
Was this helpful?
Feedback