﻿---
title: Configure access to LLMs
description: Elastic's AI features work with the out-of-the-box Elastic Managed LLMs or with third-party LLMs configured using one of the available connectors. While...
url: https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features/llm-guides/llm-connectors
products:
  - Elastic Cloud Serverless
  - Elastic Observability
  - Elastic Security
  - Elasticsearch
applies_to:
  - Elastic Cloud Serverless: Generally available
  - Elastic Stack: Generally available
---

# Configure access to LLMs
Elastic's [AI features](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features) work with the out-of-the-box Elastic Managed LLMs or with third-party LLMs configured using one of the available connectors.

## Elastic Managed LLMs

[Elastic Managed LLMs](https://docs-v3-preview.elastic.dev/elastic/kibana/tree/main/reference/connectors-kibana/elastic-managed-llm) are available in Kibana deployments and serverless projects with an appropriate [subscription or feature tier](https://www.elastic.co/pricing). They provide immediate access to generative AI features without requiring any setup or external model integration.
Elastic Managed LLMs are available out-of-the box. They do not require manual configuration or API key management. Alternatively, you can configure and use third-party LLM connectors, such as OpenAI, Azure, or Amazon Bedrock.
To learn more about security and data privacy, refer to [Elastic Managed LLMs](https://docs-v3-preview.elastic.dev/elastic/kibana/tree/main/reference/connectors-kibana/elastic-managed-llm) which provides details on the models.
<important>
  Using Elastic Managed LLMs incurs additional costs. Refer to [Elastic Cloud pricing](https://www.elastic.co/pricing/serverless-search) for more information.
</important>


## Tested models and performance ratings

While connectors let you connect to a wide range of LLMs, model performance varies by solution and use case. Refer to the following pages for performance information for models Elastic has tested:
- [LLM performance matrix for Observability](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/solutions/observability/ai/llm-performance-matrix)
- [LLM performance matrix for Elastic Security](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/solutions/security/ai/large-language-model-performance-matrix)
- [Recommended models for Elastic Agent Builder](/elastic/docs-content/pull/7414/explore-analyze/ai-features/agent-builder/models#recommended-models)

<note>
  Models that do not appear in these resources may still work, but Elastic hasn't tested them for those scenarios. We recommend selecting a model with strong ratings for your intended use case.
</note>


## Connect to a third-party or self-managed LLM

<important applies-to="Elastic Cloud Serverless: Removed, Elastic Stack: Planned for removal, Elastic Stack: Planned for deprecation">
  The OpenAI, Amazon Bedrock, Google Gemini, and Elastic Inference connector types are deprecated. Existing connectors of these types and rule actions that use them continue to work but display deprecation indicators. Follow the guidance that matches your version and deployment type:
  - <applies-to>Elastic Cloud Serverless: Removed</applies-to> <applies-to>Elastic Stack: Planned for removal</applies-to> You cannot create new LLM connectors through the standard connector UI.
  - <applies-to>Elastic Stack: Planned for deprecation</applies-to> For new AI integrations, use Elasticsearch inference endpoints instead of LLM connectors. Plan migration of existing LLM connectors and any rule actions that reference them before future removal.
</important>

Follow these guides to connect to one or more third-party LLM providers:
- [Azure OpenAI](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features/llm-guides/connect-to-azure-openai)
- [Amazon Bedrock](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features/llm-guides/connect-to-amazon-bedrock)
- [OpenAI](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features/llm-guides/connect-to-openai)
- [Google Vertex](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features/llm-guides/connect-to-google-vertex)
- [Self-managed LLMs](https://docs-v3-preview.elastic.dev/elastic/docs-content/pull/7414/explore-analyze/ai-features/llm-guides/local-llms-overview)


## Preconfigured connectors

<applies-to>
  - Elastic Cloud Serverless: Unavailable
  - Elastic Stack: Generally available
</applies-to>

You can also use [preconfigured connectors](https://docs-v3-preview.elastic.dev/elastic/kibana/tree/main/reference/connectors-kibana/pre-configured-connectors) to set up third-party LLM connectors by editing the `kibana.yml` file. This allows you enable a connector for multiple spaces at once, without performing set up in the Kibana UI for each space.
If you use a preconfigured connector for your LLM connector, we recommend adding the `exposeConfig: true` parameter to the `xpack.actions.preconfigured` section of the `kibana.yml` config file. This parameter makes debugging easier by adding configuration information to the debug logs, including which LLM the connector uses.