Self-managed custom LLMs

Serverless Stack

You can set up connectors for self-managed LLMs to maintain more control of your data, operate in an air-gapped environment, or use specific open-source models of your choosing.

The following guides describe how to set up self-managed LLMs for Elastic Security and Observability.

Self-managed LLMs for Elastic Security:

• For production environments or air-gapped environments, you can connect to vLLM.
• For test environments, you can connect to LM Studio.

Self-managed LLMs for Observability:

• For test environments, you can connect to LM Studio.