--- title: Add and manage AI index sources description: Add Elasticsearch data or connector sources to an AI index, then replace or remove them as its scope changes. url: https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/add-and-manage-sources products: - Elastic Documentation - Elastic Observability - Elastic Security - Elasticsearch - Kibana applies_to: - Elastic Cloud Serverless: Experimental - Elastic Stack: Planned --- # Add and manage AI index sources This page is currently hidden from the documentation navigation.The following Context Engine pages are live: - [Landing page](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine) - [Get started with Context Engine](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/quickstart) - [Context Engine concepts](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/concepts) - [Build and maintain an AI index](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/build-and-maintain-ai-index) - [Create and manage AI indices](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/create-and-manage-ai-indices) - [Add and manage sources](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/add-and-manage-sources) - [Create and manage automations](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/create-and-manage-automations) - [Evaluate and improve KIs](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/evaluate-and-improve-knowledge-indicators) - [Use Context Engine with agents and applications](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/use-context-engine-with-agents) - [Use Context Engine with Agent Builder](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/use-context-engine-with-agent-builder) - [Query AI indices from LangChain](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/langchain-integration) - [Context Engine APIs](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/context-engine-api) Sources identify the data that an AI index is intended to use. They also give Elastic Agent Builder the starting point for suggested automations. Add sources in Kibana or manage them programmatically with the Context Engine APIs. Update the selection when the intended scope of the AI index changes. The source editor in Kibana has tabs for Elasticsearch data and connectors: ![AI index source editor showing the Elasticsearch data tab, index picker, and Advanced ES|QL section](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/images/select-elasticsearch-source.png) ## Before you begin You need a custom AI index and the **All** privilege for the **Context Engine** feature. You also need access to the Elasticsearch data or connectors you want to select. To create a connector from the source picker, you need permission to create connectors. Choose data that supports the AI index's purpose and intended questions. For design guidance, refer to [Select source data](/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/build-and-maintain-ai-index#select-source-data). ## Add an Elasticsearch index, data stream, or alias Use the index picker when the automation should have access to all documents in one Elasticsearch index, data stream, or alias. Selecting one creates an ES|QL source in the form `FROM `. Add the source as follows: 1. Open **Context**, then select the AI index. 2. In **Sources**, select **Edit**. 3. On the **Elasticsearch data** tab, start typing the name of an index, data stream, or alias. 4. Select a result. The source appears under **Selected sources**. 5. Add any other sources the automations need, then select **Save**. 6. Confirm that the selected source appears in the AI index's **Sources** section. ## Add an advanced ES|QL source Use an ES|QL query when the automation should analyze a filtered or transformed result, or data from more than one Elasticsearch index: 1. Open the AI index's **Sources** editor. 2. On the **Elasticsearch data** tab, expand **Advanced: ES|QL**. 3. Enter the query that defines the data available to the automation. For example: ```esql FROM logs-* | WHERE event.outcome == "failure" | LIMIT 100 ``` 4. Select **Add ES|QL source**. 5. Confirm that the query appears under **Selected sources**, then select **Save**. The query records the intended scope of the source and gives Elastic Agent Builder a result to inspect when it suggests an automation. A generated workflow can add mapping, aggregation, or other queries against the underlying Elasticsearch data. Review those queries to confirm that they stay within the intended scope. Saving the source checks that its query syntax is valid, but you should also run it against your data and inspect the result. ## Add a connector source Add data from a supported external system as follows: 1. Open the AI index's **Sources** editor. 2. Select the **Connectors** tab. 3. Search for and select each configured connector that the automation should use. 4. If the connector does not exist and you have permission to create it, select **Create connector**, configure it, and save it. The new connector is selected automatically. 5. Confirm that the connectors appear under **Selected sources**, then select **Save**. The picker lists only connector types that support Context Engine and only connectors that you can access. ## Replace or remove sources Update the source selection as follows: 1. Open the AI index's **Sources** editor. 2. Under **Selected sources**, remove any source that is no longer in scope. 3. Add its replacement or any additional sources. 4. Select **Save**. 5. Confirm that the **Sources** section shows the intended selection. Changing the source selection does not update attached workflow automations or Knowledge Indicators (KIs) generated by earlier runs. Review each workflow for queries or connector references that also need to change, run the updated automations, and [evaluate the resulting KIs](https://www.elastic.co/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/evaluate-and-improve-knowledge-indicators). ## Manage sources with the API Use the [create or update AI index API](https://www.elastic.co/docs/api/doc/kibana/operation/operation-put-context-engine-ai-index-aiindexid) to replace the sources programmatically. Each source has a `type` and `value`: - For an ES|QL source, set `type` to `esql` and `value` to the complete query. - For a connector source, set `type` to `connector` and `value` to the connector ID. For example, the following partial AI index document combines both source types: ```json { "sources": [ { "type": "esql", "value": "FROM support-cases | WHERE status == \"open\"" }, { "type": "connector", "value": "my-connector-id" } ] } ``` The update API replaces the complete AI index record, not only its sources. For an example that preserves the other fields, refer to [Update an AI index with the API](/elastic/docs-builder/docs/4300/explore-analyze/ai-features/context-engine/create-and-manage-ai-indices#update-ai-index-api).