Create a Mistral inference endpoint
- PUT /_inference/{task_type}/{mistral_inference_id}
Create an inference endpoint to perform an inference task with the mistral service.
Required authorization
- Cluster privileges manage_inference
Request body
-
chunking_settingsobject -
The chunking configuration object.
- Reference
-
max_chunk_sizenumber · default: 250 -
The maximum size of a chunk in words. This value cannot be higher than
300or lower than20(forsentencestrategy) or10(forwordstrategy). -
overlapnumber · default: 100 -
The number of overlapping words for chunks. It is applicable only to a
wordchunking strategy. This value cannot be higher than half themax_chunk_sizevalue. -
servicerequired -
The type of service supported for the specified task type. In this case,
mistral. -
Values:
mistral -
service_settingsobjectrequired -
Settings used to install the inference model. These settings are specific to the
mistralservice. -
api_keystringrequired -
A valid API key of your Mistral account. You can find your Mistral API keys or you can create a new one on the API Keys page.
ImportantYou need to provide the API key only once, during the inference model creation. The get inference endpoint API does not retrieve your API key.
- External docs
-
modelstringrequired -
The name of the model to use for the inference task. Refer to the Mistral models documentation for the list of available models.
- External docs
Response
-
chunking_settingsobject -
Chunking configuration object
-
max_chunk_sizenumber · default: 250 -
The maximum size of a chunk in words. This value cannot be higher than
300or lower than20(forsentencestrategy) or10(forwordstrategy). -
overlapnumber · default: 100 -
The number of overlapping words for chunks. It is applicable only to a
wordchunking strategy. This value cannot be higher than half themax_chunk_sizevalue.