Create an Google AI Studio inference endpoint
- PUT /_inference/{task_type}/{googleaistudio_inference_id}
Create an inference endpoint to perform an inference task with the googleaistudio service.
Required authorization
- Cluster privileges manage_inference
Request body
-
chunking_settingsobject -
The chunking configuration object.
- Reference
-
max_chunk_sizenumber · default: 250 -
The maximum size of a chunk in words. This value cannot be higher than
300or lower than20(forsentencestrategy) or10(forwordstrategy). -
overlapnumber · default: 100 -
The number of overlapping words for chunks. It is applicable only to a
wordchunking strategy. This value cannot be higher than half themax_chunk_sizevalue. -
servicerequired -
The type of service supported for the specified task type. In this case,
googleaistudio. -
Values:
googleaistudio -
service_settingsobjectrequired -
Settings used to install the inference model. These settings are specific to the
googleaistudioservice. -
model_idstringrequired -
The name of the model to use for the inference task. Refer to the Google documentation for the list of supported models.
- External docs
Response
-
chunking_settingsobject -
Chunking configuration object
-
max_chunk_sizenumber · default: 250 -
The maximum size of a chunk in words. This value cannot be higher than
300or lower than20(forsentencestrategy) or10(forwordstrategy). -
overlapnumber · default: 100 -
The number of overlapping words for chunks. It is applicable only to a
wordchunking strategy. This value cannot be higher than half themax_chunk_sizevalue.