Loading

stack es inference put-openshift-ai cli command

Auth required Idempotent Scope: global
elastic stack es inference put-openshift-ai \
  --task-type <task-type> \
  --openshiftai-inference-id <openshiftai-inference-id> \
  --service <service> \
  --service-settings <service-settings> \
  [options]
		

Create an OpenShift AI inference endpoint.

Behaviour flags:

--dry-run — validate all inputs and exit without performing any action

--task-type enum required

The type of the inference task that the model will perform. NOTE: The chat_completion task type only supports streaming and only through the _stream API.

Values: text_embedding, completion, chat_completion, rerank

--openshiftai-inference-id string required
The unique identifier of the inference endpoint.
--service enum required

The type of service supported for the specified task type. In this case, openshift_ai.

Values: openshift_ai

--service-settings string required
Settings used to install the inference model. These settings are specific to the openshift_ai service.
--timeout string
Specifies the amount of time to wait for the inference endpoint to be created.
--chunking-settings string
The chunking configuration object. Applies only to the text_embedding task type. Not applicable to the rerank, completion, or chat_completion task types.
--task-settings string
Settings to configure the inference task. Applies only to the rerank task type. Not applicable to the text_embedding, completion, or chat_completion task types. These settings are specific to the task type you specified.
--input-file string
path to a JSON file to use as command input
--[no-]dry-run
validate all inputs and exit without performing any action (preview changes without applying them)
--[no-]json

output as JSON