Evaluate a trained model

Auth

Path parameters

model_id string required

The unique identifier of the trained model.

Query parameters

timeout string · default: 10s

Controls the amount of time to wait for inference results.

Request body

docs string to object[] required

An array of objects to pass to the model for inference. The objects should contain a fields matching your configured trained model input. Typically, for NLP models, the field name is text_field. Currently, for NLP models, only a single value is allowed.

inference_config object

The inference configuration updates to apply on the API call

regression object

Regression configuration for inference.

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

num_top_feature_importance_values number · default: 0

Specifies the maximum number of feature importance values per document.

classification object

Classification configuration for inference.

num_top_classes number

Specifies the number of top class predictions to return. Defaults to 0.

num_top_feature_importance_values number · default: 0

Specifies the maximum number of feature importance values per document.

prediction_field_type string

Specifies the type of the predicted field to write. Acceptable values are: string, number, boolean. When boolean is provided 1.0 is transformed to true and 0.0 to false.

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

top_classes_results_field string

Specifies the field to which the top classes are written. Defaults to top_classes.

text_classification object

Text classification configuration for inference.

num_top_classes number

Specifies the number of top class predictions to return. Defaults to 0.

tokenization object

The tokenization options to update when inferring

truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

classification_labels string[]

Classification labels to apply other than the stored labels. Must have the same deminsions as the default configured labels

zero_shot_classification object

Zeroshot classification configuration for inference.

tokenization object

The tokenization options to update when inferring

truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

multi_label boolean

Update the configured multi label option. Indicates if more than one true label exists. Defaults to the configured value.

labels string[] required

The labels to predict.

fill_mask object

Fill mask configuration for inference.

num_top_classes number

Specifies the number of top class predictions to return. Defaults to 0.

tokenization object

The tokenization options to update when inferring

truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

ner object

Named entity recognition configuration for inference.

tokenization object

The tokenization options to update when inferring

truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

pass_through object

Pass through configuration for inference.

tokenization object

The tokenization options to update when inferring

truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

text_embedding object

Text embedding configuration for inference.

tokenization object
truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

text_expansion object

Text expansion configuration for inference.

tokenization object
truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

question_answering object

Question answering configuration for inference

question string required

The question to answer given the inference context

num_top_classes number

Specifies the number of top class predictions to return. Defaults to 0.

tokenization object

The tokenization options to update when inferring

truncate enum

Truncate options to apply

Values: first second none
span number

Span options to apply

results_field string

The field that is added to incoming documents to contain the inference prediction. Defaults to predicted_value.

max_answer_length number

The maximum answer length to consider for extraction

Response

application/json
inference_results object[] required
entities object[]

If the model is trained for named entity recognition (NER) tasks, the response contains the recognized entities.

class_name string required
class_probability number required
entity string required
start_pos number required
end_pos number required
is_truncated boolean

Indicates whether the input text was truncated to meet the model's maximum sequence length limit. This property is present only when it is true.

predicted_value union oneOf nullable

If the model is trained for a text classification or zero shot classification task, the response is the predicted class. For named entity recognition (NER) tasks, it contains the annotated text output. For fill mask tasks, it contains the top prediction for replacing the mask token. For text embedding tasks, it contains the raw numerical text embedding values. For regression models, its a numerical value For classification models, it may be an integer, double, boolean or string depending on prediction type

One of: union[] or union
predicted_value_sequence string

For fill mask tasks, the response contains the input text sequence with the mask token replaced by the predicted value. Additionally

prediction_probability number

Specifies a probability for the predicted value.

prediction_score number

Specifies a confidence score for the predicted value.

top_classes object[]

For fill mask, text classification, and zero shot classification tasks, the response contains a list of top class entries.

class_name string required
class_probability number required
class_score number required
warning string

If the request failed, the response contains the reason for the failure.

feature_importance object[]

The feature importance for the inference results. Relevant only for classification or regression models

feature_name string required
importance number
classes object[]
class_name string required
importance number required