Deserialize

Deserialize a model config from a .prompt file format.

Authentication

X-API-KEYstring
API Key authentication via header

Request

This endpoint expects an object.
configstringRequired

Response

Successful Response
idstring

String ID of config. Starts with config_.

modelstring

The model instance used. E.g. text-davinci-002.

othermap from strings to any
Other parameter values to be passed to the provider call.
namestring
A friendly display name for the model config. If not provided, a name will be generated.
descriptionstring
A description of the model config.
providerenum
The company providing the underlying model service.
max_tokensintegerDefaults to -1

The maximum number of tokens to generate. Provide max_tokens=-1 to dynamically calculate the maximum number of tokens to generate given the length of the prompt

temperaturedoubleDefaults to 1
What sampling temperature to use when making a generation. Higher values means the model will be more creative.
top_pdoubleDefaults to 1

An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass.

stopstring or list of strings

The string (or list of strings) after which the model will stop generating. The returned text will not contain the stop sequence.

presence_penaltydoubleDefaults to 0

Number between -2.0 and 2.0. Positive values penalize new tokens based on whether they appear in the generation so far.

frequency_penaltydoubleDefaults to 0

Number between -2.0 and 2.0. Positive values penalize new tokens based on how frequently they appear in the generation so far.

seedinteger
If specified, model will make a best effort to sample deterministically, but it is not guaranteed.
response_formatobject

The format of the response. Only type json_object is currently supported for chat.

reasoning_effortenum or integer

Guidance on how many reasoning tokens it should generate before creating a response to the prompt. OpenAI reasoning models (o1, o3-mini) expect a OpenAIReasoningEffort enum. Anthropic reasoning models expect an integer, which signifies the maximum token budget.

template_languageenum
The template language to use for rendering the template.
Allowed values:
prompt_templatestring

Prompt template that will take your specified inputs to form your final request to the model. NB: Input variables within the prompt template should be specified with syntax: {{input_name}}.

chat_templatelist of objects

Messages prepended to the list of messages sent to the provider. These messages that will take your specified inputs to form your final request to the provider model. NB: Input variables within the template should be specified with syntax: {{input_name}}.

toolslist of objects
Tools shown to the model.
endpointenum
The provider model endpoint used.
Allowed values:
tool_configslist of objectsDeprecated

NB: Deprecated with tools field. Definition of tools shown to the model.

Errors

422
Model Configs Deserialize Request Unprocessable Entity Error