Parameters
Supported request parameters.
The following parameters are forwarded to the model. Support varies per model - check supported_parameters on the model object.
| Parameter | Type | Description |
|---|---|---|
model | string | Model id (required) |
messages | array | Conversation messages (required) |
stream | boolean | Stream tokens via SSE |
temperature | number | 0–2, sampling randomness |
top_p | number | Nucleus sampling |
max_tokens | integer | Max output tokens |
stop | string[] | Stop sequences |
tools | array | Function/tool definitions |
response_format | object | Structured output / JSON mode |