Skip to main content
POST
LLM Chat Completion

Body

application/json
projectId
string
required

Project ID

provider
enum<string>
required

LLM provider

Available options:
openai,
anthropic,
bedrock,
groq,
gemini,
xai,
custom
model
string
required

Model name

Example:

"gpt-4"

messages
object[]
required

Messages

providerName
string

Provider name (configured in LLM Providers)

Example:

"OpenAI Production"

legacy
boolean

Use legacy Chat Completions API when true

Example:

true

instructions
string

System instructions

temperature
number

Temperature

Required range: 0 <= x <= 2
Example:

0.7

maxTokens
number

Max tokens

Example:

1000

topP
number

Top P (nucleus sampling)

Required range: 0 <= x <= 1
Example:

0.9

frequencyPenalty
number

Frequency penalty

Required range: -2 <= x <= 2
Example:

0.3

presencePenalty
number

Presence penalty

Required range: -2 <= x <= 2
Example:

0.2

stop
string[]

Stop sequences

Example:
seed
number

Seed for reproducible outputs

Example:

12345

tools
object[]

Tools available for the model to call

responseFormat
object

Response format for structured output

Example:
thinking
object

Enable extended thinking/reasoning for supported models

Example:
serverTools
string[]

Server-side tools (provider-specific). Anthropic: web_search, code_execution

Example:

Response

ChatResponse: { text, finishReason, usage: { promptTokens, completionTokens, totalTokens }, model, toolCalls? }.