Overview
Generate a model response in the Anthropic Messages shape for models that support it: a drop-in for the Anthropic SDKs and Claude Code. Served by the inference endpoint (inference.openrelay.inc).
Messages
Generate a model response in the Anthropic Messages shape for models that support it: a drop-in for the Anthropic SDKs and Claude Code. Served by the inference endpoint (inference.openrelay.inc).
Generate a chat completion POST
Generates a model response for a conversation in the OpenAI Chat Completions shape, from any model whose supported APIs include chat completions. The hand-written `orl chat` is the friendlier front for this operation: model name completion, a readable transcript, and streaming output rendered to the terminal. Requires a funded balance. Set "stream" to true to receive the completion incrementally as Server-Sent Events, ending with a `data: [DONE]` sentinel. The request body is capped at 10 MiB.
Generate a message (Anthropic-compatible) POST
Generates a model response in the Anthropic Messages shape, a drop-in for the Anthropic SDKs and Claude Code on models that support messages. Messages is a second online family alongside Chat Completions; check a model's supported_apis on GET /v1/models before calling it rather than assuming. Requires a funded balance. Send the API key as x-api-key (the Anthropic SDK convention) or as Authorization Bearer; either is accepted. Set "stream" to true for event-typed Server-Sent Events (message_start, content_block_delta, message_stop, and so on). The request body is capped at 10 MiB.