Overview
Create a model response in the OpenAI Responses shape for models that support it, stateless: a drop-in for the OpenAI SDKs and Codex. Served by the inference endpoint (inference.openrelay.inc).
Responses
Create a model response in the OpenAI Responses shape for models that support it, stateless: a drop-in for the OpenAI SDKs and Codex. Served by the inference endpoint (inference.openrelay.inc).
Generate a message (Anthropic-compatible) POST
Generates a model response in the Anthropic Messages shape, a drop-in for the Anthropic SDKs and Claude Code on models that support messages. Messages is a second online family alongside Chat Completions; check a model's supported_apis on GET /v1/models before calling it rather than assuming. Requires a funded balance. Send the API key as x-api-key (the Anthropic SDK convention) or as Authorization Bearer; either is accepted. Set "stream" to true for event-typed Server-Sent Events (message_start, content_block_delta, message_stop, and so on). The request body is capped at 10 MiB.
Create a model response (OpenAI Responses) POST
Generates a model response in the OpenAI Responses shape for the OpenAI SDKs and Codex. Check a model's supported_apis on GET /v1/models first. Stateless: the gateway sends store false and refuses previous_response_id, conversation, background, stored prompts, item references and file inputs (400 unsupported_parameter). Send the full conversation in input on every turn. Client-executed tools (function, custom, namespace, client tool_search) are forwarded; hosted web_search is removed and every other hosted tool is refused (400 unsupported_tool_type). Requires a funded balance. Set "stream" to true for event-typed Server-Sent Events (response.created, response.output_text.delta, response.completed, and so on); a stream carries no [DONE] line. The request body is capped at 10 MiB.