Skip to content
OpenRelay is in early access, and the /v1 API is stable. New capabilities ship in the changelog.
Inference API

Models

List available models with GET /v1/models and the OpenRelay public model ids you can request.

Models are addressed by their public OpenRelay id. Use a model id in the model field of a chat completion or a message.

List models

GET https://api.openrelay.inc/v1/models

Requires an API key (see Authentication). This endpoint is free — it is not balance-gated. Model discovery is served by the control plane (api.openrelay.inc); inference itself runs on inference.openrelay.inc.

curl https://api.openrelay.inc/v1/models \
  -H "Authorization: Bearer $OPENRELAY_API_KEY"

The response is an OpenAI-style list object:

{
  "object": "list",
  "data": [
    {
      "id": "openrelay/gpt-oss-120b",
      "object": "model",
      "created": 1767322800,
      "owned_by": "openrelay",
      "supported_apis": ["chat_completions"],
      "modalities": { "input": ["text"], "output": ["text"] },
      "status": "available"
    },
    {
      "id": "openrelay/flux-image",
      "object": "model",
      "created": 1767322800,
      "owned_by": "openrelay",
      "supported_apis": ["images"],
      "modalities": { "input": ["text"], "output": ["image"] },
      "status": "request_access"
    }
  ]
}
FieldDescription
idThe public model id to put in model.
createdUnix timestamp (seconds) the model was added to the catalog.
owned_byAlways openrelay.
supported_apisThe API families this model serves (e.g. chat_completions, messages, images). Check this field to see whether a model supports Messages; not every model does.
modalitiesWhat the model accepts and produces — { "input": [...], "output": [...] }. Values are free-form (text, image, audio, video, …), so a text→image, image→image, vision (image→text), or video/world model is expressed without any special-casing.
statusavailable (usable now) or request_access (listed for discovery but not yet generally available).

request_access models appear in the catalog so you can discover them, but a chat request to one returns a 403 model_access_required error until the model is enabled. Contact us to request access. Only status: "available" models can be invoked.

Always use the model id exactly as returned by GET /v1/models. It is the same id that appears in every response's model field.

Messages-capable models

openrelay/glm-5.2 is the current example of a model whose supported_apis includes messages, so it can be requested through either Chat Completions or Messages on the same model id.

Available models

Model idDescription
openrelay/gpt-oss-120bA large open-weight general-purpose chat model — the higher-capability option.
openrelay/gpt-oss-20bA smaller, faster, lower-cost open-weight chat model.
openrelay/gemma-4-31bGoogle's Gemma 4 31B: vision (text + image input) with reasoning and tool calling, 256K context.
openrelay/gemma-4-31b-nvfp4-32kGemma 4 31B, NVFP4-quantized for low-latency serving at 32K context: vision, reasoning, tool calling.
openrelay/glm-5.2Zhipu's frontier GLM 5.2: bilingual reasoning and agentic tool use, 1M-token context.
openrelay/deepseek-ocr-2DeepSeek's document OCR model: converts scans, receipts, and screenshots to structured markdown (text + image input), 8K context.

Call GET /v1/models for the authoritative, up-to-date list available to your organization. For per-model rates, see Pricing & billing.

On this page