Skip to content
OpenRelay is in early access, and the /v1 API is stable. New capabilities ship in the changelog.
PricingDashboard
GuidesAPI ReferenceCLI
API ReferenceComputeCatalog

List catalog models (OpenAI-compatible)

Returns the model catalog with each model's supported APIs, endpoints, modalities, status and batch eligibility. A model scoped to your organization also carries its token pricing. Free, not balance-gated. Models with status "available" can be used immediately in /v1/chat/completions; "request_access" models are listed for discovery but are not yet invocable.

Required permission

Requires the catalog.read permission. See Permissions for the roles and API key permissions that include it.

Command line

The orl CLI wraps this endpoint:

orl catalog model list
GET
/v1/models

Authorization

apiKey
headerAuthorizationBearer <token>

OpenRelay API key. Send it as Authorization: Bearer or_… (legacy vl_… keys still work).

Response Body

The public model catalog

application/json
  1. response
object*"list"
Value in"list"
data*array<>
Example Request
curl -X GET 'https://api.openrelay.inc/v1/models'
Example Response
{  "object": "list",  "data": [    {      "id": "string",      "object": "model",      "created": 0,      "owned_by": "string",      "supported_apis": [        "string"      ],      "endpoints": {        "property1": "string",        "property2": "string"      },      "modalities": {        "input": [          "string"        ],        "output": [          "string"        ]      },      "status": "available",      "batch_eligible": true,      "pricing": {        "input": 0,        "output": 0,        "cachedInput": 0,        "cacheWrite": 0      }    }  ]}

Overview

Public catalog: GPU models, availability, pricing, templates, and locations, plus the OpenAI-compatible model list and public GPU list rates. The list rates need no API key.

GPU availability by model GET

Live availability per GPU model for VMs: total and free GPUs and the largest single allocation placeable right now, served from a short-lived cache. Capacity held exclusively for another organization is left out. Free GPUs released from another organization's reservation to the spot market are counted in spotFreeGpus, not freeGpus.