GPU availability by model
Live availability per GPU model for VMs: total and free GPUs and the largest single allocation placeable right now, served from a short-lived cache. Capacity held exclusively for another organization is left out. Free GPUs released from another organization's reservation to the spot market are counted in spotFreeGpus, not freeGpus.
Required permission
Requires the compute.read permission. See Permissions for the roles and API key permissions that include it.
Command line
The orl CLI wraps this endpoint:
orl catalog gpu-availability getapiKeyAuthorizationBearer <token>OpenRelay API key. Send it as Authorization: Bearer or_… (legacy vl_… keys still work).
Availability by gpu model
application/json- response
[index: integer]?Per-model GPU availability for VMs ("vm", vfio-group passthrough). Pod capacity is answered by GET /v1/pods/capacity.
curl -X GET 'https://api.openrelay.inc/v1/gpu-availability'[ { "gpuModelId": "rtx-4090", "vm": { "totalGpus": 12, "freeGpus": 5, "maxPlaceableGpus": 4 } }]List catalog models (OpenAI-compatible) GET
Returns the model catalog with each model's supported APIs, endpoints, modalities, status and batch eligibility. A model scoped to your organization also carries its token pricing. Free, not balance-gated. Models with status "available" can be used immediately in /v1/chat/completions; "request_access" models are listed for discovery but are not yet invocable.
GPU model catalog GET
Returns every GPU model in the catalog with its name, manufacturer, VRAM, architecture, form factor, and interconnect, and whether it is hidden.