Skip to content
OpenRelay is in early access, and the /v1 API is stable. New capabilities ship in the changelog.
PricingDashboard
GuidesAPI ReferenceCLI
API ReferenceComputePods

Live pod GPU capacity and on-demand rates

Returns, per GPU model, the GPU units a pod create can claim right now, the largest single pod that fits, and the server-computed on-demand rate per GPU-hour. What a pod create can actually claim right now, per GPU model: free native (device-request) GPU units on online, non-delisted nodes a pod can be sized on (the exact filter admission uses), plus the SERVER-computed on-demand hourly rate. Only models with pod units and a price are returned; a create flow should offer exactly these and render these rates verbatim rather than re-deriving prices from the catalog.

Required permission

Requires the compute.read permission. See Permissions for the roles and API key permissions that include it.

Command line

The orl CLI wraps this endpoint:

orl pods capacity list
GET
/v1/pods/capacity

Authorization

apiKey
headerAuthorizationBearer <token>

OpenRelay API key. Send it as Authorization: Bearer or_… (legacy vl_… keys still work).

Response Body

Capacity per GPU model, cheapest first

application/json
  1. response
items*array<>
Example Request
curl -X GET 'https://api.openrelay.inc/v1/pods/capacity'
Example Response
{  "items": [    {      "gpuModelId": "string",      "name": "string",      "vramGb": 0,      "manufacturer": "string",      "freeUnits": 0,      "totalUnits": 0,      "maxGpuCount": 0,      "rateOnDemandCentsPerHour": 0,      "rateReservedCentsPerHour": 0,      "rateInterruptibleCentsPerHour": 0    }  ]}

Create a pod POST

Runs your container image as a pod on gpuCount whole GPUs of one node, with SSH access, at the on-demand rate fixed at creation, and returns it as a VmSummary. Compute-fabric pod (BYO container image + SSH keys): a hardened GPU container on gpuCount whole native-driver GPUs of one node. Admission claims free device-request GPU units (see listPodCapacity for what is claimable), snapshots the on-demand rate immutably onto the pod, and drives the guest workflow. A valid request the fleet has no room for right now answers 503 with a capacity code; a GPU count no node could ever hold for the org answers 400 GPU_COUNT_NOT_ALLOCATABLE; and an org without the pod tier answers 409 FEATURE_DISABLED.

Get a pod's container log tail GET

Returns the tail of a pod's container output (startup, CUDA errors, a crash's last lines), capped to a bounded size, or found false while it starts.