Get the Batch API's current limits
Returns the limits a batch submission runs against today: the per-batch minimum fee and the metadata caps that create and update both enforce. The minimum fee is 0 when none is configured. orl estimate and orl batches create read this instead of assuming fixed constants, so a limit change on the server reaches them without a CLI release.
Required permission
Requires the batch.read permission. See Permissions for the roles and API key permissions that include it.
Command line
The orl CLI wraps this endpoint:
orl batches limit getapiKeyAuthorizationBearer <token>OpenRelay API key. Send it as Authorization: Bearer or_… (legacy vl_… keys still work).
OK
application/json- response
Batch API limits that affect what a submission or an estimate should assume.
min_fee_nano_usd*integerThe per-batch minimum charge, in nanoUSD. 0 when no minimum fee is configured.
int64metadata*The metadata caps the batch metadata update also enforces.
curl -X GET 'https://inference.openrelay.inc/v1/batches/limits'{ "min_fee_nano_usd": 0, "metadata": { "max_pairs": 0, "max_key_length": 0, "max_value_length": 0 }}Overview
Batch inference jobs: submit a JSONL file of requests, poll status, and download results. A batch has 24 hours to finish; standard batches bill at a discount. Served by the inference endpoint (inference.openrelay.inc). Batch access is enabled per organization; without it these endpoints return 404.
List batches, newest first GET
Returns one page of your organization's batches, newest first, in the OpenAI list envelope. Page with limit (1 to 100, default 20) and after.