Skip to content

OpenRelay is in early access, and the /v1 API is stable. New capabilities ship in the changelog.

API Reference Pricing Dashboard

API Reference Pricing Dashboard

Getting Started

Introduction Quickstart Authentication VM billing and burn rate Providers Provider nodes Errors Pagination

Command Line

Inference API

API Reference

Overview List batches, newest first GET Create a batch inference job POST Get a batch by id GET Cancel a running batch POST

Batches

Overview

Batch inference jobs: submit a JSONL file of requests, poll status, and download results at a discounted rate. Served by the inference endpoint (inference.openrelay.inc). Batch access is enabled per organization; without it these endpoints return 404.

Batches

Batch inference jobs: submit a JSONL file of requests, poll status, and download results at a discounted rate. Served by the inference endpoint (inference.openrelay.inc). Batch access is enabled per organization; without it these endpoints return 404.

Cancel a running batch

Create a batch inference job

Get a batch by id

List batches, newest first

Locations / regions GET

Previous Page

List batches, newest first GET

Next Page

On this page