Overview
Models served on capacity reserved for your organization. Call one through the inference API at inference.openrelay.inc with its modelId. Read it, its lifecycle events, and its monitoring series here. Dedicated endpoints are set up with our team; without dedicated inference the list is empty and the rest return 404.
Dedicated Endpoints
Models served on capacity reserved for your organization. Call one through the inference API at inference.openrelay.inc with its modelId. Read it, its lifecycle events, and its monitoring series here. Dedicated endpoints are set up with our team; without dedicated inference the list is empty and the rest return 404.
Download a file's raw JSONL content GET
Streams a file's raw bytes as application/octet-stream, for a batch input file you uploaded or a result file that a batch has written. Use it to fetch batch results: the batch object's output_file_id (successful records) and error_file_id (failed records) each point at a JSONL file of `{custom_id, response | error}` lines.
List your dedicated endpoints GET
Returns one page of your organization's dedicated inference endpoints, with each one's model id, status, enabled flag, and per-token pricing.