Overview
Answer typed questions about an input (a choice, a score or a yes/no) with a classifier instead of a generator, online only and billed per input token. Served by the inference endpoint (inference.openrelay.inc).
Decisions
Answer typed questions about an input (a choice, a score or a yes/no) with a classifier instead of a generator, online only and billed per input token. Served by the inference endpoint (inference.openrelay.inc).
Turn text into vectors POST
Turns text into vectors for search, retrieval, clustering and deduplication in the OpenAI embeddings shape, served by openrelay/bge-m3 today. openrelay/bge-m3 is multilingual and returns 1024-dimension dense vectors; check a model's supported_apis on GET /v1/models for embeddings. Requires a funded balance. No output rate: billed only on usage.prompt_tokens. stream is dropped. Limits: 8192 tokens per input item, 1024 items per request, 10 MiB request body. Also runs through the Batch API at endpoint /v1/embeddings, at the batch rate.
Answer typed questions with a classifier POST
Answers typed questions about a text or JSON input with a classifier: a choice, a score or a yes/no, with probabilities. Bills input tokens only. Each answer carries its probabilities and a confidence; nothing is generated. Served by openrelay/laya; check a model's supported_apis on GET /v1/models for decisions. Online only: the Batch API does not accept /v1/decisions. Requires a funded balance. Any field this schema does not list is rejected with 400 unknown_field. stream is dropped: a decision is always a single JSON response. Limits: 1 to 64 questions per request, 10 MiB request body.