Overview
The credentials that imports of your own model weights read private Hugging Face, S3 and Google Cloud Storage sources with, for dedicated endpoints. Without dedicated inference these return 404.
Model Imports
The credentials that imports of your own model weights read private Hugging Face, S3 and Google Cloud Storage sources with, for dedicated endpoints. Without dedicated inference these return 404.
Get a dedicated endpoint's usage for a month GET
A dedicated endpoint's GPU-hours and their cost for one calendar month (UTC), read from the usage records its monthly bill is settled from. It reports the GPU-hours the endpoint's replicas were hosted, the GPU-hours of those that were billed (a replica is billed while it answers requests), and their cost in cents. The current month runs to now. A deleted endpoint's usage stays readable for the months it has records in. It is a billing read: it needs the usage permission, as the organization's usage routes do. Requests to the endpoint are not charged per token, so this is the endpoint's whole cost. It is rounded once for the endpoint, and the bill once for the organization, so the two can differ by under a cent per endpoint.
List your organization's model imports GET
Every model import of your organization, running or ended, each with its status, progress, source and the artifact it produces. Read the artifact for its facts and the hardware it fits. Imports are listed by id, not by when they started.