OPENLLM API

One entry point,
many models.

Bring model access, usage and billing together. Choose the capabilities you need and start with your existing SDK.

APIHow it works
Apps
Teams
Workflows
OpenLLM APIModel routing · Keys · Billing
Cloud models
Local models
Compute supply
BUILD WITH CONFIDENCE

From integration to operations.

One integration

Use OpenAI-compatible endpoints for chat, images and embeddings. Check model documentation for supported capabilities and parameters.

Multi-channel routing

Models can map to multiple supply nodes, with configurable routing and fallback for retryable failures.

Traceable usage

Inspect requests, tokens and spend by model, key and time, including cache and billing details.

Make your first request.

Create a key, list available models and follow model documentation. Review usage and spend in your workspace.

Create an application key

Check model IDs and parameters

Verify actual usage and spend