OpenInference — pricing & performance
Models served
7
of 1,191 tracked models
Mean output speed
35
tokens per second, averaged over
7 measured endpoints
7 measured endpoints
Mean latency
1.8s
time to first token, averaged over
7 measured endpoints
7 measured endpoints
Cheapest blended
$0.000
per 1M tokens at a 3:1
input:output blend
input:output blend
Output speed on OpenInference
Output tokens per second for all 7 models on OpenInference with published throughput telemetry, the most recent figure OpenRouter publishes for each host. Higher is better. We do not run these measurements ourselves.
All 7 of 7 models⇩
The Known Good
7 models on OpenInference
Full leaderboard →
| Model | Creator | Input $/M | Output $/M | Blended | Speed | TTFT | Context |
|---|---|---|---|---|---|---|---|
DeepSeek: DeepSeek V4 Flash 0423
|
DeepSeek | $0.006 | $0.48 | $0.13 | 16 | 1.9s | 1.05M |
|
DeepSeek: DeepSeek V4 Flash 0731
|
DeepSeek | $0.004 | $0.48 | $0.12 | 14 | 2.6s | 1.05M |
|
DeepSeek: DeepSeek V4 Flash 0731 (free)
|
DeepSeek | $0.000 | $0.000 | $0.000 | 32 | 1.2s | 1.05M |
|
DeepSeek: DeepSeek V4.1 Flash
|
DeepSeek | $0.20 | $1.00 | $0.40 | 27 | 3.9s | 1.05M |
Google: Gemma 4 31B
|
$0.070 | $0.35 | $0.14 | 50 | 0.4s | 262k | |
Z.ai: GLM 5.3
|
Z.ai | $0.20 | $3.96 | $1.14 | 87 | 0.4s | 1.05M |
|
Z.ai: GLM 5.3 Flash
|
Z.ai | $0.032 | $2.80 | $0.72 | 16 | 2.0s | 1.05M |
The Known Good
Source. Prices, endpoint availability and throughput for OpenInference are ingested from OpenRouter;
model metadata is enriched from models.dev. A blank cell means the figure was not published for that endpoint —
it never means zero. Blended price is (3 × input + output) ÷ 4, the same 3:1 blend used everywhere on this
site; see methodology. Quality scores are not provider-specific:
a model scores the same wherever it is hosted, so quality lives on the
model pages.