Quality
How OpenAI: GPT-4o-mini (2024-07-18) compares against every tracked model
Composite of GPQA Diamond, Mock AIME 2024–25, MATH Level 5, SWE-bench Verified, LiveBench, Humanity's Last Exam and Terminal-Bench, normalised 0–100. Scores are ingested from their publishers; we do not run these evaluations.
Quality Breakdown
OpenAI: GPT-4o-mini (2024-07-18) on each evaluation feeding the index, against the tracked average
Bar = OpenAI: GPT-4o-mini (2024-07-18) · grey marker = average across tracked models
None of the seven index evaluations have published a score for this model yet.
Arena Elo
Human preference rating from blind pairwise votes
Elo from blind pairwise votes, ingested from Arena
OpenAI: GPT-4o-mini (2024-07-18) does not currently appear in any arena we ingest.
Price & Cost
Published API pricing by token type
USD per 1M tokens at a 3:1 input:output blend. Live from OpenRouter, cross-checked against models.dev. Lower is better.
(2024-07-18)this model #96/370 · off scale
Context Window
Maximum input tokens accepted
Maximum input context from provider metadata via models.dev and OpenRouter. Higher is better.
(2024-07-18)this model #319/375
Speed
Median output throughput across hosting providers
Median output tokens per second across all tracked providers. Derived from OpenRouter endpoint telemetry. Higher is better.
(2024-07-18)this model #160/317
Latency
Time to first token, median across providers
Seconds to first streamed chunk, median across tracked providers. Derived from OpenRouter endpoint telemetry. Lower is better.
(2024-07-18)this model #59/317 · off scale
Providers
Hosts serving OpenAI: GPT-4o-mini (2024-07-18), with their own price and speed
| Provider | Input $/M | Output $/M | Blended | Speed | TTFT | Context |
|---|---|---|---|---|---|---|
| OpenAI · first party | $0.15 | $0.60 | $0.26 | 57 | 0.5s | 128k |
Per-host pricing and telemetry from OpenRouter. Speed is output tokens per second; TTFT is time to first token.
History
How price and quality have moved since we began tracking this model
Since 25 Jul 2026
| Known Good Index | — |
| Blended price | $0.26 per 1M · observed 29 Jul 2026 |
| Output speed | 48 tok/s · observed 29 Jul 2026 |
| Time to first token | 0.6s |
No recorded changes for this model since tracking began.
Comparisons
Head-to-head pages pairing OpenAI: GPT-4o-mini (2024-07-18) with other tracked models
Head-to-head pages are generated for the top 50 models by Known Good Index, which OpenAI: GPT-4o-mini (2024-07-18) is not currently in. Its nearest tracked models by index are below.