The Known Good Updated 8 Oct 2026 Subscribe
Evaluations· LiveBench· Apache-2.0· Tracked, not in the index

LiveBench Instruction Following

LiveBench instruction-following subset. Published by LiveBench (Apache-2.0) and redistributed by Epoch AI under CC-BY 4.0 in live_bench_external.csv (column 'IF Average'). The Known Good aggregates published results; it runs no evaluations.

Publisher's page Licence & attribution How we use this score
49 models scored Higher is better Published by LiveBench Apache-2.0
Every model we hold a LiveBench Instruction Following score for
All 49 of 49 models
# Model Creator LiveBench Instruction Following Known Good Index Measured
1 OpenAI: GPT-5.1 💡 OpenAI 93.3 73 8 Oct 2026
2 gemini-2.0-flash-001 Google DeepMind,Google 85.8 61 8 Oct 2026
3 OpenAI: o3 Mini 💡 OpenAI 84.4 86 8 Oct 2026
4 gemini-2.0-pro-exp-02-05 Google 83.4 74 8 Oct 2026
5 Meta: Llama 3.3 70B Instruct Meta 82.7 34 8 Oct 2026
6 gemini-2.0-flash-thinking-exp-01-21 Google DeepMind,Google 82.5 62 8 Oct 2026
7 gemini-2.0-flash-exp Google DeepMind,Google 81.9 — 8 Oct 2026
8 QwQ-32B Alibaba 81.8 69 8 Oct 2026
9 OpenAI: o1 💡 OpenAI 81.5 69 8 Oct 2026
10 DeepSeek: DeepSeek V3 0324 DeepSeek 81.5 64 8 Oct 2026
11 claude-3-7-sonnet-20250219 Anthropic 81.2 74 8 Oct 2026
12 gemini-2.5-pro-exp-03-25 Google 80.6 — 8 Oct 2026
13 DeepSeek: R1 💡 DeepSeek 80.5 75 8 Oct 2026
14 gemini-2.0-flash-lite-preview-02-05 Google 78.3 — 8 Oct 2026
15 gemini-exp-1206 Google DeepMind,Google 77.3 — 8 Oct 2026
16 gemini-2.0-flash-lite Google 76.6 — 8 Oct 2026
17 Perplexity: Sonar Perplexity 76.2 — 8 Oct 2026
18 qwen2.5-max Alibaba 75.3 — 8 Oct 2026
19 DeepSeek: DeepSeek V3 DeepSeek 75.2 62 8 Oct 2026
20 Google: Gemma 3 27B Google 74.9 47 8 Oct 2026
21 gpt-4.5-preview OpenAI 72.3 54 8 Oct 2026
22 DeepSeek: R1 Distill Llama 70B 💡 DeepSeek 69.9 63 8 Oct 2026
23 grok-2-1212 xAI 69.6 45 8 Oct 2026
24 claude-3-5-sonnet-20241022 Anthropic 69.3 45 8 Oct 2026
25 OpenAI: GPT-4o OpenAI 68.6 27 8 Oct 2026
26 learnlm-1.5-pro-experimental Unknown 68.2 — 8 Oct 2026
27 mistral-large-2411 Mistral 67.9 37 8 Oct 2026
28 amazon.nova-pro-v1:0 Amazon 67.1 — 8 Oct 2026
29 o1-mini OpenAI 65.4 65 8 Oct 2026
30 Dracarys2-72B-Instruct Unknown 65.2 — 8 Oct 2026
31 claude-3-opus-20240229 Anthropic 63.9 32 8 Oct 2026
32 mistral-small-2503 Mistral 63.7 33 8 Oct 2026
33 Dracarys2-Llama-3.1-70B-Instruct Unknown 63.2 — 8 Oct 2026
34 claude-3-5-haiku-20241022 Anthropic 61.9 30 8 Oct 2026
35 OLMo-2-1124-13B-Instruct Allen Institute for AI,University of Washington,New York University (NYU) 60.6 — 8 Oct 2026
36 mistral-small-2501 Mistral 59.5 31 8 Oct 2026
37 Qwen2.5 Coder 32B Instruct Alibaba 58.7 — 8 Oct 2026
38 Microsoft: Phi 4 Microsoft 58.4 41 8 Oct 2026
39 Google: Gemma 2 27B Google 58.1 21 8 Oct 2026
40 c4ai-command-r-plus-08-2024 Cohere,Cohere for AI 57.6 — 8 Oct 2026
41 OpenAI: GPT-4o-mini OpenAI 56.8 31 8 Oct 2026
42 DeepSeek-R1-Distill-Qwen-32B DeepSeek 55.7 53 8 Oct 2026
43 c4ai-command-r-08-2024 Cohere 55.6 — 8 Oct 2026
44 amazon.nova-lite-v1:0 Amazon 54.1 — 8 Oct 2026
45 gemma-2-9b-it Google 52.6 13 8 Oct 2026
46 amazon.nova-micro-v1:0 Amazon 48.0 — 8 Oct 2026
47 Phi-3-small-8k-instruct Microsoft 47.2 — 8 Oct 2026
48 Phi-3-mini-4k-instruct Microsoft 39.1 — 8 Oct 2026
49 QwQ-32B-Preview Alibaba 35.6 — 8 Oct 2026
The Known Good
Provenance. These figures are published by LiveBench and redistributed here under Apache-2.0. The publisher's own page is here. We did not run this evaluation and we do not adjust the published numbers — where a score feeds an index it is min-max normalised against every other model holding the same evaluation, and nothing else is done to it. Full licence detail is on attribution, and every score here is in the CSV download.