The Known Good Updated 29 Jul 2026
claude-sonnet-4-5-20250929 vs Google: Gemma 3 27B ·Anthropic vs Google

claude-sonnet-4-5-20250929 vs Google: Gemma 3 27B — head-to-head comparison

claude-sonnet-4-5-20250929 profile Google: Gemma 3 27B profile All comparisons
claude-sonnet-4-5-20250929 — Anthropic
Quality
#35 of 62
66based on 6 of 7 evaluations
Known Good Index
Speed
unranked
—
Output tokens per second
Price
unranked
—
Blended per 1M tokens
Cache hit price
unranked
—
per 1M tokens
Context
unranked
—
tokens
Google: Gemma 3 27B — Google
Quality
#46 of 62
46based on 4 of 7 evaluations
Known Good Index
Speed
#278 of 317
20.9
Output tokens per second
Price
#66 of 370
$0.17
Blended per 1M tokens
In $0.08 · Out $0.45
Cache hit price
#74 of 238
$0.040
per 1M tokens (−50%)
Context
#198 of 375
262k
tokens (~400 pages)
Summary

On the Known Good Index, claude-sonnet-4-5-20250929 scores 66 and Google: Gemma 3 27B scores 46 — a 20-point lead for claude-sonnet-4-5-20250929. They share 3 published evaluations, with claude-sonnet-4-5-20250929 ahead on 3 and Google: Gemma 3 27B ahead on 0.

Published pricing is tracked for Google: Gemma 3 27B only, at $0.17 per 1M tokens blended.

claude-sonnet-4-5-20250929 is proprietary; Google: Gemma 3 27B is open weights under Open weights (restricted use). 5 tracked hosts serve one or both.

Generated from tracked data on 29 Jul 2026 · how these comparisons are computed →

At a glance
Metricclaude-sonnet-4-5-20250929Google: Gemma 3 27B
Known Good Index 66 based on 6 of 7 evaluations 46 based on 4 of 7 evaluations
Blended $/1M — $0.17
Output tok/s — 21
Context window — 262k
Providers 0 5
Jump to section

Quality

Known Good Index and the capability indices, side by side

Index scores

Each index is min-max normalised across tracked models and scaled 0–100 from published evaluations. We do not run these evaluations.

Metricclaude-sonnet-4-5-20250929Google: Gemma 3 27B
Known Good Index 66 46
Coding Index 61 —
Mathematics Index 89 47
Reasoning Index 48 40
Agentic Index 61 —
Openness Index 5 60
The Known Good

Quality Breakdown

Every evaluation both models report a published score for

Evaluations both models report

Bar = claude-sonnet-4-5-20250929 · marker = Google: Gemma 3 27B · scores ingested from Epoch AI (CC-BY 4.0)

GPQA Diamond82 / 49
Mock AIME 2024–2578 / 20
MATH Level 598 / 74

Right-hand figures read claude-sonnet-4-5-20250929 / Google: Gemma 3 27B. claude-sonnet-4-5-20250929 leads on 3 of 3, Google: Gemma 3 27B on 0.

The Known Good

Arena Elo

Human preference rating from blind pairwise votes

Arena ratings

Elo from blind pairwise votes, ingested from Arena. Higher is better.

Metricclaude-sonnet-4-5-20250929Google: Gemma 3 27B
Text Arena 1,438 —
Text Arena (style controlled) 1,455 —
The Known Good

Price & Cost

Published API pricing by token type

Published pricing

USD per 1M tokens. Blended is a 3:1 input:output mix. Live from OpenRouter, cross-checked against models.dev. Lower is better.

Metricclaude-sonnet-4-5-20250929Google: Gemma 3 27B
Input $/1M — $0.08
Output $/1M — $0.45
Blended $/1M — $0.17
Cache read $/1M — $0.040
The Known Good
We publish blended price rather than cost-per-task. Cost-per-task requires token counts from an evaluation suite we do not run. Blended price is computed from published rates and is fully reproducible — see the pricing methodology.

Context Window

Maximum input accepted and maximum output emitted

Context and output limits

Provider-declared limits, from metadata via models.dev and OpenRouter. Higher is better.

Metricclaude-sonnet-4-5-20250929Google: Gemma 3 27B
Context window — 262k
Max output tokens — 131k
The Known Good

Speed & Latency

Median throughput and time to first token across hosting providers

Output speedTime to first token
Throughput and latency

Medians across all tracked providers, derived from OpenRouter endpoint telemetry.

Metricclaude-sonnet-4-5-20250929Google: Gemma 3 27B
Output tokens/s — 21
Time to first token — 1.1s
The Known Good

Providers

Which hosts serve each model, and at what price and speed

5 hosts
Full provider benchmarks →
Provider claude-sonnet-4-5-20250929 blendedclaude-sonnet-4-5-20250929 tok/s Google: Gemma 3 27B blendedGoogle: Gemma 3 27B tok/s
Parasail — — $0.17 37
Phala — — $0.23 20
DeepInfra — — $0.10 18
Novita — — $0.14 17
Nebius — — $0.15 15

Per-host pricing and telemetry from OpenRouter. A dash means that host does not serve that model.

The Known Good
Sources for this page
Pricing & providers — OpenRouter Metadata — models.dev Benchmarks — Epoch AI (CC-BY 4.0)Elo — Arena Full attribution →