Google: Gemma 4 26B A4B wins on more metrics (5 of 9), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Anthropic: Claude Haiku 4.5 | Google: Gemma 4 26B A4B |
|---|---|---|
| Intelligence Index | 31.0✓ | 27.1 |
| Coding Index | 29.6✓ | 29.1 |
| GPQA Diamond | 65% | 71%✓ |
| Design Arena Elo | 1182✓ | — |
| Speed (tokens/sec) | 108✓ | 64 |
| Latency | 516ms | 358ms✓ |
| Input price /M | $1.00 | $0.060✓ |
| Output price /M | $5.00 | $0.330✓ |
| Context window | 200K | 262K✓ |
| Capabilities | ReasoningToolsJSONVision | ReasoningToolsJSONVision |