Anthropic: Claude 3 Haiku wins on more metrics (4 of 5), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Anthropic: Claude 3 Haiku | Mistral: Mixtral 8x22B Instruct |
|---|---|---|
| Intelligence Index | 3.9 | 4.4✓ |
| Coding Index | — | — |
| GPQA Diamond | 37%✓ | 33% |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | — | — |
| Latency | — | — |
| Input price /M | $0.250✓ | $2.00 |
| Output price /M | $1.25✓ | $6.00 |
| Context window | 200K✓ | 66K |
| Capabilities | ToolsVision | ToolsJSON |
Anthropic: Claude 3 Haiku wins on more metrics (4 of 5), but the right pick depends on what you optimize for — see the breakdown below.
The table on this page compares Anthropic: Claude 3 Haiku and Mistral: Mixtral 8x22B Instruct metric by metric — intelligence benchmarks, coding score, speed, latency, context window and per-token price — with the winner marked on each row. Data refreshes hourly.