Mistral: Mistral Small 4 wins on more metrics (7 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Anthropic: Claude 3.5 Haiku | Mistral: Mistral Small 4 |
|---|---|---|
| Intelligence Index | 18.7✓ | 18.6 |
| Coding Index | 10.7 | 16.4✓ |
| GPQA Diamond | 41% | 57%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 47 | 125✓ |
| Latency | 781ms | 365ms✓ |
| Input price /M | $0.800 | $0.150✓ |
| Output price /M | $4.00 | $0.600✓ |
| Context window | 200K | 262K✓ |
| Capabilities | ToolsVision | ReasoningToolsJSONVision |