Mistral: Mistral Medium 3 wins on more metrics (7 of 9), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Anthropic: Claude 3.5 Haiku | Mistral: Mistral Medium 3 |
|---|---|---|
| Intelligence Index | 18.7 | 18.8✓ |
| Coding Index | 10.7 | 13.6✓ |
| GPQA Diamond | 41% | 58%✓ |
| Design Arena Elo | — | 1163✓ |
| Speed (tokens/sec) | 40✓ | 38 |
| Latency | 755ms | 297ms✓ |
| Input price /M | $0.800 | $0.400✓ |
| Output price /M | $4.00 | $2.00✓ |
| Context window | 200K✓ | 131K |
| Capabilities | ToolsVision | ToolsJSONVision |