Mistral: Mistral Medium 3 wins on more metrics (7 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Mistral: Mistral Medium 3 | OpenAI: GPT-4o (2024-08-06) |
|---|---|---|
| Intelligence Index | — | — |
| Coding Index | 13.6 | 16.6✓ |
| GPQA Diamond | 58%✓ | 52% |
| Design Arena Elo | 1161✓ | — |
| Speed (tokens/sec) | 33✓ | 23 |
| Latency | 380ms✓ | 601ms |
| Input price /M | $0.400✓ | $2.50 |
| Output price /M | $2.00✓ | $10.00 |
| Context window | 131K✓ | 128K |
| Capabilities | ToolsJSONVision | ToolsJSONVision |