Mistral: Mistral Small 4 wins on more metrics (6 of 7), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Mistral: Mistral Small 4 | Nous: Hermes 4 405B |
|---|---|---|
| Intelligence Index | 18.6 | 18.6 |
| Coding Index | 16.4✓ | 16.0 |
| GPQA Diamond | 57% | 73%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 130✓ | 35 |
| Latency | 279ms✓ | 345ms |
| Input price /M | $0.150✓ | $1.00 |
| Output price /M | $0.600✓ | $3.00 |
| Context window | 262K✓ | 131K |
| Capabilities | ReasoningToolsJSONVision | ReasoningJSON |