Nous: Hermes 3 405B Instruct wins on more metrics (5 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Nous: Hermes 3 405B Instruct | OpenAI: GPT-4o (2024-11-20) |
|---|---|---|
| Intelligence Index | 17.6✓ | 17.3 |
| Coding Index | 18.1✓ | 16.7 |
| GPQA Diamond | 54% | 54%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 20 | 62✓ |
| Latency | 500ms | 452ms✓ |
| Input price /M | $1.00✓ | $2.50 |
| Output price /M | $1.00✓ | $10.00 |
| Context window | 131K✓ | 128K |
| Capabilities | JSON | ToolsJSONVision |