Google: Gemini 2.5 Flash Lite wins on more metrics (5 of 7), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Google: Gemini 2.5 Flash Lite | Nous: Hermes 3 405B Instruct |
|---|---|---|
| Intelligence Index | 17.6 | 17.6 |
| Coding Index | 9.5 | 18.1✓ |
| GPQA Diamond | 63%✓ | 54% |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 121✓ | 22 |
| Latency | 356ms | 345ms✓ |
| Input price /M | $0.100✓ | $1.00 |
| Output price /M | $0.400✓ | $1.00 |
| Context window | 1.0M✓ | 131K |
| Capabilities | ReasoningToolsJSONVisionAudio | JSON |