Meta: Llama 3.1 8B Instruct wins on more metrics (4 of 7), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | IBM: Granite 4.1 8B | Meta: Llama 3.1 8B Instruct |
|---|---|---|
| Intelligence Index | 12.4✓ | 11.8 |
| Coding Index | 7.3✓ | 4.9 |
| GPQA Diamond | 43%✓ | 26% |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 114 | 161✓ |
| Latency | 158ms | 146ms✓ |
| Input price /M | $0.050 | $0.020✓ |
| Output price /M | $0.100 | $0.030✓ |
| Context window | 131K | 131K |
| Capabilities | ToolsJSON | ToolsJSON |