IBM: Granite 4.1 8B wins on more metrics (7 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Anthropic: Claude 3 Haiku | IBM: Granite 4.1 8B |
|---|---|---|
| Intelligence Index | 12.3 | 12.4✓ |
| Coding Index | 6.7 | 7.3✓ |
| GPQA Diamond | 37% | 43%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 79 | 119✓ |
| Latency | 481ms | 140ms✓ |
| Input price /M | $0.250 | $0.050✓ |
| Output price /M | $1.25 | $0.100✓ |
| Context window | 200K✓ | 131K |
| Capabilities | ToolsVision | ToolsJSON |