Anthropic: Claude 3.5 Haiku wins on more metrics (6 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Anthropic: Claude 3.5 Haiku | OpenAI: GPT-4o (2024-08-06) |
|---|---|---|
| Intelligence Index | 18.7✓ | 18.6 |
| Coding Index | 10.7 | 16.6✓ |
| GPQA Diamond | 41% | 52%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 36✓ | 23 |
| Latency | 785ms✓ | 942ms |
| Input price /M | $0.800✓ | $2.50 |
| Output price /M | $4.00✓ | $10.00 |
| Context window | 200K✓ | 128K |
| Capabilities | ToolsVision | ToolsJSONVision |