modelgrep

Anthropic: Claude 3 Haiku vs OpenAI: GPT-4.1 Nano

OpenAI: GPT-4.1 Nano wins on more metrics (8 of 9), but the right pick depends on what you optimize for — see the breakdown below.

MetricAnthropic: Claude 3 HaikuOpenAI: GPT-4.1 Nano
Intelligence Index12.313.0
Coding Index6.711.2
GPQA Diamond37%51%
Design Arena Elo1039
Speed (tokens/sec)7998
Latency481ms597ms
Input price /M$0.250$0.100
Output price /M$1.25$0.400
Context window200K1.0M
CapabilitiesToolsVisionToolsJSONVision