modelgrep

Anthropic: Claude Sonnet 4 vs OpenAI: o4 Mini

OpenAI: o4 Mini wins on more metrics (5 of 9), but the right pick depends on what you optimize for — see the breakdown below.

MetricAnthropic: Claude Sonnet 4OpenAI: o4 Mini
Intelligence Index33.033.1
Coding Index30.625.6
GPQA Diamond68%78%
Design Arena Elo12201072
Speed (tokens/sec)50125
Latency720ms4.7s
Input price /M$3.00$1.10
Output price /M$15.00$4.40
Context window1M200K
CapabilitiesReasoningToolsVisionReasoningToolsJSONVision