modelgrep

Anthropic: Claude 3.5 Haiku vs Meta: Llama 4 Maverick

Meta: Llama 4 Maverick wins on more metrics (8 of 9), but the right pick depends on what you optimize for — see the breakdown below.

MetricAnthropic: Claude 3.5 HaikuMeta: Llama 4 Maverick
Intelligence Index18.718.4
Coding Index10.715.6
GPQA Diamond41%67%
Design Arena Elo980
Speed (tokens/sec)4765
Latency781ms301ms
Input price /M$0.800$0.150
Output price /M$4.00$0.600
Context window200K1.0M
CapabilitiesToolsVisionToolsJSONVision