modelgrep

Anthropic: Claude 3 Haiku vs Meta: Llama 3.1 8B Instruct

AAnthropic: Claude 3 Haikuanthropic/claude-3-haikuVSMMeta: Llama 3.1 8B Instructmeta-llama/llama-3.1-8b-instruct

Anthropic: Claude 3 Haiku and Meta: Llama 3.1 8B Instruct are evenly matched; the right pick depends on your priorities.

MetricAnthropic: Claude 3 HaikuMeta: Llama 3.1 8B Instruct
Intelligence Index12.3✓11.8
Coding Index6.7✓4.9
GPQA Diamond37%✓26%
Design Arena Elo——
Speed (tokens/sec)77161✓
Latency476ms146ms✓
Input price /M$0.250$0.020✓
Output price /M$1.25$0.030✓
Context window200K✓131K
CapabilitiesToolsVisionToolsJSON
Anthropic: Claude 3 Haiku details →Meta: Llama 3.1 8B Instruct details →