Google: Gemma 3 12B wins on more metrics (5 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Google: Gemma 3 12B | Meta: Llama 3 70B Instruct |
|---|---|---|
| Intelligence Index | 8.8 | 8.9✓ |
| Coding Index | 6.3 | 6.8✓ |
| GPQA Diamond | 35% | 38%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 29✓ | 17 |
| Latency | 565ms✓ | 721ms |
| Input price /M | $0.050✓ | $0.510 |
| Output price /M | $0.150✓ | $0.740 |
| Context window | 131K✓ | 8K |
| Capabilities | ToolsJSONVision | JSON |