Google: Gemma 3 4B wins on more metrics (3 of 4), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Google: Gemma 3 4B | Meta: Llama 3.2 1B Instruct |
|---|---|---|
| Intelligence Index | 6.3 | 6.3 |
| Coding Index | 2.9✓ | 0.6 |
| GPQA Diamond | 29%✓ | 20% |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | — | — |
| Latency | — | — |
| Input price /M | $0.050 | $0.027✓ |
| Output price /M | $0.100✓ | $0.201 |
| Context window | 131K | 131K |
| Capabilities | JSONVision |