Microsoft: Phi 4 Mini Instruct wins on more metrics (6 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Meta: Llama 3 8B Instruct | Microsoft: Phi 4 Mini Instruct |
|---|---|---|
| Intelligence Index | 6.4 | 8.4✓ |
| Coding Index | 4.0✓ | 3.6 |
| GPQA Diamond | 30% | 33%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 55 | 79✓ |
| Latency | 648ms | 270ms✓ |
| Input price /M | $0.140 | $0.080✓ |
| Output price /M | $0.140✓ | $0.350 |
| Context window | 8K | 131K✓ |
| Capabilities | JSON |