Microsoft: Phi 4 Mini Instruct wins on more metrics (5 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Meta: Llama 3 70B Instruct | Microsoft: Phi 4 Mini Instruct |
|---|---|---|
| Intelligence Index | 8.9✓ | 8.4 |
| Coding Index | 6.8✓ | 3.6 |
| GPQA Diamond | 38%✓ | 33% |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 17 | 79✓ |
| Latency | 721ms | 270ms✓ |
| Input price /M | $0.510 | $0.080✓ |
| Output price /M | $0.740 | $0.350✓ |
| Context window | 8K | 131K✓ |
| Capabilities | JSON | JSON |