Microsoft: Phi 4 Mini Instruct wins on more metrics (5 of 7), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Google: Gemma 3 4B | Microsoft: Phi 4 Mini Instruct |
|---|---|---|
| Intelligence Index | 6.3 | 8.4✓ |
| Coding Index | 2.9 | 3.6✓ |
| GPQA Diamond | 29% | 33%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | — | 79✓ |
| Latency | — | 270ms✓ |
| Input price /M | $0.050✓ | $0.080 |
| Output price /M | $0.100✓ | $0.350 |
| Context window | 131K | 131K |
| Capabilities | JSONVision | JSON |