Microsoft: Phi 4 wins on more metrics (7 of 8), but the right pick depends on what you optimize for — see the breakdown below.
| Metric | Google: Gemma 3 27B | Microsoft: Phi 4 |
|---|---|---|
| Intelligence Index | 10.3 | 10.4✓ |
| Coding Index | 9.6 | 11.2✓ |
| GPQA Diamond | 43% | 57%✓ |
| Design Arena Elo | — | — |
| Speed (tokens/sec) | 45 | 65✓ |
| Latency | 433ms | 214ms✓ |
| Input price /M | $0.080 | $0.065✓ |
| Output price /M | $0.160 | $0.140✓ |
| Context window | 131K✓ | 16K |
| Capabilities | ToolsJSONVision | JSON |