Lowest-Latency Microsoft Models

Quick answer · Updated June 2026

Phi 4 has the lowest latency of any Microsoft model, responding in about 250ms to first token. Phi 4 Mini Instruct (527ms) and WizardLM-2 8x22B (977ms) round out the top three.

250msLatency

10.4Intelligence

43 t/sSpeed

$0.065Input /M

16KContext

AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.

Frequently asked

Which Microsoft model has the lowest latency?

Phi 4 has the lowest latency of any Microsoft model, responding in about 250ms to first token. Phi 4 Mini Instruct (527ms) and WizardLM-2 8x22B (977ms) round out the top three.

What's a good alternative to Phi 4?

Phi 4 Mini Instruct (527ms) is the closest alternative on this metric, followed by WizardLM-2 8x22B (977ms). See the full ranking above for the tradeoffs.

How many Microsoft models are there?

modelgrep tracks 3 Microsoft models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Phi 4. 3 of them qualify for this ranking.

More Microsoft rankings

Microsoft: Smartest LLMs Microsoft: Best LLMs for Coding Microsoft: Best LLMs for Design & Frontend Microsoft: Fastest LLMs Microsoft: Cheapest LLMs Microsoft: Best Free LLMs Microsoft: Best Reasoning LLMs Microsoft: Best Vision LLMs Microsoft: Best LLMs for Agents Microsoft: Best Open-Source LLMs Microsoft: Longest-Context LLMs

All rankings

Small & Fast LLMs Smartest LLMs Best LLMs for Coding Best LLMs for Design & Frontend Fastest LLMs Cheapest LLMs Best Free LLMs Best Reasoning LLMs Best Vision LLMs Best LLMs for Agents Best Open-Source LLMs Longest-Context LLMs