Codestral 2508 has the lowest latency of any Mistral model, responding in about 136ms to first token. Ministral 3 3B 2512 (191ms) and Ministral 3 8B 2512 (241ms) round out the top three.
AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.
Codestral 2508 has the lowest latency of any Mistral model, responding in about 136ms to first token. Ministral 3 3B 2512 (191ms) and Ministral 3 8B 2512 (241ms) round out the top three.
Ministral 3 3B 2512 (191ms) is the closest alternative on this metric, followed by Ministral 3 8B 2512 (241ms). See the full ranking above for the tradeoffs.
modelgrep tracks 19 Mistral models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Mistral Medium 3.5. 19 of them qualify for this ranking.