The fastest LLM is Morph V3 Fast at 3.1k output tokens per second. Morph V3 Large (3.0k t/s) and gpt-oss-safeguard-20b (530 t/s) round out the top three.
AI models ranked by output speed (tokens per second, p50). The fastest large language models for low-latency and high-throughput applications.
The fastest LLM is Morph V3 Fast at 3.1k output tokens per second. Morph V3 Large (3.0k t/s) and gpt-oss-safeguard-20b (530 t/s) round out the top three.
Morph V3 Large (3.0k t/s) is the closest alternative on this metric, followed by gpt-oss-safeguard-20b (530 t/s). See the full ranking above for the tradeoffs.