The fastest Amazon model is Nova 2 Lite at 119 output tokens per second. Nova Micro 1.0 (97 t/s) and Nova Lite 1.0 (76 t/s) round out the top three.
AI models ranked by output speed (tokens per second, p50). The fastest large language models for low-latency and high-throughput applications.
The fastest Amazon model is Nova 2 Lite at 119 output tokens per second. Nova Micro 1.0 (97 t/s) and Nova Lite 1.0 (76 t/s) round out the top three.
Nova Micro 1.0 (97 t/s) is the closest alternative on this metric, followed by Nova Lite 1.0 (76 t/s). See the full ranking above for the tradeoffs.
modelgrep tracks 5 Amazon models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Nova 2 Lite. 5 of them qualify for this ranking.