Nova Micro 1.0 has the lowest latency of any Amazon model, responding in about 322ms to first token. Nova Lite 1.0 (482ms) and Nova 2 Lite (544ms) round out the top three.
AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.
Nova Micro 1.0 has the lowest latency of any Amazon model, responding in about 322ms to first token. Nova Lite 1.0 (482ms) and Nova 2 Lite (544ms) round out the top three.
Nova Lite 1.0 (482ms) is the closest alternative on this metric, followed by Nova 2 Lite (544ms). See the full ranking above for the tradeoffs.
modelgrep tracks 5 Amazon models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Nova 2 Lite. 5 of them qualify for this ranking.