The fastest NVIDIA model is Nemotron 3 Super (free) at 238 output tokens per second. Nemotron 3 Super (238 t/s) and Nemotron 3 Nano 30B A3B (free) (159 t/s) round out the top three.
AI models ranked by output speed (tokens per second, p50). The fastest large language models for low-latency and high-throughput applications.
The fastest NVIDIA model is Nemotron 3 Super (free) at 238 output tokens per second. Nemotron 3 Super (238 t/s) and Nemotron 3 Nano 30B A3B (free) (159 t/s) round out the top three.
Nemotron 3 Super (238 t/s) is the closest alternative on this metric, followed by Nemotron 3 Nano 30B A3B (free) (159 t/s). See the full ranking above for the tradeoffs.
modelgrep tracks 11 NVIDIA models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Nemotron 3 Ultra (free). 10 of them qualify for this ranking.