The fastest Nous model is Hermes 4 70B at 81 output tokens per second. Hermes 4 405B (31 t/s) and Hermes 3 405B Instruct (free) (22 t/s) round out the top three.
AI models ranked by output speed (tokens per second, p50). The fastest large language models for low-latency and high-throughput applications.
The fastest Nous model is Hermes 4 70B at 81 output tokens per second. Hermes 4 405B (31 t/s) and Hermes 3 405B Instruct (free) (22 t/s) round out the top three.
Hermes 4 405B (31 t/s) is the closest alternative on this metric, followed by Hermes 3 405B Instruct (free) (22 t/s). See the full ranking above for the tradeoffs.
modelgrep tracks 5 Nous models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Hermes 4 405B. 5 of them qualify for this ranking.