Hermes 4 70B has the lowest latency of any Nous model, responding in about 254ms to first token. Hermes 3 70B Instruct (447ms) and Hermes 3 405B Instruct (free) (650ms) round out the top three.
AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.
Hermes 4 70B has the lowest latency of any Nous model, responding in about 254ms to first token. Hermes 3 70B Instruct (447ms) and Hermes 3 405B Instruct (free) (650ms) round out the top three.
Hermes 3 70B Instruct (447ms) is the closest alternative on this metric, followed by Hermes 3 405B Instruct (free) (650ms). See the full ranking above for the tradeoffs.
modelgrep tracks 5 Nous models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Hermes 4 405B. 5 of them qualify for this ranking.