modelgrep

Lowest-Latency Nous Models

Quick answer · Updated June 2026

Hermes 4 70B has the lowest latency of any Nous model, responding in about 254ms to first token. Hermes 3 70B Instruct (447ms) and Hermes 3 405B Instruct (free) (650ms) round out the top three.

254msLatency
16.0Intelligence
84 t/sSpeed
$0.130Input /M
131KContext

AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.

  1. 1N
    hermes-4-70b
    ReasoningJSON16.0 intel · $0.130/M · 84 t/s
    254ms
    Latency
  2. 2N
    hermes-3-llama-3.1-70b
    JSON12.6 intel · $0.700/M · 29 t/s
    447ms
    Latency
  3. 3N
    hermes-3-llama-3.1-405b:free
    17.6 intel · Free/M · 20 t/s
    650ms
    Latency
  4. 4N
    hermes-3-llama-3.1-405b
    JSON17.6 intel · $1.00/M · 20 t/s
    650ms
    Latency
  5. 5N
    hermes-4-405b
    ReasoningJSON18.6 intel · $1.00/M · 24 t/s
    709ms
    Latency

Frequently asked

Which Nous model has the lowest latency?

Hermes 4 70B has the lowest latency of any Nous model, responding in about 254ms to first token. Hermes 3 70B Instruct (447ms) and Hermes 3 405B Instruct (free) (650ms) round out the top three.

What's a good alternative to Hermes 4 70B?

Hermes 3 70B Instruct (447ms) is the closest alternative on this metric, followed by Hermes 3 405B Instruct (free) (650ms). See the full ranking above for the tradeoffs.

How many Nous models are there?

modelgrep tracks 5 Nous models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Hermes 4 405B. 5 of them qualify for this ranking.

More Nous rankings

All rankings