Granite 4.1 8B has the lowest latency of any IBM model, responding in about 144ms to first token. Granite 4.0 Micro (301ms) is next.
AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.
Granite 4.1 8B has the lowest latency of any IBM model, responding in about 144ms to first token. Granite 4.0 Micro (301ms) is next.
Granite 4.0 Micro (301ms) is the closest alternative on this metric. See the full ranking above for the tradeoffs.
modelgrep tracks 2 IBM models with live benchmarks, speed, latency and per-provider pricing, led on intelligence by Granite 4.1 8B. 2 of them qualify for this ranking.