Command R7B (12-2024) has the lowest latency of any Cohere model, responding in about 220ms to first token. Command R+ (08-2024) (280ms) and Command A (286ms) round out the top three.
AI models ranked by time-to-first-token (p50). The most responsive large language models for real-time and interactive use cases.
Command R7B (12-2024) has the lowest latency of any Cohere model, responding in about 220ms to first token. Command R+ (08-2024) (280ms) and Command A (286ms) round out the top three.
Command R+ (08-2024) (280ms) is the closest alternative on this metric, followed by Command A (286ms). See the full ranking above for the tradeoffs.
modelgrep tracks 4 Cohere models with live benchmarks, speed, latency and per-provider pricing. 4 of them qualify for this ranking.