modelgrep
meta-llama logo

Meta: Llama 3.1 70B Instruct

meta-llama/llama-3.1-70b-instruct

ToolsJSON
Use via OpenRouter ↗
Intelligence
Design Elo
Speed
tokens/sec
Latency
first token
Input price
$0.400
162nd cheapest
Context
131K
16K max out

How it compares

Cheaper than52%
of all ranked models

Overview

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...

Providers & pricing (3)

ProviderIn $/MOut $/MUptime
DeepInfrafp8$0.400$0.40098.9%
Amazon Bedrock$0.720$0.720100%
CoreWeavebf16$0.800$0.800100%

Specifications

Context window131K
Max output16K
Knowledge cutoffDec 2023
Input modalitiestext
Output modalitiestext
Prompt caching
Cache read price
ModeratedNo

Llama 3.1 70B Instruct FAQ

How much does Llama 3.1 70B Instruct cost?

Llama 3.1 70B Instruct costs $0.400 per million input tokens and $0.400 per million output tokens via OpenRouter, making it 162nd cheapest of 335 paid models.

What is Llama 3.1 70B Instruct's context window?

Llama 3.1 70B Instruct supports a 131K-token context window and can output up to 16K tokens. It accepts text input.

Compare head-to-head