Llama 3.1 405B Instruct

131K ctxText Tools

Released Jul 23, 2024 · 29B tokens this week · 4 providers

Overview

Meta's largest dense open model, useful when you want frontier-adjacent quality with weights you control. Heavier and slower to serve than the mixture-of-experts generation that followed it. Still a strong teacher model for distillation.

academiareasoningtranslation

Providers

Reference data — not yet measured from live traffic

PROVIDER		MAX OUT		OUTPUT /M				QUANT
Together AICheapest	131K	16K	$0.80	$0.80	195ms	62	99.45%	Full
DeepInfra	131K	16K	$0.86	$0.86	840ms	48	98.70%	fp8
Lambda	131K	16K	$0.90	$0.90	900ms	40	98.20%	fp8
Fireworks AI	131K	16K	$0.92	$0.92	690ms	70	99.40%	Full

Latency p50 reflects a provider’s API endpoint responsiveness — the round-trip to its API, not per-token inference time. These figures, with throughput and uptime, are reference data until the gateway aggregates its own traffic.

Price comparison

Blended $ per 1M tokens

DeepSeek V3.2$0.37

Llama 3.1 405B Instruct$0.80

Gemini 3 Flash$1.95

GPT-5.2$10.94

Claude Sonnet 4.5$12.00

Blended rate per 1M tokens, weighted one part prompt to three parts completion — roughly the shape of a chat workload. Your mix will move the number.

Call it

OpenAI-compatible — swap the base URL and go

curl https://model.cards/api/v1/chat/completions \
  -H "Authorization: Bearer $MODELCARDS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-405b",
    "messages": [
      { "role": "user", "content": "Summarize the tradeoffs of speculative decoding." }
    ]
  }'