Llama 3.3 70B Instruct

131K ctxText Tools

Released Dec 6, 2024 · 164B tokens this week · 5 providers

Overview

A dense 70B model that matched the far larger 3.1-405B on most instruction-following benchmarks. The pragmatic open-weight default for general assistants and fine-tuning. Supported by essentially every inference vendor, so pricing is competitive.

roleplaytranslationprogramming

Providers

Reference data — not yet measured from live traffic

PROVIDER		MAX OUT		OUTPUT /M				QUANT
DeepInfraCheapest	131K	16K	$0.13	$0.39	460ms	110	98.90%	fp8
Novita AI	131K	16K	$0.14	$0.42	500ms	95	98.62%	fp8
Together AI	131K	16K	$0.15	$0.44	195ms	145	99.50%	Full
Groq	33K	16K	$0.15	$0.45	209ms	480	99.80%	Full
Cerebras	66K	16K	$0.16	$0.47	195ms	1550	99.60%	Full

Latency p50 reflects a provider’s API endpoint responsiveness — the round-trip to its API, not per-token inference time. These figures, with throughput and uptime, are reference data until the gateway aggregates its own traffic.

Price comparison

Blended $ per 1M tokens

Llama 3.3 70B Instruct$0.33

DeepSeek V3.2$0.37

Gemini 3 Flash$1.95

GPT-5.2$10.94

Claude Sonnet 4.5$12.00

Blended rate per 1M tokens, weighted one part prompt to three parts completion — roughly the shape of a chat workload. Your mix will move the number.

Call it

OpenAI-compatible — swap the base URL and go

curl https://model.cards/api/v1/chat/completions \
  -H "Authorization: Bearer $MODELCARDS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.3-70b",
    "messages": [
      { "role": "user", "content": "Summarize the tradeoffs of speculative decoding." }
    ]
  }'