OpenAI

gpt-oss-20b

131K ctxText Tools Reasoning

Released Aug 5, 2025 · 64B tokens this week · 4 providers

Overview

The smaller open-weight OpenAI release, light enough to run on a single accelerator. Handles chat, tool calls and light reasoning at close to zero cost per token. Often used as the draft model in speculative decoding setups.

agentsprogrammingtranslation

Providers

Reference data — not yet measured from live traffic

PROVIDER		MAX OUT		OUTPUT /M				QUANT
DeepInfraCheapest	131K	33K	$0.040	$0.15	520ms	190	98.84%	fp8
Novita AI	131K	33K	$0.043	$0.16	560ms	160	98.70%	fp8
Groq	131K	33K	$0.046	$0.17	209ms	1100	99.83%	Full
Cerebras	66K	33K	$0.048	$0.18	170ms	1600	99.64%	Full

Latency p50 reflects a provider’s API endpoint responsiveness — the round-trip to its API, not per-token inference time. These figures, with throughput and uptime, are reference data until the gateway aggregates its own traffic.

Price comparison

Blended $ per 1M tokens

gpt-oss-20b$0.12

DeepSeek V3.2$0.37

Grok 4 Fast$0.42

Gemini 3 Flash$1.95

Claude Sonnet 4.5$12.00

Blended rate per 1M tokens, weighted one part prompt to three parts completion — roughly the shape of a chat workload. Your mix will move the number.

Call it

OpenAI-compatible — swap the base URL and go

curl https://model.cards/api/v1/chat/completions \
  -H "Authorization: Bearer $MODELCARDS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-oss-20b",
    "messages": [
      { "role": "user", "content": "Summarize the tradeoffs of speculative decoding." }
    ]
  }'