OpenAI
GPT-4o
Released May 13, 2024 · 143B tokens this week · 2 providers
Overview
OpenAI's 2024 omni-modal workhorse, taking text and images with fast conversational output. Still a dependable general assistant and one of the most common baselines in published evaluations. Widely supported by third-party tooling.
Providers
Reference data — not yet measured from live traffic
| PROVIDER | MAX OUT | OUTPUT /M | QUANT | |||||
|---|---|---|---|---|---|---|---|---|
OpenAICheapest | 128K | 16K | $2.50 | $10.00 | 208ms | 105 | 99.91% | Full |
Azure AI Foundry | 128K | 16K | $2.60 | $10.40 | 610ms | 92 | 99.84% | Full |
Latency p50 reflects a provider’s API endpoint responsiveness — the round-trip to its API, not per-token inference time. These figures, with throughput and uptime, are reference data until the gateway aggregates its own traffic.
Price comparison
Blended $ per 1M tokens
Blended rate per 1M tokens, weighted one part prompt to three parts completion — roughly the shape of a chat workload. Your mix will move the number.
Call it
OpenAI-compatible — swap the base URL and go
curl https://model.cards/api/v1/chat/completions \
-H "Authorization: Bearer $MODELCARDS_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "openai/gpt-4o",
"messages": [
{ "role": "user", "content": "Summarize the tradeoffs of speculative decoding." }
]
}'