Skip to content

OpenAI · Chat

OpenAI o3

OpenAI 🇺🇸Chato3 familyOne of its sources says the weights aren't publicly available.The maker currently plans to deprecate it within the next 180 days (11 Dec 2026). Plans can change.
From Aiml API's listing:
OpenAI o3 is a frontier reasoning model with exceptional performance on complex scientific, math, and coding tasks.
llminfo IQ
128.3
Maker's price
$1.75 blended / 1M
Max context
200K
Listings
46

Evidence and sources

llminfo IQ 128.3, ranked among chat models. From 343 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 99.6, 95% interval 93–106. From 13 benchmark families across 13 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedGood value (54.5). Cheaper per task than its benchmark results predict. From 39 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsChatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it. By effort: default 44 · medium 58.Median 54,181 output tokens per task at medium effort.How the Yap score worksReleased 16 Apr 2025 Training-data cutoff, as its sources state it Maker HQ: US (according to OpenAI's own website)
All rankings: #331 on OpenRouter today #391 on OpenRouter this week #395 on OpenRouter this month #482 on NanoGPT recentlySources: OpenAI API data, Models.dev data, LMArena data, LiteLLM data, AI/ML API data, OpenRouter data docs, llminfo researchPrimary data from OpenAI API from Models.dev: name, weights availability from LMArena: variant from LiteLLM: deprecation date from AI/ML API: primary mode, description from OpenRouter: knowledge cutoff from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Trade-offs

Deprecation scheduled

The maker plans to deprecate it on 11 Dec 2026, within the next 180 days.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 9 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputWeb searchBatch API

Listings

 OpenAIo3Sources: GenAI Prices data, LiteLLM data, Models.dev data, OpenAI API data200K$2.00cache read $0.50batch $1.00$8.00batch $4.00
 Microsoft Azureo3-2025-04-16-batch · batch, 2025-04-16Source: Helicone Costs dataNot published by the provider$1.00$4.00
 OpenRouteropenai/o3:batch · batchSource: OpenRouter data docs200K$1.00cache read $0.25$4.00
 RequestyInference by OpenAIopenai/o3:flex · flexSource: Requesty data200K$1.00cache read $0.25$4.00
 Poeopenai/o3Source: Models.dev data200K$1.8182cache read $0.4545$7.2727
 302aio3Sources: 302.ai data, Models.dev data200K$2.00$8.00
 Aihubmixo3Source: AIHubMix data docs200K$2.00cache read $0.50$8.00
 Cometapio3-2025-04-16 · 2025-04-16Sources: CometAPI data, CometAPI Pricing dataNot published by the provider$2.00$8.00
 Eden AIInference by OpenAIopenai/o3Source: Models.dev data200K$2.00cache read $0.50$8.00
 Fastrouteropenai/o3Source: FastRouter data200K$2.00cache read $0.50batch $1.00$8.00batch $4.00
Show all 40 listings

Showing 10 of 40: the maker's own listing first, then the cheapest per 1M input tokens from each provider.

Also sold by Abacus, Cloudflare AI Gateway, Digitalocean, Flowdot, Gradient AI, Impossibl, Jiekou, Kilo, Llmgateway, Llmgateway Providers, Lowrouter, Merge Gateway, NanoGPT, Nous Portal, Vercel, Vercel AI Gateway.

6 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score

Human preference

Arena ELO55 related benchmarks · 57 results
Arena ELO
Source: LMArena data · Nov 2026
Arena-Hard-v2.0-Preview
Source: Arena-Hard-Auto data
Creative Writing, Ensemble GPT-4.1 and Gemini 2.5 as Judges (Best Configuration for Creative Writing)
Hard Prompt, Style Control, and Gemini-2.5 as Judge (Official Configuration)
Hard Prompt, Style Control, and GPT-4.1 as Judge (If prefer OpenAI API)
Chinese
Source: LMArena data · Nov 2026
Creative Writing
Source: LMArena data · Nov 2026
English
Source: LMArena data · Nov 2026
Exclude Ties
Source: LMArena data · Nov 2026
Show 49 more resultsHide 49 results
Expert
Source: LMArena data · Nov 2026
French
Source: LMArena data · Nov 2026
German
Source: LMArena data · Nov 2026
Hard Prompts
Source: LMArena data · Nov 2026
Hard Prompts English
Source: LMArena data · Nov 2026
Industry Entertainment and Sports and Media
Source: LMArena data · Nov 2026
Industry Life and Physical and Social Science
Source: LMArena data · Nov 2026
Industry Mathematical
Source: LMArena data · Nov 2026
Industry Medicine and Healthcare
Source: LMArena data · Nov 2026
Industry Software and It Services
Source: LMArena data · Nov 2026
Industry Writing and Literature and Language
Source: LMArena data · Nov 2026
Japanese
Source: LMArena data · Nov 2026
Korean
Source: LMArena data · Nov 2026
Longer Query
Source: LMArena data · Nov 2026
Multi Turn
Source: LMArena data · Nov 2026
Non English
Source: LMArena data · Nov 2026
Polish
Source: LMArena data · Nov 2026
Russian
Source: LMArena data · Nov 2026
Search Factuality
Source: LMArena data · Nov 2026
Search Style-Controlled
Source: LMArena data · Nov 2026
Spanish
Source: LMArena data · Nov 2026
Style-Controlled
Source: LMArena data · Nov 2026
Text Factuality
Source: LMArena data · Nov 2026
Text Factuality - English
Source: LMArena data · Nov 2026
Text Factuality - Exclude Ties
Source: LMArena data · Nov 2026
Text Factuality - Hard Prompts
Source: LMArena data · Nov 2026
Text Factuality - Hard Prompts English
Source: LMArena data · Nov 2026
Text Factuality - Longer Query
Source: LMArena data · Nov 2026
Text Factuality - Multi Turn
Source: LMArena data · Nov 2026
Text Factuality - Non English
Source: LMArena data · Nov 2026
Vision
Source: LMArena data · Nov 2026
Vision - Captioning
Source: LMArena data · Nov 2026
Vision - Chinese
Source: LMArena data · Nov 2026
Vision - Creative Writing
Source: LMArena data · Jan 2026
Vision - Creative Writing Vision
Source: LMArena data · Nov 2026
Vision - Diagram
Source: LMArena data · Nov 2026
Vision - English
Source: LMArena data · Nov 2026
Vision - Entity Recognition
Source: LMArena data · Nov 2026
Vision - Homework
Source: LMArena data · Nov 2026
Vision - Humor
Source: LMArena data · Nov 2026
Vision Style-Controlled
Source: LMArena data · Nov 2026

Reasoning

CL-benchSource: Epoch AI Benchmarking Hub data
COLLIESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ERQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Agentic

GAIA4 results
Source: GAIA Leaderboard data · Aug 2025
Difficulty level
Difficulty not reported
hal-gaiaSource: HAL (Princeton)
Tau2 Retail5 related benchmarks · 5 results
Tau2 Retail
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Tau2 Airline
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Tau2 Telecom
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
tau2-bench v0.1 airline pass^1
Source: Sierra tau-bench Leaderboard data docs · Apr 2025
submission-o3_openai_2025-01-15
tau2-bench v0.1 retail pass^1
Source: Sierra tau-bench Leaderboard data docs · Apr 2025
submission-o3_openai_2025-01-15

Coding

SWE-bench Verified9 related benchmarks · 9 results
SWE-bench Verified
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Show 3 more resultsHide 3 results

Math

AIME 2024Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
AIME 2025Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MathVistaSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ValsSource: Vals AI

Vision

MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MMMU-ProSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
VideoMMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Long context

Instruction following

Knowledge

Factuality

Multilingual

OCR

Speech

Other

Nejumi 428 related benchmarks · 28 results
ALT_バイアス
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
ALT_倫理・道徳
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
ALT_制御性
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
ALT_堅牢性
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
ALT_毒性
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
ALT_真実性
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
Show 22 more resultsHide 22 results
AVG_jaster_0shot
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
AVG_jaster_2shots
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_アプリケーション開発
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_コーディング
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_一般的知識
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_基礎的言語性能
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_専門的知識
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_応用的言語性能
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_情報検索
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_意味解析
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_抽象的推論
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_推論能力
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_数学的推論
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_構文解析
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_知識・質問応答
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_翻訳
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_表現
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_論理的推論
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
GLP_関数呼び出し
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
TOTAL_SCORE
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
アラインメント(ALT)_AVG
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort
汎用的言語性能(GLP)_AVG
Source: Nejumi Leaderboard 4 data docs
openai/o3-2025-04-16: high-effort

Data credits: Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Data by LLM Stats · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · LMArena, CC BY 4.0 (licence) · Arena-Hard-Auto, LMArena, Apache-2.0 (licence) · ArtifactsBench (Tencent Hunyuan), CC BY 4.0 (licence) · Berkeley Function-Calling Leaderboard (Gorilla, UC Berkeley), Apache-2.0 (licence) · BullshitBench by Peter Gostev, MIT (licence) · CharXiv (Wang et al., NeurIPS 2024), Princeton NLP. https://charxiv.github.io · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · HAL (Princeton) — cite the HAL paper · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · JMLE2026-Bench and IgakuQA119 by Naoto Iwase; results licence not stated (code MIT, question data CC BY 4.0). · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MLE-bench (OpenAI), MIT (licence) · Multi-SWE-bench experiments (multi-swe-bench/experiments), Apache-2.0; resolved-rate fractions converted to percentages (licence) · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · Swallow LLM Leaderboard v2, Swallow LLM team (Institute of Science Tokyo). Contents CC BY 4.0; Japanese post-trained task scores on the source's 0..1 scale. (licence) · Sierra Research tau2-bench leaderboard submissions (github.com/sierra-research/tau2-bench), MIT (licence) · Clinical Benchmarks (clinicalbenchmarks.ai), CC BY 4.0; fractions converted to percentages; source documents retain their own terms (licence)

Around the web

Also known as: azure/eu/o3, azure/eu/o3-2025-04-16, azure/o3, azure/o3-2025-04-16, azure/us/o3, azure/us/o3-2025-04-16, gradient_ai/openai-o3, o3-0416, o3-2025-04-16, o3-search, openai-o3, openai/o3, openai/o3-2025-04-16, openai/o3-fast, openai/o3:batch, openai/o3:flex, vercel_ai_gateway/openai/o3

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works