Skip to content

OpenAI · Chat

o4 Mini

OpenAI 🇺🇸ChatOpenAI familyOne of its sources says the weights aren't publicly available.The maker lists this model as deprecated (23 Oct 2026).
From Eurouter's listing:
o4-mini is OpenAI's compact reasoning model for math, coding, visual tasks, structured outputs, and tool use.
llminfo IQ
124.0
Max context
200K
Listings
43

Evidence and sources

llminfo IQ 124.0, ranked among chat models. From 384 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 100.7, 95% interval 87–114. From 11 benchmark families across 10 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedGood value (56.2). Cheaper per task than its benchmark results predict. From 41 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsTypical (53 ±16). Generates about as many tokens as models with similar coding results. Measured at low effort. A fair amount of data behind it. By effort: default 43 · low 53 · high 70.Median 20,591 output tokens per task at low effort.How the Yap score worksReleased 16 Apr 2025 Training-data cutoff, as its sources state it Maker HQ: US (according to OpenAI's own website)
All rankings: #479 on OpenRouter this monthSources: LMArena data, Models.dev data, LiteLLM data, OpenRouter data docs, EURouter data, llminfo researchPrimary data from LMArena from Models.dev: name, weights availability from LiteLLM: deprecation date from OpenRouter: knowledge cutoff from EURouter: description from llminfo research: release date
Tags from its sources:reasoninglong-contextefficientcodingmathvision

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

Deprecated by its maker

The maker has already deprecated this model (23 Oct 2026).

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputWeb searchBatch API

Listings

 OpenAIo4-mini-batch · batchSource: Helicone Costs dataNot published by the provider$0.55$2.20—
 Microsoft Azureo4-mini-batch · batchSource: Helicone Costs dataNot published by the provider$0.55$2.20—
 OpenRouteropenai/o4-mini:batch · batchSource: OpenRouter data docs200K$0.55cache read $0.1375$2.20—
 Poeopenai/o4-miniSource: Models.dev data200K$0.99cache read $0.25$4.00—
 Replicatereplicate/openai/o4-miniSource: LiteLLM dataNot published by the provider$1.00$4.00—
 Tokenmixo4-miniSources: TokenMix data, TokenMix PricingNot published by the provider$1.067$4.268—
 302aio4-miniSource: 302.ai data200K$1.10$4.40—
 Aihubmixo4-miniSource: AIHubMix data docs200K$1.10cache read $0.275$4.40—
 Fastrouteropenai/o4-miniSource: FastRouter data200K$1.10cache read $0.275batch $0.55$4.40batch $2.20$0.00084
 Flowdotopenai/o4-miniSource: FlowDot data200K$1.10$4.40—
Show all 38 listings

Showing 10 of 38: the maker's own listing first, then the cheapest per 1M input tokens from each provider.

Also sold by Abacus, Cloudflare AI Gateway, Core42, Eurouter, Impossibl, Jiekou, Kilo, Merge Gateway, Requesty, Vercel, Vercel AI Gateway.

5 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score

Human preference

Arena ELO44 related benchmarks · 49 results
Arena ELO
Source: LMArena data · Nov 2026
Arena-Hard-v2.0-Preview
Source: Arena-Hard-Auto data
Reasoning effort · Arena-Hard-v2.0-Preview · Creative Writing, Ensemble GPT-4.1 and Gemini 2.5 as Judges (Best Configuration for Creative Writing) · gemini-2.0-flash-001
Effort not reported
Reasoning effort · Arena-Hard-v2.0-Preview · Hard Prompt, Style Control, and Gemini-2.5 as Judge (Official Configuration) · o3-mini-2025-01-31
Effort not reported
Reasoning effort · Arena-Hard-v2.0-Preview · Hard Prompt, Style Control, and GPT-4.1 as Judge (If prefer OpenAI API) · o3-mini-2025-01-31
Effort not reported
Chinese
Source: LMArena data · Nov 2026
Creative Writing
Source: LMArena data · Nov 2026
English
Source: LMArena data · Nov 2026
Exclude Ties
Source: LMArena data · Nov 2026
Show 38 more resultsHide 38 results
Expert
Source: LMArena data · Nov 2026
French
Source: LMArena data · Nov 2026
German
Source: LMArena data · Nov 2026
Hard Prompts
Source: LMArena data · Nov 2026
Hard Prompts English
Source: LMArena data · Nov 2026
Industry Entertainment and Sports and Media
Source: LMArena data · Nov 2026
Industry Life and Physical and Social Science
Source: LMArena data · Nov 2026
Industry Mathematical
Source: LMArena data · Nov 2026
Industry Medicine and Healthcare
Source: LMArena data · Nov 2026
Industry Software and It Services
Source: LMArena data · Nov 2026
Industry Writing and Literature and Language
Source: LMArena data · Nov 2026
Japanese
Source: LMArena data · Nov 2026
Korean
Source: LMArena data · Nov 2026
Longer Query
Source: LMArena data · Nov 2026
Multi Turn
Source: LMArena data · Nov 2026
Non English
Source: LMArena data · Nov 2026
Polish
Source: LMArena data · Nov 2026
Russian
Source: LMArena data · Nov 2026
Spanish
Source: LMArena data · Nov 2026
Style-Controlled
Source: LMArena data · Nov 2026
Text Factuality
Source: LMArena data · Nov 2026
Text Factuality - English
Source: LMArena data · Nov 2026
Text Factuality - Exclude Ties
Source: LMArena data · Nov 2026
Text Factuality - Hard Prompts
Source: LMArena data · Nov 2026
Text Factuality - Non English
Source: LMArena data · Nov 2026
Vision
Source: LMArena data · Nov 2026
Vision - Captioning
Source: LMArena data · Nov 2026
Vision - Chinese
Source: LMArena data · Nov 2026
Vision - Creative Writing
Source: LMArena data · Jan 2026
Vision - Creative Writing Vision
Source: LMArena data · Nov 2026
Vision - Diagram
Source: LMArena data · Nov 2026
Vision - English
Source: LMArena data · Nov 2026
Vision - Entity Recognition
Source: LMArena data · Nov 2026
Vision - Homework
Source: LMArena data · Nov 2026
Vision - Humor
Source: LMArena data · Nov 2026
Vision Style-Controlled
Source: LMArena data · Nov 2026

Agentic

GAIA4 results
Source: GAIA Leaderboard data · May 2025
Difficulty level
Difficulty not reported
tau2-bench v0.112 related benchmarks · 12 results
retail pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
retail pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
Show 6 more resultsHide 6 results
retail pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
retail pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-o4-mini_openai_2024-06-20, usersim-gpt-4.1-2025-04-14

Reasoning

Knowledge

Coding

Math

AIME 2024Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
AIME 2025Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MathVistaSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ValsSource: Vals AI

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Vision

MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Long context

Factuality

Instruction following

OCR

Speech

Other

MedHELM33 related benchmarks · 33 results
Nejumi 428 related benchmarks · 28 results

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Steel.dev Agent Leaderboards, MIT (licence) · Data by LLM Stats · LMArena, CC BY 4.0 (licence) · Arena-Hard-Auto, LMArena, Apache-2.0 (licence) · BullshitBench by Peter Gostev, MIT (licence) · CharXiv (Wang et al., NeurIPS 2024), Princeton NLP. https://charxiv.github.io · CyberGym leaderboard (Wang, Shi, He, Cai, Zhang, Song; UC Berkeley), ICLR 2026. Results evaluated and submitted by the listed teams. No licence is stated for the result data; the repository's Apache-2.0 licence covers its code only. · DABstep (Adyen), CC BY 4.0 (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · HAL (Princeton) — cite the HAL paper · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MMLU-ProX: Xuan et al., arXiv:2503.10497. Public project-page results; no results licence stated. · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · Trishul Lab, PutnamBench public submitted results. Model identities and scaffold budgets preserved; result licence unstated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · Sierra Research tau2-bench leaderboard submissions (github.com/sierra-research/tau2-bench), MIT (licence) · Clinical Benchmarks (clinicalbenchmarks.ai), CC BY 4.0; fractions converted to percentages; source documents retain their own terms (licence) · Vectara Hallucination Leaderboard, Apache-2.0 (licence)

Also known as: azure/eu/o4-mini, azure/eu/o4-mini-2025-04-16, azure/o4-mini, azure/o4-mini-2025-04-16, azure/o4-mini@eastus2, azure/o4-mini@francecentral, azure/o4-mini@swedencentral, azure/o4-mini@westus3, azure/us/o4-mini, azure/us/o4-mini-2025-04-16, o4-mini-0416, o4-mini-2025-04-16, o4-mini@eu, openai/o4-mini, openai/o4-mini-high, openai/o4-mini:batch, replicate/openai/o4-mini, vercel_ai_gateway/openai/o4-mini

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works