Skip to content

OpenAI · Chat

GPT-4o mini

OpenAI 🇺🇸ChatGPT familyOne of its sources says the weights aren't publicly available.The maker currently plans to deprecate it within the next 180 days (14 Jan 2027). Plans can change.
From Netmind's listing:
GPT-4o mini is a fast, cost-efficient multimodal model from OpenAI that accepts text and image inputs and returns text. It delivers solid reasoning and reliable function calling with a 128K-token context window at a fraction of the flagship price, ideal for high-volume, latency-sensitive, and everyday tasks.
llminfo IQ
108.6
Max context
131K
Listings
81

Evidence and sources

llminfo IQ 108.6, ranked among chat models. From 478 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 71.8, 95% interval 54–90. From 7 benchmark families across 8 sources. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (22.1). Costs more per task than its benchmark results predict. From 19 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksReleased 18 Jul 2024 Training-data cutoff, as its sources state it Maker HQ: US (according to OpenAI's own website)
All rankings: #72 on OpenRouter today #74 on OpenRouter this month #77 on OpenRouter this week #182 on NanoGPT recentlySources: OpenAI API data, LMArena data, LiteLLM data, Models.dev data, AI/ML API data, OpenRouter data docs, NetMind.AI, llminfo researchPrimary data from OpenAI API from LMArena: name, variant from LiteLLM: deprecation date from Models.dev: weights availability from AI/ML API: primary mode from OpenRouter: knowledge cutoff from NetMind.AI: description from llminfo research: release date
Tags from its sources:instructtoolsvisionreasoningdocumentmultimodalfunction-callingefficient

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

Deprecation scheduled

The maker plans to deprecate it on 14 Jan 2027, within the next 180 days.

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputWeb searchBatch API

Listings

 OpenAIgpt-4o-miniSources: GenAI Prices data, LiteLLM data, Models.dev data, OpenAI API data128K$0.15cache read $0.075batch $0.075$0.60batch $0.30
 Microsoft Azuregpt-4o-mini-batch · batchSource: Helicone Costs dataNot published by the provider$0.075$0.30
 OpenRouteropenai/gpt-4o-mini:batch · batchSource: OpenRouter data docs128K$0.075cache read $0.0375$0.30
 Vercelopenai/gpt-4o-mini-batch · batchSource: Vercel AI Gateway data128K$0.075cache read $0.0375$0.30
 Cloudflare AI Gatewayopenai/gpt-4o-miniSource: Models.dev data128K$0.075cache read $0.0375$0.30
 Meganovaopenai/gpt-4o-miniSource: MegaNova data128K$0.12$0.48
 Poeopenai/gpt-4o-miniSource: Models.dev data124K$0.1364cache read $0.0682$0.5455
 302aigpt-4o-mini-2024-07-18 · 2024-07-18Source: 302.ai data128K$0.15$0.60
 Aihubmixgpt-4o-miniSource: AIHubMix data docs128K$0.15cache read $0.075$0.60
 Cometapigpt-4o-mini-2024-07-18 · 2024-07-18Sources: CometAPI data, CometAPI Pricing dataNot published by the provider$0.15$0.60

14 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Math

MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MathVistaSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MGSMSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
mu-MATH7 related benchmarks · 35 results
F1
Source: U-MATH and mu-MATH
F1 · Qwen/Qwen2.5-72B-Instruct
accuracy
Source: U-MATH and mu-MATH
accuracy · Qwen/Qwen2.5-72B-Instruct
MCC
Source: U-MATH and mu-MATH
MCC · Qwen/Qwen2.5-72B-Instruct
NPV
Source: U-MATH and mu-MATH
NPV · Qwen/Qwen2.5-72B-Instruct
PPV
Source: U-MATH and mu-MATH
PPV · Qwen/Qwen2.5-72B-Instruct
TNR
Source: U-MATH and mu-MATH
TNR · Qwen/Qwen2.5-72B-Instruct
Show 5 more resultsHide 5 results
TPR
Source: U-MATH and mu-MATH
TPR · Qwen/Qwen2.5-72B-Instruct
U-MATH7 related benchmarks · 21 results
algebra accuracy
Source: U-MATH and mu-MATH
Task set · algebra · gpt-4o-2024-08-06
differential_calc accuracy
Source: U-MATH and mu-MATH
Task set · differential_calc · gpt-4o-2024-08-06
integral_calc accuracy
Source: U-MATH and mu-MATH
Task set · integral_calc · gpt-4o-2024-08-06
multivariable_calculus accuracy
Source: U-MATH and mu-MATH
Task set · multivariable_calculus · gpt-4o-2024-08-06
overall accuracy
Source: U-MATH and mu-MATH
Task set · u_math · gpt-4o-2024-08-06
precalculus_review accuracy
Source: U-MATH and mu-MATH
Task set · precalculus_review · gpt-4o-2024-08-06
Show 3 more resultsHide 3 results
sequences_series accuracy
Source: U-MATH and mu-MATH
Task set · sequences_series · gpt-4o-2024-08-06
ValsSource: Vals AI

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score
PhareSource: Phare

Knowledge

HELM60 related benchmarks · 60 results
Show 54 more resultsHide 54 results
MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Agentic

BrowserGymSource: BrowserGym Leaderboard
GAIA4 results
Source: GAIA Leaderboard data · Oct 2024
Difficulty level
Difficulty not reported

Human preference

Arena ELO31 related benchmarks · 31 results
WildBench6 related benchmarks · 6 results
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro

Multilingual

EKI EstonianSource: Keelemudelite mõõdupuu data docs
FormosanBench MT BLEUSource: FormosanBench (arXiv:2506.21563v1) data
SeaLLMs16 related benchmarks · 16 results
Show 10 more resultsHide 10 results

Coding

HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GPQA Diamond4 results
Source: Epoch AI Benchmarking Hub data
Setting not stated
Source: OpenRouter benchmark exports · Oct 2026
gpt-4o-mini · 90-day results
Across 2 providers lowest 42.8% median 43% highest 43.1%OpenRouter's automatic routing 43.6%
Show results from 2 providers and OpenRouter's automatic routingHide results from 2 providers and OpenRouter's automatic routing
  • OpenRouter's automatic routing
  • Azure
  • OpenAI

Reasoning

DROPSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Vision

MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Factuality

FaithJudge Hallucination RateSource: FaithJudge data

Instruction following

Speech

Other

MedHELM33 related benchmarks · 33 results
Nejumi 428 related benchmarks · 28 results
Open Greek FinLLM11 related benchmarks · 11 results
QA raw score
Source: TheFinAI public numeric results
greek-contents, QA, QA Raw
FinNum raw score
Source: TheFinAI public numeric results
greek-contents, FinNum, FinNum Raw
FinText raw score
Source: TheFinAI public numeric results
greek-contents, FinText, FinText Raw
Show 5 more resultsHide 5 results
FNS raw score
Source: TheFinAI public numeric results
greek-contents, FNS, FNS Raw
MultiFin raw score
Source: TheFinAI public numeric results
greek-contents, MultiFin, MultiFin Raw
overall normalized index
Source: TheFinAI public numeric results
greek-contents, published-average
ValsSource: Vals AI

Data credits: ACEBench, MIT (licence) · AgentDojo. Copyright (c) 2024 Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. MIT License. Not a leaderboard: attack and defense coverage differs between models. (licence) · Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · LMArena, CC BY 4.0 (licence) · BrowserGym Leaderboard (ServiceNow), MIT (licence) · BullshitBench by Peter Gostev, MIT (licence) · CharXiv (Wang et al., NeurIPS 2024), Princeton NLP. https://charxiv.github.io · ChemBench leaderboard, Jablonka group / lamalab-org. Public verified numeric result summaries; results licence not separately stated. · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · Data by LLM Stats · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · Lin, Chen and Zhang, FormosanBench: Benchmarking Low-Resource Austronesian Languages in the Era of Large Language Models, arXiv:2506.21563v1, CC BY 4.0. Scores extracted from Tables 2-4. (licence) · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Stanford HELM (Stanford CRFM), Apache-2.0 (licence) · JMLE2026-Bench and IgakuQA119 by Naoto Iwase; results licence not stated (code MIT, question data CC BY 4.0). · JudgeBench, Sijun Tan et al., ScalerLab · KazBench by Yersultan Akhmer. Provisional DEV numeric results; code MIT and task-data CC BY 4.0 do not establish a separate score licence. · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · M-IFEval: Dussolle, Cardeña Díaz, Sato and Devine (Lightblue), arXiv:2502.04688. README leaderboard, repository licensed Apache-2.0. (licence) · Toloka, U-MATH and mu-MATH public leaderboard. MIT Space; generated solution outputs retain underlying model terms and are not ingested. (licence) · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · Orak leaderboard, KRAFTON AI (Park et al., NeurIPS 2025). Public numeric scores; leaderboard licence not stated (code MIT not applied; CC BY-NC trajectories not used). · Phare (Giskard), CC BY 4.0 (licence) · Trishul Lab, PutnamBench public submitted results. Model identities and scaffold budgets preserved; result licence unstated. · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · SWE-Effi (Centre for Software Excellence), Apache-2.0; resolved rate converted to percent; resource figures are per-task means (licence) · UzLiB, Tahrirchi (Abror Shopulatov). Public LEADERBOARD.md numbers; repository MIT covers software and documentation, no separate results licence stated and none asserted. · WildBench, Allen Institute for AI · WildVision Arena, MIT (licence)

Also known as: azure/eu/gpt-4o-mini, azure/eu/gpt-4o-mini-2024-07-18, azure/global-standard/gpt-4o-mini, azure/gpt-4o-mini, azure/gpt-4o-mini-2024-07-18, azure/gpt-4o-mini@eastus2, azure/gpt-4o-mini@swedencentral, azure/us-gov/gpt-4o-mini, azure/us/gpt-4o-mini, azure/us/gpt-4o-mini-2024-07-18, github_copilot/gpt-4o-mini, github_copilot/gpt-4o-mini-2024-07-18, gmi/openai/gpt-4o-mini, gpt-4o mini, gpt-4o-mini-0718, gpt-4o-mini-2024-07-18, gpt-4o-mini@eu, gradient_ai/openai-gpt-4o-mini, openai-gpt-4o-mini, openai-gpt-4o-mini-2024-07-18, openai/gpt-4o-mini, openai/gpt-4o-mini-2024-07-18, openai/gpt-4o-mini-batch, openai/gpt-4o-mini-fast, openai/gpt-4o-mini-search, openai/gpt-4o-mini:batch, replicate/openai/gpt-4o-mini, vercel_ai_gateway/openai/gpt-4o-mini

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works