Skip to content

OpenAI · Chat

GPT 4.1

OpenAI 🇺🇸ChatGPT familyOne of its sources says the weights aren't publicly available.The maker currently plans to deprecate it within the next 180 days (14 Jan 2027). Plans can change.

Newer version: GPT 6. Our catalogue has no release date for GPT 4.1. We compared the version names in our catalogue.

From Netmind's listing:
GPT-4.1 is a flagship model from OpenAI with a 1M-token context window, offering major gains in coding, instruction following, and long-context comprehension over GPT-4o. It provides reliable function calling and accepts text and image inputs, well suited for agentic workflows, coding, and complex production tasks.
llminfo IQ
120.7
Maker's price
$1.75 blended / 1M
Max context
1M
Listings
73

Evidence and sources

llminfo IQ 120.7, ranked among chat models. From 486 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 92.4, 95% interval 87–98. From 13 benchmark families across 14 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (42.8). Costs more per task than its benchmark results predict. From 35 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsTerse (33 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.Median 4,589 output tokens per task at default effort.How the Yap score works Training-data cutoff, as its sources state it Maker HQ: US (according to OpenAI's own website)
All rankings: #131 on OpenRouter this month #138 on OpenRouter this week #148 on OpenRouter today #322 on NanoGPT recentlySources: OpenAI API data, Inference.net data, LMArena data, LiteLLM data, Models.dev data, AI/ML API data, OpenRouter data docs, NetMind.AIPrimary data from OpenAI API from Inference.net: name from LMArena: variant from LiteLLM: deprecation date from Models.dev: weights availability from AI/ML API: primary mode from OpenRouter: knowledge cutoff from NetMind.AI: description
Tags from its sources:instructtoolsvisionreasoningdocumentmultimodalfunction-callinglong-contextcoding

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Trade-offs

Deprecation scheduled

The maker plans to deprecate it on 14 Jan 2027, within the next 180 days.

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 7 maker's prices; 3 market median prices.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputWeb searchBatch API

Listings

 OpenAIgpt-4.1Sources: GenAI Prices data, LiteLLM data, Models.dev data, OpenAI API data1M$2.00cache read $0.50batch $1.00$8.00batch $4.00
 Microsoft Azuregpt-4.1-batch · batchSource: Helicone Costs dataNot published by the provider$1.00$4.00
 OpenRouteropenai/gpt-4.1:batch · batchSource: OpenRouter data docs1M$1.00cache read $0.25$4.00
 Vercelopenai/gpt-4.1-batch · batchSource: Vercel AI Gateway data1M$1.00cache read $0.25$4.00
 Poeopenai/gpt-4.1Source: Models.dev data1M$1.8182cache read $0.4545$7.2727
 302aigpt-4.1Sources: 302.ai data, Models.dev data1M$2.00$8.00
 Aihubmixgpt-4.1Source: AIHubMix data docs1M$2.00cache read $0.50$8.00
 Cometapigpt-4.1-2025-04-14 · 2025-04-14Sources: CometAPI data, CometAPI Pricing dataNot published by the provider$2.00$8.00
 Eden AIInference by OpenAIopenai/gpt-4.1Source: Models.dev data1M$2.00cache read $0.50$8.00
 Fastrouteropenai/gpt-4.1Sources: FastRouter data, Models.dev data1M$2.00cache read $0.50batch $1.00$8.00batch $4.00

13 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score
PhareSource: Phare

Human preference

Arena ELO50 related benchmarks · 52 results
Arena ELO
Source: LMArena data · Nov 2026
Arena-Hard-v2.0-Preview
Source: Arena-Hard-Auto data
Creative Writing, Ensemble GPT-4.1 and Gemini 2.5 as Judges (Best Configuration for Creative Writing)
Hard Prompt, Style Control, and Gemini-2.5 as Judge (Official Configuration)
Hard Prompt, Style Control, and GPT-4.1 as Judge (If prefer OpenAI API)
Chinese
Source: LMArena data · Nov 2026
Creative Writing
Source: LMArena data · Nov 2026
English
Source: LMArena data · Nov 2026
Exclude Ties
Source: LMArena data · Nov 2026
Show 44 more resultsHide 44 results
Expert
Source: LMArena data · Nov 2026
French
Source: LMArena data · Nov 2026
German
Source: LMArena data · Nov 2026
Hard Prompts
Source: LMArena data · Nov 2026
Hard Prompts English
Source: LMArena data · Nov 2026
Industry Entertainment and Sports and Media
Source: LMArena data · Nov 2026
Industry Life and Physical and Social Science
Source: LMArena data · Nov 2026
Industry Mathematical
Source: LMArena data · Nov 2026
Industry Medicine and Healthcare
Source: LMArena data · Nov 2026
Industry Software and It Services
Source: LMArena data · Nov 2026
Industry Writing and Literature and Language
Source: LMArena data · Nov 2026
Japanese
Source: LMArena data · Nov 2026
Korean
Source: LMArena data · Nov 2026
Longer Query
Source: LMArena data · Nov 2026
Multi Turn
Source: LMArena data · Nov 2026
Non English
Source: LMArena data · Nov 2026
Polish
Source: LMArena data · Nov 2026
Russian
Source: LMArena data · Nov 2026
Spanish
Source: LMArena data · Nov 2026
Style-Controlled
Source: LMArena data · Nov 2026
Text Factuality
Source: LMArena data · Nov 2026
Text Factuality - English
Source: LMArena data · Nov 2026
Text Factuality - Exclude Ties
Source: LMArena data · Nov 2026
Text Factuality - Hard Prompts
Source: LMArena data · Nov 2026
Text Factuality - Hard Prompts English
Source: LMArena data · Nov 2026
Text Factuality - Longer Query
Source: LMArena data · Nov 2026
Text Factuality - Multi Turn
Source: LMArena data · Nov 2026
Text Factuality - Non English
Source: LMArena data · Nov 2026
Vision
Source: LMArena data · Nov 2026
Vision - Captioning
Source: LMArena data · Nov 2026
Vision - Chinese
Source: LMArena data · Nov 2026
Vision - Creative Writing
Source: LMArena data · Jan 2026
Vision - Creative Writing Vision
Source: LMArena data · Nov 2026
Vision - Diagram
Source: LMArena data · Nov 2026
Vision - English
Source: LMArena data · Nov 2026
Vision - Entity Recognition
Source: LMArena data · Nov 2026
Vision - Homework
Source: LMArena data · Nov 2026
Vision - Humor
Source: LMArena data · Nov 2026
Vision Style-Controlled
Source: LMArena data · Nov 2026
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026

Agentic

GAIA4 results
Source: GAIA Leaderboard data · May 2025
Difficulty level
Difficulty not reported
hal-gaiaSource: HAL (Princeton)
tau2-bench13 related benchmarks · 16 results
airline
Source: OpenRouter benchmark exports · Oct 2026
gpt-4.1-2025-04-14 · 90-day results
Across 3 providers lowest 46% median 51.3% highest 52.3%OpenRouter's automatic routing 47.7%
Show results from 3 providers and OpenRouter's automatic routingHide results from 3 providers and OpenRouter's automatic routing
  • Azure
  • OpenAI
  • OpenRouter's automatic routing
  • FakeProvider
v0.1 airline pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 airline pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 airline pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 airline pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 retail pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
Show 7 more resultsHide 7 results
v0.1 retail pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 retail pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 retail pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 telecom pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 telecom pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 telecom pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14
v0.1 telecom pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-gpt-4-1_openai_2024-06-20, usersim-gpt-4.1-2025-04-14

Coding

SWE-bench Verified15 related benchmarks · 20 results
SWE-bench Verified
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
SWE-bench-Live Full
Source: SWE-bench-Live leaderboard data · May 2025
scaffold: swe-agent, set: full, instances: 1319
SWE-bench-Live Lite
Source: SWE-bench-Live leaderboard data · May 2025
By scaffold · set: lite · instances: 300
Show 12 more resultsHide 12 results
SWE-rebench 2025-05
Source: SWE-rebench
SWE-rebench 2025-06
Source: SWE-rebench

Knowledge

MMLU31 related benchmarks · 31 results
Show 25 more resultsHide 25 results

Vision

MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Multilingual

OCR

OmniDocBenchSource: Nanonets IDP data

Reasoning

COLLIESource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GraphwalksSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Math

AIME 2024Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
AIME 2025Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HMMT 2025Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MathVistaSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ValsSource: Vals AI

Long context

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GPQA Diamond4 results
Source: Epoch AI Benchmarking Hub data
Setting not stated
Source: OpenRouter benchmark exports · Oct 2026
gpt-4.1-2025-04-14 · 90-day results
Across 2 providers lowest 63.7% median 64.8% highest 66%OpenRouter's automatic routing 63.7%
Show results from 2 providers and OpenRouter's automatic routingHide results from 2 providers and OpenRouter's automatic routing
  • OpenAI
  • OpenRouter's automatic routing
  • Azure

Factuality

General

Instruction following

IFEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Multi-IFSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Speech

Other

Horangi36 related benchmarks · 36 results
Indigenous Americas89 related benchmarks · 89 results
Show 83 more resultsHide 83 results
Nejumi 428 related benchmarks · 28 results
ValsSource: Vals AI

Data credits: OpenVLM Leaderboard (OpenCompass / VLMEvalKit), Apache-2.0 (licence) · Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Data by LLM Stats · LMArena, CC BY 4.0 (licence) · Arena-Hard-Auto, LMArena, Apache-2.0 (licence) · ArtifactsBench (Tencent Hunyuan), CC BY 4.0 (licence) · Berkeley Function-Calling Leaderboard (Gorilla, UC Berkeley), Apache-2.0 (licence) · BullshitBench by Peter Gostev, MIT (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · CharXiv (Wang et al., NeurIPS 2024), Princeton NLP. https://charxiv.github.io · CyberGym leaderboard (Wang, Shi, He, Cai, Zhang, Song; UC Berkeley), ICLR 2026. Results evaluated and submitted by the listed teams. No licence is stated for the result data; the repository's Apache-2.0 licence covers its code only. · DABstep (Adyen), CC BY 4.0 (licence) · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · Galileo Agent Leaderboard, Apache-2.0 (licence) · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · HAL (Princeton) — cite the HAL paper · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · Horangi 4, Weights & Biases Korea; public publisher-selected numeric evaluation results · Vasselli, Martínez Peguero, Hudi, Sakajo and Watanabe. Measuring Linguistic Competence of LLMs on Indigenous Languages of the Americas. EACL 2026, ©2026 ACL, CC BY 4.0. Numeric/protocol extract from Tables 1–4; random reference rows omitted. (licence) · LiveMCPBench leaderboard, ICIP-CAS (Mo et al., 2025). Sheet linked from the Apache-2.0 project README; sheet licence not separately stated. · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MineBench, MIT (licence) · MMLU-ProX: Xuan et al., arXiv:2503.10497. Public project-page results; no results licence stated. · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · Phare (Giskard), CC BY 4.0 (licence) · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · Swallow LLM Leaderboard v2, Swallow LLM team (Institute of Science Tokyo). Contents CC BY 4.0; Japanese post-trained task scores on the source's 0..1 scale. (licence) · SWE-bench-Live (Microsoft and contributors), swe-bench-live.github.io. Resolve rates computed from the published report counts. · Sierra Research tau2-bench leaderboard submissions (github.com/sierra-research/tau2-bench), MIT (licence) · Vectara Hallucination Leaderboard, Apache-2.0 (licence)

Also known as: azure/eu/gpt-4.1, azure/gpt-4.1, azure/gpt-4.1-2025-04-14, azure/gpt-4.1@eastus2, azure/gpt-4.1@francecentral, azure/gpt-4.1@swedencentral, azure/gpt-4.1@westus3, azure/us-gov/gpt-4.1, azure/us/gpt-4.1, azure/us/gpt-4.1-2025-04-14, github_copilot/gpt-4.1, github_copilot/gpt-4.1-2025-04-14, gpt-4.1-2025-04-14, gpt-4.1@eu, openai-gpt-4.1, openai/gpt-4-1, openai/gpt-4.1, openai/gpt-4.1-2025-04-14, openai/gpt-4.1-batch, openai/gpt-4.1-fast, openai/gpt-4.1:batch, replicate/openai/gpt-4.1, snowflake/openai-gpt-4.1, vercel_ai_gateway/openai/gpt-4.1

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works