Skip to content

xAI · Chat

Grok 4

xAI 🇺🇸ChatGrok familyOne of its sources says the weights aren't publicly available.The maker currently plans to deprecate it within the next 180 days (31 Jan 2027). Plans can change.
From Llmgateway's listing:
Latest Grok 4 with vision and tool support.
llminfo IQ
125.2
Maker's price
$6.00 blended / 1M
Max context
262K
Listings
21

Evidence and sources

llminfo IQ 125.2, ranked among chat models. From 296 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 98.0, 95% interval 85–111. From 6 benchmark families across 8 sources. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (32.7). Costs more per task than its benchmark results predict. From 39 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksReleased 9 Jul 2025Maker HQ: US (according to xAI's own website)
Sources: LMArena data, LiteLLM data, Models.dev data, LLMGateway data, llminfo researchPrimary data from LMArena from LiteLLM: deprecation date from Models.dev: weights availability from LLMGateway: description from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

Deprecation scheduled

The maker plans to deprecate it on 31 Jan 2027, within the next 180 days.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 9 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Images
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputWeb search

Listings

 xAIgrok-4-0709 · 0709Source: GenAI Prices data256K$3.00cache read $0.75$15.00
 Jiekougrok-4-0709 · 0709Source: Models.dev data256K$2.85$14.25
 Microsoft Azureazure_ai/grok-4Source: LiteLLM data262K$3.00$15.00
 302aigrok-4Source: 302.ai data256K$3.00$15.00
 Fastrouterx-ai/grok-4Source: Models.dev data256K$3.00cache read $0.75$15.00
 Flowdotx-ai/grok-4Source: FlowDot data256K$3.00$15.00
 Llmgatewaygrok-4Source: LLMGateway data256K$3.00cache read $0.75$15.00
 OpenRouterx-ai/grok-4Source: Helicone Costs dataNot published by the provider$3.00$15.00
 RequestyInference by xAIxai/grok-4Source: Requesty data256K$3.00>128k $6.00cache read $0.75$15.00>128k $30.00cache write $3.00
 Vercelxai/grok-4Source: Helicone Costs dataNot published by the provider$3.00$15.00
Show all 19 listings

Showing 10 of 19: the maker's own listing first, then the cheapest per 1M input tokens from each provider.

Also sold by Abacus, Aihubmix, Llmgateway Providers, Oci, Poe, Replicate, Vercel AI Gateway.

2 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score
PhareSource: Phare

Human preference

Arena ELO55 related benchmarks · 55 results
English
Expert
Show 49 more resultsHide 49 results
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026

Agentic

Gaia2Source: Gaia2 (Meta ARE) data · Sep 2025

Math

AIME 2025Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
HMMT25Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
USAMO25Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ValsSource: Vals AI

Coding

Long context

Reasoning

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

General

Vision

Instruction following

Factuality

Knowledge

OCR

Speech

Other

Nejumi 428 related benchmarks · 28 results

Data credits: Aider LLM Leaderboards (Aider-AI), Apache-2.0 (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Data by LLM Stats · LMArena, CC BY 4.0 (licence) · Berkeley Function-Calling Leaderboard (Gorilla, UC Berkeley), Apache-2.0 (licence) · CyBench — cite Zhang et al. 2025 · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · FinSearchComp, CC BY 4.0 (licence) · Galileo Agent Leaderboard, Apache-2.0 (licence) · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · MathArena (ETH SRI / INSAIT), MIT — cite dekoninck2026matharena (licence) · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · Phare (Giskard), CC BY 4.0 (licence) · Clinical Benchmarks (clinicalbenchmarks.ai), CC BY 4.0; fractions converted to percentages; source documents retain their own terms (licence)

Around the web

Also known as: azure_ai/grok-4, grok-4-0709, grok-4-search, oci/xai.grok-4, replicate/xai/grok-4, vercel_ai_gateway/xai/grok-4, x-ai/grok-4, xai/grok-4

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works