Skip to content

xAI · Chat

Grok 2

xAI 🇺🇸ChatGrok family
llminfo IQ
112.6
Maker's price
$4.00 blended / 1M
Max context
131K
Listings
8

Evidence and sources

🤗 xai-org/grok-2llminfo IQ 112.6, ranked among chat models. From 78 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 83.1, 95% interval 73–93. From 4 benchmark families across 4 sources. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (25.9). Costs more per task than its benchmark results predict. From 10 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksReleased 13 Aug 2024Maker HQ: US (according to xAI's own website)
Sources: LMArena data, llminfo researchPrimary data from LMArena from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 9 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

Function calling

Listings

 xAIgrok-2-1212 · 1212Source: GenAI Prices data33K$2.00$10.00
 302aigrok-2-1212 · 1212Source: 302.ai data131K$2.00$10.00
 Aihubmixgrok-2-1212 · 1212Source: AIHubMix data docsNot published by the provider$1.80$9.00
 OpenRoutergrok-2-1212 · 1212Source: GenAI Prices dataNot published by the provider$2.00$10.00
 Vercelxai/grok-2Source: Helicone Costs dataNot published by the provider$2.00$10.00
 Vercel AI Gatewayvercel_ai_gateway/xai/grok-2Source: LiteLLM data131K$2.00$10.00

2 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Math

MATHSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ValsSource: Vals AI

General

Reasoning

Coding

HumanEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

MMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MMLU-ProSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Safety

PhareSource: Phare

Vision

DocVQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Factuality

Instruction following

Other

Data credits: LMArena, CC BY 4.0 (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · Data by LLM Stats · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · Phare (Giskard), CC BY 4.0 (licence)

Around the web

Also known as: grok-2-1212, grok-2-2024-08-13, vercel_ai_gateway/xai/grok-2, x-ai/grok-2-1212, xai/grok-2

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works