Skip to content

Benchmark

Arena ELO Text Factuality - Hard Prompts

People compare model answers and choose which they prefer. Higher scores are better.

Models measured
168
Scores recorded
192
Sources
1
IQ weight
2.23

Score distribution

1,459.1
Mean
1,464.1
Median
40.8
Std dev
1,401.2
10th percentile
1,502.4
90th percentile
1,311.6
Min
1,311.61,544.8
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.23 for chat models, measured over 168 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
151Grok 40709· LMArena data1,437.8
152Step 3.5 Flash· LMArena data1,437.5
153GPT 5.4 NanoHigh· LMArena data1,436.9
154GPT 5High· LMArena data1,435.9
155nova-experimental-chat11-10· LMArena data1,435.4
156Qwen3.5 Flash· LMArena data1,432.1
157MiMo V2 FlashThinking· LMArena data1,429.8
158Grok 4 FastReasoning· LMArena data1,429.2
159nova-experimental-chat26-01-10· LMArena data1,429.1
160Grok 4.1 FastReasoning· LMArena data1,427.8
161Qwen3.5 35B A3B· LMArena data1,424
162Muse Glimmer· LMArena data1,423.1
163GPT 4.12025-04-14· LMArena data1,418.7
164GPT-5 miniHigh· LMArena data1,417.4
165Gemini 2.5 Flash-Lite PreviewNon-Thinking, 09-2025· LMArena data1,416.3
166nova-experimental-chat10-20· LMArena data1,413.6
167OpenAI o32025-04-16· LMArena data1,411
168Nemotron 3 Super 120B A12B· LMArena data1,409.3
169MiniMax M2.5· LMArena data1,408.9
170GLM 4.5 Air· LMArena data1,404.8
171GPT OSS 120B· LMArena data1,404.7
172GLM 4.6v· LMArena data1,401.8
173Granite 4.2 30B· LMArena data1,401.2
174Nova 2 Lite· LMArena data1,395.6
175Trinity Large Preview· LMArena data1,393.5
176Nemotron 3.5 Lightning 30B A3BNVFP4· LMArena data1,393.2
177Gemma 3 27B IT· LMArena data1,392.8
178MiniMax M2· LMArena data1,386.5
179GLM 4.7 Flash· LMArena data1,386.3
180Trinity Large Thinking· LMArena data1,385.5
181o4 Mini2025-04-16· LMArena data1,385
182Mercury 2· LMArena data1,384
183MiniMax M1· LMArena data1,383.3
184INTELLECT-3· LMArena data1,382.5
185Nemotron 3 Nano 30B A3BBF16· LMArena data1,376.7
186Command A03-2025· LMArena data1,364
187Granite 4.2 8B· LMArena data1,363
188Olmo 3.1 32B Instruct· LMArena data1,361.7
189Granite 4.2 3B· LMArena data1,353.3
190Olmo 3 32B Think· LMArena data1,334.9
191Granite 4.1 8B· LMArena data1,328.4
192Olmo 3.1 32B Think· LMArena data1,311.6

Showing 151–192 of 192 results.

Data credits: LMArena, CC BY 4.0 (licence)