Skip to content

Benchmark

Arena ELO Text Factuality - Expert

People compare model answers and choose which they prefer. Higher scores are better.

Models measured
114
Scores recorded
130
Sources
1
IQ weight
2.21

Score distribution

1,480.4
Mean
1,482
Median
33.7
Std dev
1,437.1
10th percentile
1,522
90th percentile
1,386.2
Min
1,386.21,552.1
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.21 for chat models, measured over 114 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
101Kimi K2 Thinking· LMArena data1,453.8
102DeepSeek V3.2Thinking· LMArena data1,452.2
103Mistral Large 3· LMArena data1,451.8
104ERNIE 5.00110· LMArena data1,450.9
105Qwen3.5 122B-A10B· LMArena data1,450.7
106Gemini 3 FlashMinimal· LMArena data1,450.6
107Claude Opus 4.1Thinking 16K, 20250805· LMArena data1,447.8
108GPT-5.5 Instant· LMArena data1,447.7
109Qwen3.5 27B· LMArena data1,446.5
110Grok 4.1Thinking· LMArena data1,445.6
111GPT 5.4 NanoHigh· LMArena data1,443.1
112Step 3.5 Flash· LMArena data1,442.9
113nova-experimental-chat11-10· LMArena data1,442.3
114ChatGPT-4o Latest20250326· LMArena data1,441.6
115MiMo V2 FlashNon-Thinking· LMArena data1,440.6
116Doubao Seed 2.0 Pro· LMArena data1,437.3
117Gemini 2.5 Flash Preview09-2025· LMArena data1,437.1
118Mistral Medium 3.12508· LMArena data1,436.9
119Gemini 3.1 Flash Lite· LMArena data1,434
120Grok 4.3· LMArena data1,432.7
121GPT-5.3 Chat· LMArena data1,432.2
122Grok 4.1· LMArena data1,430.5
123Qwen3.5 35B A3B· LMArena data1,429.5
124Qwen3.5 Flash· LMArena data1,426.4
125Gemini 2.5 Flash-Lite PreviewNon-Thinking, 09-2025· LMArena data1,421.4
126Grok 4.1 FastReasoning· LMArena data1,420.1
127MiniMax M2.5· LMArena data1,406.7
128Nemotron 3.5 Lightning 30B A3BNVFP4· LMArena data1,406.7
129Trinity Large Thinking· LMArena data1,402.9
130Trinity Large Preview· LMArena data1,386.2

Showing 101–130 of 130 results.

Data credits: LMArena, CC BY 4.0 (licence)