Skip to content

Benchmark

Arena ELO - Longer Query

People compare model answers and choose which they prefer. Higher scores are better.

Models measured
345
Scores recorded
401
Sources
1
IQ weight
1.34

Score distribution

1,323.7
Mean
1,357.1
Median
137.1
Std dev
1,102.6
10th percentile
1,475.3
90th percentile
951.6
Min
951.61,549
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.34 for chat models, measured over 345 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
401ChatGLM3 6B· LMArena data951.6

Showing 401–401 of 401 results.

Data credits: LMArena, CC BY 4.0 (licence)