Skip to content

Benchmark

Arena ELO Vision - Entity Recognition

People compare model answers and choose which they prefer. Higher scores are better.

Models measured
44
Scores recorded
51
Sources
1
IQ weight
1.50

Score distribution

1,234.7
Mean
1,228.7
Median
48.5
Std dev
1,183.1
10th percentile
1,288.8
90th percentile
1,140.6
Min
1,140.61,346.5
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.50 for chat models, measured over 44 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51Mistral Medium 32505· LMArena data1,140.6

Showing 51–51 of 51 results.

Data credits: LMArena, CC BY 4.0 (licence)