Skip to content

Benchmark

LLM Chess Wrong Moves per 1000 Moves

Lower scores are better.

Models measured
149
Scores recorded
206
Sources
1
IQ weight
1.97

Score distribution

43.7
Mean
9.1
Median
76.9
Std dev
0.483
10th percentile
141
90th percentile
0
Min
0458.3
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.97 for chat models, measured over 149 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Showing 201–206 of 206 results.

Data credits: LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence)