Skip to content

Benchmark

SnakeBench

Scores are percentages.

Models measured
260
Scores recorded
267
Sources
1
IQ weight
1.32

Score distribution

22.1%
Mean
22.5%
Median
7.3%
Std dev
13.2%
10th percentile
32.2%
90th percentile
1.2%
Min
1.2%38.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.32 for chat models, measured over 254 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Showing 251–267 of 267 results.

Data credits: SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence)