Skip to content

Benchmark

PACT (Lech Mazur)

Models measured
25
Scores recorded
25
Sources
1
IQ weight
1.48

Score distribution

1,521.6
Mean
1,520
Median
49.5
Std dev
1,449
10th percentile
1,570
90th percentile
1,394
Min
1,3941,607
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.48 for chat models, measured over 25 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard