Skip to content

Benchmark

NoCha pair accuracy (random-reference-common)

Long context benchmarks measure how well models use information in long inputs. Scores are percentages. Higher is better.

Models and systems measured
1
Scores recorded
1
Sources
1
IQ weight
No weight published

Score distribution

25%
Mean
25%
Median
0%
Std dev
25%
10th percentile
25%
90th percentile
25%
Min

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
Randomtable: 3, view: random-reference-common, system: Random· NoCha (arXiv:2406.16264v3) data25%

Data credits: Marzena Karpinska, Katherine Thai, Kyle Lo, Tanya Goyal and Mohit Iyyer. One Thousand and One Pairs, arXiv:2406.16264v3. CC BY 4.0 article numeric/protocol extract; restructured, printed values unchanged. No task, book or dataset rights asserted. (licence)