Benchmark
RULER · 256K
Long context benchmarks measure how well models use information in long inputs. Scores are percentages. Higher is better.
- Models measured
- 1
- Scores recorded
- 2
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 96.6%
- Mean
- 96.8%
- Median
- 0.265%
- Std dev
- 96.3%
- 10th percentile
- 96.8%
- 90th percentile
- 96.3%
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Nemotron 3 Super 120B A12Btechnical report Table 5/8 · dedicated RULER container· Reported by NVIDIA· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 96.8% |
| 2 | Nemotron 3 Super 120B A12Bofficial HF model card · dedicated RULER container· Reported by NVIDIA· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 96.3% |