Benchmark
RULER · 512K
Long context benchmarks measure how well models use information in long inputs. Scores are percentages. Higher is better.
- Models measured
- 1
- Scores recorded
- 2
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 95.4%
- Mean
- 95.7%
- Median
- 0.225%
- Std dev
- 95.2%
- 10th percentile
- 95.7%
- 90th percentile
- 95.2%
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Nemotron 3 Super 120B A12Bofficial HF model card · dedicated RULER container· Reported by NVIDIA· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 95.7% |
| 2 | Nemotron 3 Super 120B A12Btechnical report Table 5/8 · dedicated RULER container· Reported by NVIDIA· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 95.2% |