Benchmark
Scale AI Multi-Challenge
Instruction following benchmarks measure how closely models follow instructions. Scores are percentages. Higher is better.
- Models measured
- 2
- Scores recorded
- 2
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 59.5%
- Mean
- 63.8%
- Median
- 4.3%
- Std dev
- 55.2%
- 10th percentile
- 63.8%
- 90th percentile
- 55.2%
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Nemotron 3 UltraNeMo Evaluator SDK · official table· Reported by NVIDIA· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 63.8% |
| 2 | Nemotron 3 Super 120B A12BNeMo Evaluator / mostly NeMo Skills · Scale AI multi-turn instruction following· Reported by NVIDIA· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 55.2% |