Skip to content

Benchmark

Toolathlon Verified · Average turns

Lower scores are better.

Models measured
6
Scores recorded
6
Sources
1
IQ weight
No weight published

Score distribution

25.1
Mean
24.5
Median
3.5
Std dev
23.5
10th percentile
31.6
90th percentile
20.4
Min
20.431.6
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

ModelScore
Claude Fable 5.1internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.23.7
Claude Opus 4.8internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.20.4
Claude Opus 5internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.23.5
Claude Opus 5.5internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.26.9
Claude Sonnet 5internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.24.5
Claude Sonnet 5.5internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.31.6

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.