Skip to content

Benchmark

τ-bench Airline

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages. Higher is better.

Models measured
4
Scores recorded
8
Sources
1
IQ weight
No weight published

Score distribution

46.6%
Mean
48.6%
Median
9.2%
Std dev
38%
10th percentile
59.6%
90th percentile
32%
Min
32%60%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Claude Sonnet 4extended thinking + tool use · prompt addendum · max 100 model-completion steps· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.60%
2Claude Opus 4extended thinking + tool use · prompt addendum · max 100 model-completion steps· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.59.6%
3GPT OSS 120Bofficial model card Table 3 · reasoning high · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.49.2%
4GPT OSS 120Bofficial model card Table 3 · reasoning medium · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.48.6%
5GPT OSS 120Bofficial model card Table 3 · reasoning low · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.42.6%
6GPT OSS 20bofficial model card Table 3 · reasoning medium · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.42.6%
7GPT OSS 20bofficial model card Table 3 · reasoning high · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.38%
8GPT OSS 20bofficial model card Table 3 · reasoning low · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.32%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.