Benchmark
τ-bench Airline
Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages. Higher is better.
- Models measured
- 4
- Scores recorded
- 8
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 46.6%
- Mean
- 48.6%
- Median
- 9.2%
- Std dev
- 38%
- 10th percentile
- 59.6%
- 90th percentile
- 32%
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4extended thinking + tool use · prompt addendum · max 100 model-completion steps· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 60% |
| 2 | Claude Opus 4extended thinking + tool use · prompt addendum · max 100 model-completion steps· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 59.6% |
| 3 | GPT OSS 120Bofficial model card Table 3 · reasoning high · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 49.2% |
| 4 | GPT OSS 120Bofficial model card Table 3 · reasoning medium · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 48.6% |
| 5 | GPT OSS 120Bofficial model card Table 3 · reasoning low · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 42.6% |
| 6 | GPT OSS 20bofficial model card Table 3 · reasoning medium · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 42.6% |
| 7 | GPT OSS 20bofficial model card Table 3 · reasoning high · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 38% |
| 8 | GPT OSS 20bofficial model card Table 3 · reasoning low · developer functions · pass@1· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 32% |