Benchmark
OSWorld 2.0 · Partial
Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages. Higher is better.
- Models measured
- 24
- Scores recorded
- 76
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 59.3%
- Mean
- 62.2%
- Median
- 16.4%
- Std dev
- 41.4%
- 10th percentile
- 75.4%
- 90th percentile
- 8.3%
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 5.5adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · 82-task offline subset · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 87.2% |
| 2 | Claude Sonnet 5.5adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · 82-task offline subset · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 83.9% |
| 3 | Claude Opus 5.5Opus 5.5 System Card capability section · 2026-09-10 task/assets · 1080p · 500 steps · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 81.8% |
| 4 | Claude Fable 5.1Opus 5.5 System Card capability section · 2026-09-10 task/assets · updated harness · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 80.7% |
| 5 | Claude Sonnet 5.52026-09-10 tasks/assets · 1080p · 500 steps · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 80.1% |
| 6 | Claude Fable 5.12026-08 task set · partial· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 77.9% |
| 7 | Claude Fable 5.1System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted · partial· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 77.9% |
| 8 | Claude Opus 52026-08 task set · partial· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 75.4% |
| 9 | Claude Opus 5System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted · partial· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 75.4% |
| 10 | Claude Opus 5Opus 5.5 System Card capability section · 2026-09-10 task/assets · updated harness · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 74% |
| 11 | GPT-6 AstraOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · max reasoning · displayed cost $9.44/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 73.5% |
| 12 | GPT-6 AstraOSWorld 2.0 offline v2026.08.08 · max effort · $9.0733 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 73.5% |
| 13 | Claude Fable 52026-08 task set · partial· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 72.9% |
| 14 | Claude Fable 5System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted · partial· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 72.9% |
| 15 | GPT-6 Astrav2026.08.08 · offline set · partial score· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 72.6% |
| 16 | Claude Haiku 5.582-task offline subset · 1080p · 500 steps · max · 5 runs· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 72.4% |
| 17 | GPT-6.1 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · max reasoning · displayed cost $1.27/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 71.4% |
| 18 | GPT-6 AstraOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · xhigh reasoning · displayed cost $7.49/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 71.3% |
| 19 | GPT-6 AstraOSWorld 2.0 offline v2026.08.08 · xhigh effort · $7.1744 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 71.3% |
| 20 | Claude Opus 5v2026.08.08 · offline set · partial score· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 70.2% |
| 21 | Claude Opus 5OSWorld 2.0 offline v2026.08.08 · max effort · $24.11 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 70.2% |
| 22 | Claude Opus 5OSWorld 2.0 offline v2026.08.08 · xhigh effort · $23.91 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 70.1% |
| 23 | GPT-6 AstraOSWorld 2.0 offline v2026.08.08 · high effort · $6.6024 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 70% |
| 24 | GPT-6 AstraOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · high reasoning · displayed cost $6.91/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 70% |
| 25 | GPT-6.1 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · high reasoning · displayed cost $0.96/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 69.6% |
| 26 | GPT-6.1 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · xhigh reasoning · displayed cost $1.05/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 69.4% |
| 27 | GPT-6 AstraOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · medium reasoning · displayed cost $5.36/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 69.3% |
| 28 | GPT-6 AstraOSWorld 2.0 offline v2026.08.08 · medium effort · $5.1009 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 69.3% |
| 29 | Claude Opus 5max · OSWorld 2.0 v08.08 · 108 tasks · common internal framework · partial reward· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 68.3% |
| 30 | Muse Spark 1.3max · OSWorld 2.0 v08.08 · 108 tasks · common internal framework · partial reward· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 66.9% |
| 31 | GPT-6.1 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · medium reasoning · displayed cost $0.77/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 66.8% |
| 32 | GPT-5.6 SolOSWorld 2.0 offline v2026.08.08 · max effort · $7.7105 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 66.2% |
| 33 | Claude Opus 5OSWorld 2.0 offline v2026.08.08 · high effort · $15.95 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 65.9% |
| 34 | GPT-5.6 Solv2026.08.08 · offline set · partial score· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 65.7% |
| 35 | GPT-6 SolOSWorld 2.0 offline v2026.08.08 · max effort · $3.2543 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 64.4% |
| 36 | GPT-6 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · max reasoning · displayed cost $3.37/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 64.4% |
| 37 | GPT-5.6 Solmax · OSWorld 2.0 v08.08 · 108 tasks · common internal framework · partial reward· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 62.7% |
| 38 | GPT-6 AstraOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · low reasoning · displayed cost $2.72/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 62.2% |
| 39 | GPT-6 AstraOSWorld 2.0 offline v2026.08.08 · low effort · $2.5457 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 62.2% |
| 40 | GPT-5.6 SolOSWorld 2.0 offline v2026.08.08 · xhigh effort · $5.9257 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 60.9% |
| 41 | GPT-6 SolOSWorld 2.0 offline v2026.08.08 · xhigh effort · $2.2127 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 60.5% |
| 42 | GPT-6 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · xhigh reasoning · displayed cost $2.30/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 60.5% |
| 43 | Claude Opus 5OSWorld 2.0 offline v2026.08.08 · medium effort · $12.67 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 60.3% |
| 44 | GLM 5.3 FlashZ.ai Flash设置 / partial· Reported by Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 59.1% |
| 45 | Gemini 3.8 Flashpartial / batch tool enabled· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 59% |
| 46 | GPT-6.1 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · low reasoning · displayed cost $0.42/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 59% |
| 47 | GPT-6 SolOSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart · high reasoning · displayed cost $1.71/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 58.3% |
| 48 | GPT-6 SolOSWorld 2.0 offline v2026.08.08 · high effort · $1.6379 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 58.3% |
| 49 | GPT-5.6 SolOSWorld 2.0 offline v2026.08.08 · high effort · $4.4613 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 56.5% |
| 50 | Claude Opus 5OSWorld 2.0 offline v2026.08.08 · low effort · $9.88 average cost/task· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 55.2% |
Showing 1–50 of 76 results.