Skip to content

Benchmark

Terminal-Bench 2.1

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages. Higher is better.

Models and systems measured
64
Scores recorded
159
Sources
3
IQ weight
2.76

Score distribution

75.3%
Mean
82.7%
Median
17.2%
Std dev
56.4%
10th percentile
88.8%
90th percentile
2.9%
Min
2.9%91.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.76 for chat models, measured over 53 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model or systemScore
1GPT-5.6 SolUltra effort· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.91.9%
2DeepSeek V4.1 Flash· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim
Values from 2 sources
90.6%
3DeepSeek V4.1 FlashDeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.6%
4DeepSeek V4.1 FlashDSH Minimal · max effort · temp 1.0 · top_p .95 · 1M · max_steps 500 · N=3 · no network· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.6%
5DeepSeek V4.1 Flashmini-SWE · max effort · temp 1.0 · top_p .95 · 1M · max_steps 500 · N=3 · no network· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.3%
6Claude Opus 5Atria Dawn Preview official card / report Table 1 · published comparison run · model snapshots and reasoning tiers not specified unless stated · four-run mean · 12× timeout multiplier capped at 12 hours · 500 turns · Claude Code v2.1.224 except GPT models use Terminus 2 · Opus 4.8 fallback on a subset of tasks· Reported by Shanghai AI Laboratory· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.2%
7MiMo V2.6 Pro· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim89.9%
8MiMo V2.6 Pro RL· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim89.9%
9Gemini 3.8 Flash· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim89.4%
10Gemini 3.8 FlashGoogle Model Card· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.89.4%
11Qwen3.8 MaxAtria Dawn Preview official card / report Table 1 · published comparison run · model snapshots and reasoning tiers not specified unless stated · four-run mean · 12× timeout multiplier capped at 12 hours · 500 turns · Claude Code v2.1.224 except GPT models use Terminus 2· Reported by Shanghai AI Laboratory· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.89.3%
12Claude Opus 5DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.89.1%
13Claude Opus 5Google Model Card· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.89.1%
14GPT-5.6 Sol· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim88.8%
15GPT-5.6 SolDeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
16GPT-5.6 SolGoogle Model Card· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
17GPT-5.6 Solmax · 89 tasks · native coding harness · isolated cloud sandbox · pass@1· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
18GPT-5.6 SolOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
19GPT-5.6 SolQwen表:Qwen 采用 Claude Code avg@10、5h、max_tokens 131072;友商取公开最高分· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
20GPT-5.6 Sol厂商公开表共同值· Reported by Z.ai, DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
21Muse Spark 1.3· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim88.8%
22Muse Spark 1.3max · 89 tasks · native coding harness · isolated cloud sandbox · pass@1· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.8%
23LongCat 2.5· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim88.4%
24Kimi K3setting not named by the source· Reported by Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.3%
25Kimi K3· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim88.3%
26Kimi K3best score across harnesses · max effort· Reported by Moonshot AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.3%
27Kimi K3DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.3%
28GLM 5.3setting not named by the source· Reported by Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.2%
29GLM 5.3· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim
Values from 2 sources
88.2%
30GLM 5.3DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88.2%
31DeepSeek V4.1 FlashClaude Code · max effort · temp 1.0 · top_p .95 · 1M · max_steps 500 · N=3 · no network· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.88%
32DeepSeek V4 Pro 0813setting not named by the source· Reported by Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.87.9%
33DeepSeek V4 Pro 0813· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim
Values from 2 sources
87.9%
34DeepSeek V4 Pro 0813DeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.87.9%
35MiMo V2.6 Flash· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim
Values from 2 sources
87.6%
36GPT-5.6 Terra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim87.4%
37GPT-5.6 TerraOpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.87.4%
38Claude Opus 5Claude Code · max· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.86.7%
39Claude Opus 5max · 89 tasks · native coding harness · isolated cloud sandbox · pass@1· Reported by Meta· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.86.7%
40Qwen3.8 Maxsetting not named by the source· Reported by Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.86.6%
41Qwen3.8 Max· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim
Values from 2 sources
86.6%
42Qwen3.8 MaxQwen表:Qwen 采用 Claude Code avg@10、5h、max_tokens 131072;友商取公开最高分· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.86.6%
43DeepSeek V4.1 FlashPi · max effort · temp 1.0 · top_p .95 · 1M · max_steps 500 · N=3 · no network· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.86.1%
44DeepSeek V4.1 FlashDSH PTC · max effort · temp 1.0 · top_p .95 · 1M · max_steps 500 · N=3 · no network· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.85.8%
45DeepSeek V4.1 FlashDSH Standard · max effort · temp 1.0 · top_p .95 · 1M · max_steps 500 · N=3 · no network· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.85.8%
46Gemini 3.7 Flash· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim85.8%
47Gemini 3.7 FlashTerminus 2· Reported by Google DeepMind· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.85.8%
48GPT 5.5OpenAI GPT-5.6 launch table· Reported by OpenAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.85.6%
49GLM 5.3Atria Dawn Preview official card / report Table 1 · published comparison run · model snapshots and reasoning tiers not specified unless stated · four-run mean · 12× timeout multiplier capped at 12 hours · 500 turns · Claude Code v2.1.224 except GPT models use Terminus 2· Reported by Shanghai AI Laboratory· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.85.4%
50Hy4 preview· Hugging Face Official Benchmarks data· Reported by the model's developer. The source relaying it did not verify it. claim
Values from 2 sources
85.4%

Showing 1–50 of 158 results.

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
Muse Spark (version unspecified)Meta Model API · highest effort · version unspecified · 89 tasks · bash-only · pass@1 · five-attempt mean· Reported by Meta, Meta Superintelligence Labs· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.67.3%

Data credits: Data by LLM Stats · Hugging Face official benchmark leaderboards; licence varies by benchmark · BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.