Skip to content

Benchmark

PinchBench v2 · Best Success Rate

Scores are percentages. Higher is better.

Models and systems measured
60
Scores recorded
64
Sources
1
IQ weight
1.39

Score distribution

79.3%
Mean
85.3%
Median
18.2%
Std dev
58.9%
10th percentile
91.9%
90th percentile
3.2%
Min
3.2%100%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.39 for chat models, measured over 50 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model or systemScore
1Claude Opus 4.6OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs100%
2Mercury 2OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs100%
3Claude Opus 4.8OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · fast route · best run· Reported by PinchBench· via BenchBoard docs94.5%
4Qwen3.7 MaxOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs93.4%
5Claude Opus 4.6SenseNova 6.7 Flash-Lite official benchmark chart · best result · chart does not restate benchmark version· Reported by SenseTime / OpenSenseNova· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.93.3%
6MiMo V2.5OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs91.9%
7Claude Opus 4.8OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs91.8%
8Claude Opus 4.7OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs91.6%
9DeepSeek V4 FlashOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs91.5%
10Grok 4.5OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs91.2%
11GPT-5.6 LunaOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs90.8%
12Nemotron 3 UltraOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs90.6%
13GPT 5.4SenseNova 6.7 Flash-Lite official benchmark chart · best result · chart does not restate benchmark version· Reported by SenseTime / OpenSenseNova· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.5%
14Claude Haiku 4.5OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs90.4%
15MiMo V2.5 ProOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs89.5%
16Qwen3.6 FlashOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs89.1%
17GPT 5.5OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs89%
18GPT 5.4OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs88.4%
19GLM 5.2OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs87.8%
20Nemotron 3.5 Lightning 30B A3BOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs87.2%
21GPT-5.6 SolOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs87%
22GLM 5SenseNova 6.7 Flash-Lite official benchmark chart · best result · chart does not restate benchmark version· Reported by SenseTime / OpenSenseNova· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.86.4%
23GPT-5.4 miniOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs86.4%
24Qwen3.6 PlusOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs85.9%
25Step 3.5 FlashSenseNova 6.7 Flash-Lite official benchmark chart · best result · chart does not restate benchmark version· Reported by SenseTime / OpenSenseNova· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.85.3%
26Step 3.5 FlashOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs84.7%
27Claude Sonnet 4.6OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs84.6%
28MiniMax M2.7OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs84.5%
29Devstral 2 123b Instruct 2512OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs83.2%
30Gemini 3.1 Pro PreviewOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs82.9%
31Kimi K2.5OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs81.9%
32DeepSeek V4 Pro 0813OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs81.6%
33GPT-5.6 TerraOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs81.4%
34Gemini 3.1 Flash LiteOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs80.5%
35Kimi K2.7 CodeOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs80.2%
36Gemini 3 FlashOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs80%
37GPT 5.4 NanoOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs77.3%
38Gemma 4 26B A4BOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs77.1%
39Gemma 4 31B ITOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs77%
40GLM 5.1OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs76.6%
41Gemini 3.5 FlashOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs76.3%
42Mistral Large 3 675b InstructOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs72.9%
43Fugu UltraOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs72.4%
44Trinity Large PreviewOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs72.4%
45Trinity Large ThinkingOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs71.2%
46Nemotron 3 Super 120B A12BOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs60.4%
47Claude Fable 5OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs59.6%
48Nova 2 LiteOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run, v1· Reported by PinchBench· via BenchBoard docs58.9%
49Claude Sonnet 4OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs57.8%
50GPT OSS 120BOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs47.4%

Showing 1–50 of 54 results.

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
Aion 3.0OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs62.4%
GLM 5 TurboOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs88.2%
GLM 5V TurboOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs86.6%
Grok 4.20OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs87.8%
Grok 4.3OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs85%
Grok Build 0.1OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs92.1%
Ling 2.6 1TOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs82.6%
Nemotron 3.5 Bolt 74B-A9B 24GBOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs90.1%
Nemotron 3.5 Bolt 74B-A9B BF16OpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs91.7%
Seed-2.0-LiteOpenClaw · PinchBench v2.0.0 · task count: 147 on live leaderboard / 148 in v2.0.0 release notes · best run· Reported by PinchBench· via BenchBoard docs89.7%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.