Skip to content

Benchmark

OpenHands Index: commit0

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
1.70

Score distribution

30%
Mean
25%
Median
17.4%
Std dev
12.5%
10th percentile
56.2%
90th percentile
0%
Min
0%62.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.70 for chat models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model
1Claude Fable 5· OpenHands Index data62.5%
2Claude Opus 4.8· OpenHands Index data62.5%
3Claude Opus 4.6· OpenHands Index data56.2%
4Claude Opus 4.7· OpenHands Index data56.2%
5GPT 5.4· OpenHands Index data56.2%
6Claude Sonnet 4.6· OpenHands Index data50%
7GPT 5.2· OpenHands Index data50%
8GPT 5.5· OpenHands Index data43.8%
9GPT-5.2 Codex· OpenHands Index data43.8%
10Claude Opus 4.5· OpenHands Index data37.5%
11Gemini 3.5 Flash· OpenHands Index data37.5%
12GLM 5.1· OpenHands Index data37.5%
13GLM 5· OpenHands Index data31.2%
14Gemini 3 Pro Preview· OpenHands Index data25%
15Gemini 3.1 Pro Preview· OpenHands Index data25%
16Kimi K2.6· OpenHands Index data25%
17MiniMax M3· OpenHands Index data25%
18Qwen3 Coder Next· OpenHands Index data25%
19Qwen3.6 Plus· OpenHands Index data25%
20Gemini 3 Flash· OpenHands Index data18.8%
21Kimi K2.5· OpenHands Index data18.8%
22MiniMax M2.1· OpenHands Index data18.8%
23Claude Sonnet 4.5· OpenHands Index data12.5%
24DeepSeek V4 Pro· OpenHands Index data12.5%
25GLM 4.7· OpenHands Index data12.5%
26Kimi K2 Thinking· OpenHands Index data12.5%
27MiniMax M2.5· OpenHands Index data12.5%
28Nemotron 3 Super· OpenHands Index data12.5%
29Qwen3.5 Flash· OpenHands Index data12.5%
30Trinity Large Thinking· OpenHands Index data12.5%
31Qwen3 Coder· OpenHands Index data0%

Tokens the model generated per task, as measured by the source. Comparable within this benchmark only.

Data credits: OpenHands Index (All Hands AI), Apache-2.0 (licence)