Skip to content

Benchmark

OpenHands Index: gaia

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
1.24

Score distribution

60%
Mean
65.5%
Median
19.9%
Std dev
33.9%
10th percentile
81.8%
90th percentile
12.7%
Min
12.7%86.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.24 for chat models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model
1GPT 5.5· OpenHands Index data86.1%
2Claude Fable 5· OpenHands Index data84.2%
3GPT 5.4· OpenHands Index data82.4%
4Gemini 3.1 Pro Preview· OpenHands Index data81.8%
5Claude Opus 4.7· OpenHands Index data81.2%
6Gemini 3.5 Flash· OpenHands Index data81.2%
7Claude Opus 4.6· OpenHands Index data80%
8Claude Opus 4.8· OpenHands Index data78.8%
9Kimi K2.6· OpenHands Index data74.5%
10Claude Sonnet 4.5· OpenHands Index data72.7%
11Qwen3.6 Plus· OpenHands Index data72.1%
12GPT-5.2 Codex· OpenHands Index data70.9%
13Claude Opus 4.5· OpenHands Index data69.1%
14GLM 5.1· OpenHands Index data67.3%
15MiniMax M3· OpenHands Index data66.7%
16GPT 5.2· OpenHands Index data65.5%
17Kimi K2.5· OpenHands Index data63.6%
18GLM 5· OpenHands Index data60%
19Gemini 3 Flash· OpenHands Index data58.8%
20GLM 4.7· OpenHands Index data53.9%
21Qwen3 Coder Next· OpenHands Index data50.9%
22Qwen3.5 Flash· OpenHands Index data49.7%
23MiniMax M2.5· OpenHands Index data47.9%
24Gemini 3 Pro Preview· OpenHands Index data44.2%
25Kimi K2 Thinking· OpenHands Index data43.6%
26MiniMax M2.1· OpenHands Index data40.6%
27Nemotron 3 Super· OpenHands Index data40%
28Qwen3 Coder· OpenHands Index data33.9%
29Trinity Large Thinking· OpenHands Index data32.7%
30Claude Sonnet 4.6· OpenHands Index data13.3%
31DeepSeek V4 Pro· OpenHands Index data12.7%

Tokens the model generated per task, as measured by the source. Comparable within this benchmark only.

Data credits: OpenHands Index (All Hands AI), Apache-2.0 (licence)