Skip to content

Benchmark

SkillsBench · Vals · With Skills · Mean duration / test

Lower scores are better.

Models and systems measured
34
Scores recorded
35
Sources
1
IQ weight
0.20

Score distribution

576.1
Mean
542.3
Median
281.6
Std dev
223.5
10th percentile
930.4
90th percentile
49.4
Min
49.41,191.7
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.20 for chat models, measured over 24 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model or systemScore
1Grok 4.5Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=grok/grok-4.5 · provider=SpaceXAI · reasoning_effort=high · temperature=0.7 · top_p=0.95· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.135.7
2Gemini 3.7 FlashVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=google/gemini-3.7-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.185.7
3DeepSeek V4.1 FlashVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=deepseek/deepseek-v4.1-flash · provider=DeepSeek · reasoning_effort=high · max_output_tokens=384000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.223.5
4Gemini 3.8 FlashVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.235.2
5GPT 5.5Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · Codex (version not stated) · With Skills · system=openai/gpt-5.5-codex · provider=OpenAI· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.279.5
6GPT-5.6 LunaVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=openai/gpt-5.6-luna · provider=OpenAI · reasoning_effort=max · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.320.5
7Muse Spark 1.1Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=meta/muse_spark_1_1 · provider=Meta · reasoning_effort=xhigh · max_output_tokens=256000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.376.3
8Qwen 3.8 27BVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=alibaba/qwen3.8-27b · provider=Alibaba · reasoning_effort=xhigh · temperature=1 · top_p=0.95 · max_output_tokens=65536· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.401
9DeepSeek V4 Flash 0731Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=deepseek/deepseek-v4-flash-0731 · provider=DeepSeek · reasoning_effort=high · max_output_tokens=384000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.412
10GPT 5.5Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=openai/gpt-5.5 · provider=OpenAI · reasoning_effort=xhigh · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.414.6
11GPT-5.6 TerraVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=openai/gpt-5.6-terra · provider=OpenAI · reasoning_effort=max · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.415.1
12Gemini 3.5 FlashVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=google/gemini-3.5-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.435
13Claude Opus 5Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-opus-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.505
14GPT 5.4Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=openai/gpt-5.4-2026-03-05 · provider=OpenAI · reasoning_effort=xhigh · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.542.3
15Claude Fable 5.1Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-fable-5-1 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.662
16DeepSeek V4 Pro 0813Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=deepseek/deepseek-v4-pro-0813 · provider=DeepSeek · reasoning_effort=max · max_output_tokens=384000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.674.7
17Qwen3.7 PlusVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=alibaba/qwen3.7-plus · provider=Alibaba · temperature=0.7 · max_output_tokens=65536· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.724.5
18GLM 5.3 FlashVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=zai/glm-5.3-flash · provider=Fireworks AI · reasoning_effort=max · temperature=1 · top_p=0.95 · max_output_tokens=131072· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.729
19Muse Spark 1.2Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=meta/muse_spark_1_2 · provider=Meta · reasoning_effort=xhigh · temperature=1 · max_output_tokens=131072· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.780
20GLM 5.3Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=zai/glm-5.3 · provider=Zhipu AI · reasoning_effort=max · temperature=1 · top_p=0.95 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.787.4
21GPT-5.6 SolVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=openai/gpt-5.6-sol · provider=OpenAI · reasoning_effort=max · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.787.5
22Kimi K2.7 CodeVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=kimi/kimi-k2.7-code · provider=Moonshot AI · top_p=0.95 · max_output_tokens=32768· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.803.8
23Claude Sonnet 4.6Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-sonnet-4-6 · provider=Anthropic · compute_effort=max · reasoning=true · temperature=1 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.860.2
24Claude Sonnet 5Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.911.7
25MiniMax M3Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=minimax/MiniMax-M3 · provider=MiniMax · temperature=1 · top_p=0.95 · max_output_tokens=512000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.928
26Claude Opus 4.8Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-opus-4-8 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.930.4
27Qwen3.8 MaxVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=alibaba/qwen3.8-max · provider=Alibaba · temperature=0.7 · max_output_tokens=128000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.948.4
28GLM 5.2Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=zai/glm-5.2 · provider=Zhipu AI · reasoning_effort=max · temperature=1 · top_p=0.95 · max_output_tokens=131072· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.1,191.7

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
DeepSeek V4 Pro (version unspecified)Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=deepseek/deepseek-v4-pro · provider=DeepSeek · reasoning_effort=max · max_output_tokens=384000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.495.6
Grok 4.3Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=grok/grok-4.3 · provider=SpaceXAI · reasoning_effort=high · temperature=0.7 · top_p=0.95· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.277.2
Grok 4.6Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=grok/grok-4.6 · provider=SpaceXAI · reasoning_effort=high · temperature=0.7 · top_p=0.95· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.808.1
InklingVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=thinkingmachines/inkling · provider=Thinkingmachines · reasoning_effort=0.99 · temperature=1 · top_p=1 · max_output_tokens=256000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.938.7
Inkling-SmallVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=thinkingmachines/inkling-small · provider=Thinkingmachines · reasoning_effort=0.99 · temperature=1 · top_p=1 · max_output_tokens=262000· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.700.9
Ling-3.0-FlashVals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=ant/ling-3.0-flash-2607 · provider=Ant · temperature=0.6 · top_p=0.95 · max_output_tokens=131072· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.292.4
Mercury 2.5Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=inception/mercury-2.5 · provider=Inception · reasoning_effort=high · max_output_tokens=65536· Reported by Vals AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.49.4

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.