Skip to content

Benchmark

ZEROBench pass^5

Vision benchmarks measure how well models understand images. Scores are percentages.

Models measured
63
Scores recorded
69
Sources
1
IQ weight
2.63

Score distribution

3.7%
Mean
1%
Median
6%
Std dev
0%
10th percentile
9%
90th percentile
0%
Min
0%35%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.63 for chat models, measured over 63 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT-6 Astramax· ZeroBench35%
2Claude Opus 5.5max· ZeroBench25%
3GPT-6 Solmax· ZeroBench17%
4GPT-5.6 Solmax· ZeroBench13%
5Claude Opus 5max· ZeroBench11%
6GPT 5.5xhigh· ZeroBench11%
7GPT-5.6 Terramax· ZeroBench10%
8Claude Fable 5max· ZeroBench9%
9GPT 5.4xhigh· ZeroBench9%
10Grok 4.5high· ZeroBench9%
11Gemini 3.1 Pro Preview· ZeroBench8%
12Gemini 3.6 Flashhigh· ZeroBench8%
13GPT-5.6 Lunamax· ZeroBench8%
14GPT-6 Lunamax· ZeroBench7%
15Grok 4.6xhigh· ZeroBench7%
16Claude Opus 4.8· ZeroBench6%
17GPT 5.2medium reasoning· ZeroBench6%
18GPT-5.4 mini· ZeroBench6%
19Claude Opus 4.7xhigh· ZeroBench5%
20Claude Sonnet 5max· ZeroBench5%
21Gemini 3 Pro Preview· ZeroBench5%
22Gemini 3.5 Flash· ZeroBench5%
23GPT-5 minihigh reasoning· ZeroBench4%
24Grok 4.20reasoning· ZeroBench4%
25Claude Opus 4.6· ZeroBench2%
26Claude Sonnet 4.6· ZeroBench2%
27Gemini 3 Flash· ZeroBench2%
28Grok 4.20non-reasoning· ZeroBench2%
29Claude Opus 4thinking· ZeroBench1%
30Claude Opus 4.1· ZeroBench1%
31Claude Opus 4.1thinking· ZeroBench1%
32Claude Opus 4.5· ZeroBench1%
33Claude Sonnet 3.7thinking· ZeroBench1%
34Claude Sonnet 4· ZeroBench1%
35Claude Sonnet 4.5thinking· ZeroBench1%
36Gemini 2.5 Flash· ZeroBench1%
37Gemini 2.5 Pro· ZeroBench1%
38Gemini 3.1 Flash Lite· ZeroBench1%
39Grok 4.3high· ZeroBench1%
40Llama 4 Scout· ZeroBench1%
41Claude 3 Haiku· ZeroBench0%
42Claude 3 Opus· ZeroBench0%
43Claude 3 Sonnet· ZeroBench0%
44Claude 3.5 Sonnet· ZeroBench0%
45Claude 3.5 Sonnet v2· ZeroBench0%
46Claude Opus 4· ZeroBench0%
47Claude Sonnet 3.7· ZeroBench0%
48Claude Sonnet 4thinking· ZeroBench0%
49Claude Sonnet 4.5· ZeroBench0%
50Gemini 1.5 Flash· ZeroBench0%

Showing 1–50 of 69 results.