Skip to content

Benchmark

MMAR

Scores are percentages. Higher is better.

Models and systems measured
9
Scores recorded
10
Sources
2
IQ weight
0.36

Score distribution

74.6%
Mean
77.7%
Median
5.3%
Std dev
67.3%
10th percentile
79.8%
90th percentile
65.6%
Min
65.6%80%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.36 for chat models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model or systemScore
1Qwen3.5 Omni PlusQwen3.5-Omni release · published setting· Reported by Qwen, Qwen Team· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.80%
2Qwen3.5 Omni PlusQwen3.8 Omni Flash 官方发布表· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.79.8%
3Qwen3.8 Omni FlashQwen3.8 Omni Flash 官方发布表· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.79.8%
4Gemini 3.8 FlashQwen3.8 Omni Flash 官方发布表· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.78.5%
5Gemini 2.5 Pro· MMAR data74.7%
6Qwen3.5 Omni FlashQwen3.5-Omni release · published setting· Reported by Qwen, Qwen Team· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.74%
7Gemini 2.5 Flash· MMAR data68.4%
8Muse Spark 1.2Qwen3.8 Omni Flash 官方发布表· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.67.3%
9Gemini 2.0 Flash· MMAR data65.6%

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
Seed-2.0-LiteQwen3.8 Omni Flash 官方发布表· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.77.7%

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.