Skip to content

Benchmark

MMMU - Art & Design

Vision benchmarks measure how well models understand images. Scores are percentages.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

58.5%
Mean
59.7%
Median
1.2%
Std dev
57.3%
10th percentile
59.7%
90th percentile
57.3%
Min
57.3%59.7%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1LLaVA 1.6 34BArt & Design· EvalAI data59.7%
2Pixtral 12BArt & Design, 2409· EvalAI data57.3%