Skip to content

Benchmark

Video-MME-v2 - Level 3

Vision benchmarks measure how well models understand images. Scores are percentages.

Models measured
20
Scores recorded
78
Sources
1
IQ weight
1.63

Score distribution

19%
Mean
18.4%
Median
6.8%
Std dev
10.9%
10th percentile
28.4%
90th percentile
7.1%
Min
7.1%40.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.63 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51Qwen3.5 Omni Pluswo sub @ 64· Video-MME-v215.3%
52Qwen3.5 122B-A10Bwo sub @ 64, think· Video-MME-v214.9%
53Qwen3.5 9Bwo sub @ 512, think· Video-MME-v214.6%
54Qwen3.5 Omni Pluswo sub @ 512· Video-MME-v214.5%
55Qwen3 VL 235Bwo sub @ 512, think· Video-MME-v214.5%
56Qwen3.5 27Bwo sub @ 512, think· Video-MME-v214.4%
57internvl3-5-241b-a28bwo sub @ 64, instruct· Video-MME-v214.1%
58Qwen3 VL 235Bwo sub @ 64, instruct· Video-MME-v213.9%
59Qwen3.5 35B A3Bwo sub @ 64, think· Video-MME-v213.9%
60Qwen3.5 4Bw. sub @ 64, instruct· Video-MME-v213.6%
61Qwen3 VL 235Bwo sub @ 64, think· Video-MME-v213.4%
62Qwen3.5 122B-A10Bwo sub @ 512, think· Video-MME-v212.9%
63Qwen3.5 9Bwo sub @ 64, think· Video-MME-v212.6%
64Qwen2.5 VL 72B Instructwo sub @ 64, instruct· Video-MME-v212.6%
65Qwen3.5 27Bwo sub @ 64, instruct· Video-MME-v212.3%
66Qwen3.5 35B A3Bwo sub @ 512, think· Video-MME-v211.7%
67GLM 4.5Vwo sub @ 64, think· Video-MME-v211.4%
68Qwen: Qwen3 VL 8B Thinkingwo sub @ 512, think· Video-MME-v211.1%
69qwen3-vl-30bwo sub @ 64, think· Video-MME-v211.1%
70Qwen: Qwen3 VL 8B Thinkingwo sub @ 64, think· Video-MME-v210.9%
71Qwen3.5 122B-A10Bwo sub @ 64, instruct· Video-MME-v210.9%
72Qwen: Qwen3 VL 8B Thinkingwo sub @ 64, instruct· Video-MME-v210.7%
73Qwen3.5 9Bwo sub @ 64, instruct· Video-MME-v210%
74qwen3-vl-30bwo sub @ 512, think· Video-MME-v210%
75Qwen3.5 35B A3Bwo sub @ 64, instruct· Video-MME-v29.9%
76Qwen3.5 4Bwo sub @ 64, think· Video-MME-v29.9%
77Qwen3.5 4Bwo sub @ 64, instruct· Video-MME-v28.5%
78qwen3-vl-30bwo sub @ 64, instruct· Video-MME-v27.1%

Showing 51–78 of 78 results.