Benchmark
Video-MME-v2 - Level 1
Vision benchmarks measure how well models understand images. Scores are percentages.
- Models measured
- 20
- Scores recorded
- 78
- Sources
- 1
- IQ weight
- 2.15
Score distribution
- 27.2%
- Mean
- 25.8%
- Median
- 11.7%
- Std dev
- 14.9%
- 10th percentile
- 43.2%
- 90th percentile
- 9.3%
- Min
This benchmark has a weight of 2.15 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 51 | Qwen3.5 9Bw. sub @ 64, instruct· Video-MME-v2 | 20.7% |
| 52 | Qwen3 VL 235Bwo sub @ 64, instruct· Video-MME-v2 | 20.7% |
| 53 | Qwen3.5 27Bwo sub @ 64, think· Video-MME-v2 | 20% |
| 54 | Qwen3.5 Omni Pluswo sub @ 64· Video-MME-v2 | 19.6% |
| 55 | Qwen3 VL 235Bwo sub @ 64, think· Video-MME-v2 | 19.1% |
| 56 | Qwen3.5 122B-A10Bwo sub @ 64, think· Video-MME-v2 | 19% |
| 57 | Qwen3.5 35B A3Bwo sub @ 64, think· Video-MME-v2 | 18.2% |
| 58 | internvl3-5-241b-a28bwo sub @ 64, instruct· Video-MME-v2 | 18.1% |
| 59 | qwen3-vl-30bw. sub @ 64, instruct· Video-MME-v2 | 18% |
| 60 | Qwen3.5 4Bw. sub @ 64, instruct· Video-MME-v2 | 17.6% |
| 61 | qwen3-vl-30bwo sub @ 64, think· Video-MME-v2 | 17.4% |
| 62 | Qwen: Qwen3 VL 8B Thinkingwo sub @ 512, think· Video-MME-v2 | 17% |
| 63 | qwen3-vl-30bwo sub @ 512, think· Video-MME-v2 | 16.9% |
| 64 | Qwen3.5 397B A17Bwo sub @ 64, instruct· Video-MME-v2 | 16.8% |
| 65 | Qwen3.5 9Bwo sub @ 64, think· Video-MME-v2 | 16.7% |
| 66 | Qwen3.5 27Bwo sub @ 64, instruct· Video-MME-v2 | 15.8% |
| 67 | Qwen3.5 122B-A10Bwo sub @ 512, think· Video-MME-v2 | 15.8% |
| 68 | Qwen: Qwen3 VL 8B Thinkingwo sub @ 64, instruct· Video-MME-v2 | 15.4% |
| 69 | Qwen2.5 VL 72B Instructwo sub @ 64, instruct· Video-MME-v2 | 15.3% |
| 70 | Qwen3.5 4Bwo sub @ 64, think· Video-MME-v2 | 14.9% |
| 71 | GLM 4.5Vwo sub @ 64, think· Video-MME-v2 | 14.9% |
| 72 | Qwen3.5 122B-A10Bwo sub @ 64, instruct· Video-MME-v2 | 14.8% |
| 73 | Qwen3.5 35B A3Bwo sub @ 512, think· Video-MME-v2 | 13.9% |
| 74 | Qwen3.5 35B A3Bwo sub @ 64, instruct· Video-MME-v2 | 13.7% |
| 75 | Qwen: Qwen3 VL 8B Thinkingwo sub @ 64, think· Video-MME-v2 | 13.1% |
| 76 | Qwen3.5 4Bwo sub @ 64, instruct· Video-MME-v2 | 11.9% |
| 77 | Qwen3.5 9Bwo sub @ 64, instruct· Video-MME-v2 | 11.5% |
| 78 | qwen3-vl-30bwo sub @ 64, instruct· Video-MME-v2 | 9.3% |
Showing 51–78 of 78 results.