Skip to content

Benchmark

MVEB(video, v1) - VideoPairClassification

Vision benchmarks measure how well models understand images. Scores are percentages.

Models measured
4
Scores recorded
4
Sources
1
IQ weight
No weight published

Score distribution

66.4%
Mean
73.2%
Median
8.2%
Std dev
54.3%
10th percentile
74.6%
90th percentile
54.3%
Min
54.3%74.6%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Qwen3-VL Embedding 8BVideoPairClassification· MTEB Multimodal Boards data docs74.6%
2Jina Embeddings v5 Omni SmallVideoPairClassification· MTEB Multimodal Boards data docs73.2%
3Jina Embeddings v5 Omni NanoVideoPairClassification· MTEB Multimodal Boards data docs63.3%
4Qwen2.5-Omni 7BVideoPairClassification· MTEB Multimodal Boards data docs54.3%