Skip to content

Benchmark

VCR

Vision benchmarks measure how well models understand images. Scores are percentages.

Models measured
5
Scores recorded
5
Sources
1
IQ weight
1.36

Score distribution

17.8%
Mean
21.9%
Median
5.9%
Std dev
9.3%
10th percentile
23.2%
90th percentile
9.3%
Min
9.3%23.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.36 for chat models, measured over 5 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Data credits: OpenVLM Leaderboard (OpenCompass / VLMEvalKit), Apache-2.0 (licence)