Benchmark
OCRVQA
OCR benchmarks measure how well models read text in images and documents. Scores are percentages.
- Models measured
- 17
- Scores recorded
- 17
- Sources
- 1
- IQ weight
- 0.33
Score distribution
- 33.2%
- Mean
- 27.6%
- Median
- 20%
- Std dev
- 13.5%
- 10th percentile
- 60.2%
- 90th percentile
- 2.9%
- Min
This benchmark has a weight of 0.33 for chat models, measured over 17 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Qwen2-VL-72B· OpenVLM Leaderboard data | 73.7% |
| 2 | Pixtral 12B· OpenVLM Leaderboard data | 64.7% |
| 3 | Phi 4 Multimodal Instruct· OpenVLM Leaderboard data | 60.2% |
| 4 | Qwen-VL Max· OpenVLM Leaderboard data | 55% |
| 5 | InternVL2 26B· OpenVLM Leaderboard data | 43.4% |
| 6 | internvl3-8b· OpenVLM Leaderboard data | 38.9% |
| 7 | Qwen-VL Plus· OpenVLM Leaderboard data | 38.8% |
| 8 | GPT-4.1 nano· OpenVLM Leaderboard data | 36% |
| 9 | Gemma 3 4B· OpenVLM Leaderboard data | 27.6% |
| 10 | GPT-4.1 mini· OpenVLM Leaderboard data | 26.3% |
| 11 | GPT 4.1· OpenVLM Leaderboard data | 18.7% |
| 12 | Gemini 1.5 Flash· OpenVLM Leaderboard data | 18.5% |
| 13 | Gemma 3 12B IT· OpenVLM Leaderboard data | 17.7% |
| 14 | Molmo 7B-D· OpenVLM Leaderboard data | 15.9% |
| 15 | Gemma 3 27B IT· OpenVLM Leaderboard data | 13.5% |
| 16 | gemini-1.0-pro· OpenVLM Leaderboard data | 12.3% |
| 17 | kosmos-2· OpenVLM Leaderboard data | 2.9% |
Data credits: OpenVLM Leaderboard (OpenCompass / VLMEvalKit), Apache-2.0 (licence)