Benchmark
Arena ELO Vision
People compare model answers and choose which they prefer. Higher scores are better.
All human preference benchmarksScores from LMArena data.
- Models measured
- 147
- Scores recorded
- 168
- Sources
- 1
- IQ weight
- 1.77
Score distribution
- 1,185.4
- Mean
- 1,222.2
- Median
- 114.5
- Std dev
- 999
- 10th percentile
- 1,304.2
- 90th percentile
- 811.6
- Min
This benchmark has a weight of 1.77 for chat models, measured over 147 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 151 | Hunyuan Standard Vision2024-12-31· LMArena data | 999 |
| 152 | Aya Vision 32B· LMArena data | 995.5 |
| 153 | Nova Lite 1.0· LMArena data | 990.3 |
| 154 | Qwen2 VL 7b Instruct· LMArena data | 989.8 |
| 155 | Claude 3 Sonnet20240229· LMArena data | 983.8 |
| 156 | Nova Pro 1.0· LMArena data | 980.4 |
| 157 | Yi Vision· LMArena data | 977.6 |
| 158 | Llama 3.2 11B Vision Instruct· LMArena data | 966.3 |
| 159 | Molmo 7B-D0924· LMArena data | 958.6 |
| 160 | Claude 3 Haiku20240307· LMArena data | 950.1 |
| 161 | InternVL2 4B· LMArena data | 941.2 |
| 162 | nvila-internal-15b-v1· LMArena data | 940.1 |
| 163 | LLaVA 1.6 34B· LMArena data | 936.4 |
| 164 | CogVLM2 Llama3 Chat 19B· LMArena data | 927.5 |
| 165 | LLaVA-OneVision Qwen2 72B OV· LMArena data | 922.7 |
| 166 | MiniCPM-V 2.6· LMArena data | 911.5 |
| 167 | Phi-3.5 Vision Instruct· LMArena data | 851.4 |
| 168 | Phi-3 Vision 128K Instruct· LMArena data | 811.6 |
Showing 151–168 of 168 results.
Data credits: LMArena, CC BY 4.0 (licence)