Benchmark
Arena ELO - Expert
People compare model answers and choose which they prefer. Higher scores are better.
All human preference benchmarksScores from LMArena data.
- Models measured
- 318
- Scores recorded
- 371
- Sources
- 1
- IQ weight
- 1.30
Score distribution
- 1,333.9
- Mean
- 1,371.6
- Median
- 146.5
- Std dev
- 1,113
- 10th percentile
- 1,491.8
- 90th percentile
- 953.7
- Min
This benchmark has a weight of 1.30 for chat models, measured over 318 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 351 | Qwen1.5-7B-Chat· LMArena data | 1,054.8 |
| 352 | OpenChat 3.50106· LMArena data | 1,052.2 |
| 353 | Phi-3 Mini 4K InstructJune 2024· LMArena data | 1,050.7 |
| 354 | Phi-3 Mini 4K Instruct· LMArena data | 1,045.1 |
| 355 | OpenChat 3.5· LMArena data | 1,041.7 |
| 356 | Gemma 1.1 7B IT· LMArena data | 1,039.2 |
| 357 | Llama 2 70B Chat· LMArena data | 1,039.1 |
| 358 | Llama 2 7B Chat· LMArena data | 1,035.9 |
| 359 | Mistral 7B Instruct v0.2· LMArena data | 1,035.7 |
| 360 | Starling LM 7B Alpha· LMArena data | 1,033 |
| 361 | Llama 2 13B Chat· LMArena data | 1,029.8 |
| 362 | Vicuna 33B· LMArena data | 1,029 |
| 363 | Snowflake Arctic Instruct· LMArena data | 1,028.1 |
| 364 | Llama 3.2 1B Instruct· LMArena data | 1,007 |
| 365 | Zephyr 7B Beta· LMArena data | 1,005.7 |
| 366 | Gemma 7B IT· LMArena data | 1,001.2 |
| 367 | Vicuna 13B· LMArena data | 993.9 |
| 368 | Phi-3 Mini 128K Instruct· LMArena data | 983.7 |
| 369 | Qwen1.5-4B-Chat· LMArena data | 979.8 |
| 370 | Gemma 1.1 2B IT· LMArena data | 970.1 |
| 371 | Mistral 7B Instruct· LMArena data | 953.7 |
Showing 351–371 of 371 results.
Data credits: LMArena, CC BY 4.0 (licence)