Benchmark
Arena ELO - Industry Writing and Literature and Language
People compare model answers and choose which they prefer. Higher scores are better.
All human preference benchmarksScores from LMArena data.
- Models measured
- 365
- Scores recorded
- 422
- Sources
- 1
- IQ weight
- 1.17
Score distribution
- 1,297.8
- Mean
- 1,328.7
- Median
- 142.8
- Std dev
- 1,086
- 10th percentile
- 1,453.9
- 90th percentile
- 809.1
- Min
This benchmark has a weight of 1.17 for chat models, measured over 365 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 401 | Mistral 7B Instruct· LMArena data | 1,030.4 |
| 402 | Llama 3.2 1B Instruct· LMArena data | 1,029.8 |
| 403 | SmolLM2 1.7B Instruct· LMArena data | 1,024.5 |
| 404 | Code Llama 70B Instruct· LMArena data | 1,014.8 |
| 405 | PaLM 2· LMArena data | 1,006.8 |
| 406 | Gemma 1.1 2B IT· LMArena data | 1,006 |
| 407 | OLMo 7B Instruct· LMArena data | 1,003.1 |
| 408 | Qwen1.5-4B-Chat· LMArena data | 1,000.9 |
| 409 | Koala 13B· LMArena data | 979.4 |
| 410 | Gemma 2B IT· LMArena data | 978.3 |
| 411 | GPT4All 13B Snoozy· LMArena data | 973.1 |
| 412 | MPT 7B Chat· LMArena data | 972.8 |
| 413 | ChatGLM3 6B· LMArena data | 972.5 |
| 414 | Alpaca 13B· LMArena data | 968.2 |
| 415 | ChatGLM2 6B· LMArena data | 952.7 |
| 416 | RWKV-4 Raven 14B· LMArena data | 934 |
| 417 | OpenAssistant Pythia 12B· LMArena data | 928.2 |
| 418 | ChatGLM 6B· LMArena data | 925.4 |
| 419 | FastChat-T5 3B· LMArena data | 907.6 |
| 420 | Dolly 2.0 12B· LMArena data | 872.3 |
| 421 | StableLM Tuned Alpha 7B· LMArena data | 867.9 |
| 422 | LLaMA 13B· LMArena data | 809.1 |
Showing 401–422 of 422 results.
Data credits: LMArena, CC BY 4.0 (licence)