Benchmark
Arena ELO - Hard Prompts English
People compare model answers and choose which they prefer. Higher scores are better.
All human preference benchmarksScores from LMArena data.
- Models measured
- 364
- Scores recorded
- 421
- Sources
- 1
- IQ weight
- 1.31
Score distribution
- 1,319.1
- Mean
- 1,374
- Median
- 157.7
- Std dev
- 1,085.3
- 10th percentile
- 1,479.2
- 90th percentile
- 734.7
- Min
This benchmark has a weight of 1.31 for chat models, measured over 364 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 401 | Gemma 1.1 2B IT· LMArena data | 1,025.8 |
| 402 | Mistral 7B Instruct· LMArena data | 1,021.8 |
| 403 | Guanaco 33B· LMArena data | 1,020.3 |
| 404 | StripedHyena Nous 7B· LMArena data | 1,015 |
| 405 | OLMo 7B Instruct· LMArena data | 1,009.9 |
| 406 | Vicuna 7B· LMArena data | 1,004.4 |
| 407 | Gemma 2B IT· LMArena data | 995.9 |
| 408 | Qwen1.5-4B-Chat· LMArena data | 983.4 |
| 409 | ChatGLM3 6B· LMArena data | 976.9 |
| 410 | GPT4All 13B Snoozy· LMArena data | 955.3 |
| 411 | Koala 13B· LMArena data | 943.1 |
| 412 | ChatGLM2 6B· LMArena data | 938.9 |
| 413 | MPT 7B Chat· LMArena data | 908.4 |
| 414 | RWKV-4 Raven 14B· LMArena data | 901.3 |
| 415 | OpenAssistant Pythia 12B· LMArena data | 897.5 |
| 416 | ChatGLM 6B· LMArena data | 896.3 |
| 417 | StableLM Tuned Alpha 7B· LMArena data | 849.5 |
| 418 | Alpaca 13B· LMArena data | 839.4 |
| 419 | FastChat-T5 3B· LMArena data | 829.8 |
| 420 | Dolly 2.0 12B· LMArena data | 809.4 |
| 421 | LLaMA 13B· LMArena data | 734.7 |
Showing 401–421 of 421 results.
Data credits: LMArena, CC BY 4.0 (licence)