Benchmark
Artificial Analysis Briefcase
Scores are Elo ratings. Higher ratings are better.
Benchmark sourceScores from BenchBoard docs, LLM Stats data.
- Models and systems measured
- 19
- Scores recorded
- 30
- Sources
- 2
- IQ weight
- 1.34
Score distribution
- 1,526.1
- Mean
- 1,574
- Median
- 258.4
- Std dev
- 1,336
- 10th percentile
- 1,780
- 90th percentile
- 614
- Min
This benchmark has a weight of 1.34 for chat models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model or system | Score |
|---|---|---|
| 1 | Claude Sonnet 5.5adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · Haiku 5.5 card snapshot · max· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,824 |
| 2 | Claude Opus 5.5Opus 5.5 System Card capability section · v1.1 · Artificial Analysis · max effort· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,822 |
| 3 | Claude Sonnet 5.5v1.1 · Artificial Analysis · max· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,811 |
| 4 | Claude Opus 5.5Opus 5.5 System Card capability section · v1.1 · Artificial Analysis · xhigh effort· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,780 |
| 5 | Claude Sonnet 5.5adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · xhigh· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,746 |
| 6 | Claude Opus 5Opus 5 System Card capability summary · adaptive thinking · max effort unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,720 |
| 7 | Claude Opus 5.5Opus 5.5 System Card capability section · v1.1 · Artificial Analysis · high effort· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,705 |
| 8 | Claude Fable 5.1System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,694 |
| 9 | Claude Opus 5System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,685 |
| 10 | Claude Fable 5.1Opus 5.5 System Card capability section · v1.1 · Artificial Analysis · max effort· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,678 |
| 11 | Claude Opus 5Opus 5.5 System Card capability section · v1.1 · Artificial Analysis · max effort· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,673 |
| 12 | Grok 4.7release-page snapshot· Reported by SpaceXAI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,657 |
| 13 | Claude Haiku 5.5v1.1 · Artificial Analysis · max· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,578 |
| 14 | Grok 4.6· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim | 1,577 |
| 15 | Claude Fable 5Opus 5 System Card capability summary · adaptive thinking · max effort unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,574 |
| 16 | Claude Fable 5System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,572 |
| 17 | Kimi K3· LLM Stats data | 1,548 |
| 18 | Kimi K3snapshot 2026-07-23· Reported by Moonshot AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,548 |
| 19 | Inkling 2 Small· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim | 1,527 |
| 20 | GPT-5.6 SolOpus 5 System Card capability summary · adaptive thinking · max effort unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,505 |
| 21 | GPT-5.6 SolSystem Card capability summary · adaptive thinking · max effort · default sampling · 5 trials · context ≤1M unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,502 |
| 22 | Claude Sonnet 5Elo · Artificial Analysis independent evaluation· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,393 |
| 23 | Mistral Large 4· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim | 1,393 |
| 24 | Claude Haiku 5.5adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · medium· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,372 |
| 25 | Claude Opus 4.8Opus 5 System Card capability summary · adaptive thinking · max effort unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,346 |
| 26 | GPT-6 Lunaadaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · Haiku 5.5 card snapshot · max· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,336 |
| 27 | Gemini 3.8 Flashadaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · Haiku 5.5 card snapshot · highest thinking· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,203 |
| 28 | Inkling Small· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim | 917 |
| 29 | Claude Haiku 4.5adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · published setting· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 614 |
Not ranked
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| GPT-6 Sol (Sonnet 5.5 table label)source table label · max effort· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 1,483 |
Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · Data by LLM Stats