Skip to content

Benchmark

GPQA Diamond

Science benchmarks measure how well models answer science questions. Scores are percentages. Higher is better.

Models and systems measured
282
Scores recorded
1623
Sources
4
IQ weight
1.72

Score distribution

79.3%
Mean
84.5%
Median
15.7%
Std dev
56.8%
10th percentile
92.2%
90th percentile
0.168%
Min
0.168%96.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.72 for chat models, measured over 272 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#Model or system
201Kimi K3.1 ProOpenRouter harness, moonshotai/kimi-k3.1-pro-20261023, DeepInfra, public 90-day aggregate· OpenRouter benchmark exports91.6%
202MiniMax M3OpenRouter harness, minimax/minimax-m3-20260531, Together, public 90-day aggregate· OpenRouter benchmark exports91.6%
203MiniMax M3OpenRouter harness, minimax/minimax-m3-20260531, StreamLake, public 90-day aggregate· OpenRouter benchmark exports91.5%
204DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, AtlasCloud, public 90-day aggregate· OpenRouter benchmark exports91.5%
205DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, Alibaba, public 90-day aggregate· OpenRouter benchmark exports91.5%
206DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, Cloudflare, public 90-day aggregate· OpenRouter benchmark exports91.4%
207Inkling 2 SmallOpenRouter harness, thinkingmachines/inkling-2-small-20261107, Nebius, public 90-day aggregate· OpenRouter benchmark exports91.4%
208Inkling 2 SmallOpenRouter harness, thinkingmachines/inkling-2-small-20261107, Together, public 90-day aggregate· OpenRouter benchmark exports91.4%
209GPT 5.2xhigh· Epoch AI Benchmarking Hub data91.4%
210MiniMax M3OpenRouter harness, minimax/minimax-m3-20260531, Novita, public 90-day aggregate· OpenRouter benchmark exports91.3%
211DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, Baidu, public 90-day aggregate· OpenRouter benchmark exports91.3%
212Claude Opus 4.6Opus 4.6 System Card capability summary · adaptive thinking · max effort · default sampling · 5 trials unless noted· Reported by Anthropic· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.91.3%
213Claude Opus 4.6Qwen3.8 Omni Flash 官方发布表 · max effort· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.91.3%
214DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, Wafer, public 90-day aggregate· OpenRouter benchmark exports91.3%
215DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, Phala, public 90-day aggregate· OpenRouter benchmark exports91.3%
216DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, Alibaba, public 90-day aggregate· OpenRouter benchmark exports91.2%
217Kimi K3OpenRouter harness, moonshotai/kimi-k3-20260715, Together, public 90-day aggregate· OpenRouter benchmark exports91.2%
218Inkling 2 SmallOpenRouter harness, thinkingmachines/inkling-2-small-20261107, Cloudflare, public 90-day aggregate· OpenRouter benchmark exports91.2%
219MiniMax M3OpenRouter harness, minimax/minimax-m3-20260531, GMICloud, public 90-day aggregate· OpenRouter benchmark exports91.2%
220GLM 5.2setting not named by the source· Reported by Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.91.2%
221DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, Venice, public 90-day aggregate· OpenRouter benchmark exports91.2%
222DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, GMICloud, public 90-day aggregate· OpenRouter benchmark exports91.1%
223DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, Pearl Research, public 90-day aggregate· OpenRouter benchmark exports91.1%
224GPT-6.1 TerraOpenRouter harness, openai/gpt-6.1-terra-20261026, OpenAI, public 90-day aggregate· OpenRouter benchmark exports91.1%
225DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, DekaLLM, public 90-day aggregate· OpenRouter benchmark exports91.1%
226Claude Opus 4.8max· Epoch AI Benchmarking Hub data91%
227DeepSeek V4 Flash 0731max· Epoch AI Benchmarking Hub data91%
228Kimi K3OpenRouter harness, moonshotai/kimi-k3-20260715, DeepInfra, public 90-day aggregate· OpenRouter benchmark exports91%
229Qwen3.8 Omni FlashQwen3.8 Omni Flash 官方发布表· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.91%
230GPT-6.1 TerraOpenRouter harness, openai/gpt-6.1-terra-20261026, Azure, public 90-day aggregate· OpenRouter benchmark exports91%
231Muse Spark OpenOpenRouter harness, meta/muse-spark-open-20261015, Modal, public 90-day aggregate· OpenRouter benchmark exports91%
232DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, Novita, public 90-day aggregate· OpenRouter benchmark exports91%
233DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, River, public 90-day aggregate· OpenRouter benchmark exports91%
234GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna-pro-20260709, Azure, public 90-day aggregate, pro· OpenRouter benchmark exports91%
235DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, auto-routing, public 90-day aggregate· OpenRouter benchmark exports90.9%
236DeepSeek V4.1 FlashOpenRouter harness, deepseek/deepseek-v4.1-flash-20260910, NextBit, public 90-day aggregate· OpenRouter benchmark exports90.9%
237DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, StreamLake, public 90-day aggregate· OpenRouter benchmark exports90.9%
238DeepSeek V4 Pro 0813OpenRouter harness, deepseek/deepseek-v4-pro-20260813, Reka, public 90-day aggregate· OpenRouter benchmark exports90.9%
239DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, Ambient, public 90-day aggregate· OpenRouter benchmark exports90.9%
240Inkling 2 SmallOpenRouter harness, thinkingmachines/inkling-2-small-20261107, Modal, public 90-day aggregate· OpenRouter benchmark exports90.9%
241Qwen3.7 MaxOpenRouter harness, qwen/qwen3.7-max-20260520, AtlasCloud, public 90-day aggregate· OpenRouter benchmark exports90.9%
242DeepSeek V4 Prohigh· Epoch AI Benchmarking Hub data90.9%
243GLM 5.3max· Epoch AI Benchmarking Hub data90.9%
244MiniMax M3· Epoch AI Benchmarking Hub data90.9%
245Qwen3.7 Max· Epoch AI Benchmarking Hub data90.9%
246DeepSeek V4 Flash Vision ExpOpenRouter harness, deepseek/deepseek-v4-flash-vision-exp-20260821, GMICloud, public 90-day aggregate· OpenRouter benchmark exports90.9%
247DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, StepFun, public 90-day aggregate· OpenRouter benchmark exports90.9%
248DeepSeek V4.1 FlashDeepSeek V4.1 launch chart · exact public value · setting not further specified· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.9%
249DeepSeek V4.1 FlashPass@1 / max effort· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.90.9%
250DeepSeek V4.1 Flash 1017OpenRouter harness, deepseek/deepseek-v4.1-flash-20261017, CoreWeave, public 90-day aggregate· OpenRouter benchmark exports90.9%

Showing 201–250 of 1,621 results.

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or system
MiMo V2 Flash Baseofficial Base table · 5-shot· Reported by Xiaomi MiMo· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.55.1%
Qwen3.8-2.4T-A95Blifecycle-page core-benchmark claim· Reported by Alibaba Cloud Model Studio· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.92.6%

Tokens the model generated per task, as measured by the source. Comparable within this benchmark only.

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · OpenEvals/leaderboard-data, MIT (licence)