Benchmark
WideSearch item F1
Scores are percentages. Higher is better.
Benchmark sourceScores from OpenRouter benchmark exports, BenchBoard docs.
- Models measured
- 6
- Scores recorded
- 40
- Sources
- 2
- IQ weight
- 0.00
Score distribution
- 72.9%
- Mean
- 74.4%
- Median
- 6.6%
- Std dev
- 65.8%
- 10th percentile
- 80.8%
- 90th percentile
- 59.4%
- Min
This benchmark has a weight of 0.00 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, perplexity, server-tool, 25, high· OpenRouter benchmark exports | 84% |
| 2 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, perplexity, server-tool, 25, xhigh· OpenRouter benchmark exports | 83.4% |
| 3 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, native, server-tool, 25, high· OpenRouter benchmark exports | 81.8% |
| 4 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, perplexity, server-tool, 5, high· OpenRouter benchmark exports | 81.4% |
| 5 | Kimi K2.6Kimi K2.6 official benchmark table · thinking · temp 1.0 · top_p 1.0 · 262,144 context · hide-tool-result context management· Reported by Moonshot AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 80.8% |
| 6 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, parallel, server-tool, 25, high· OpenRouter benchmark exports | 80.6% |
| 7 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, perplexity, server-tool, 5, xhigh· OpenRouter benchmark exports | 80% |
| 8 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, perplexity, server-tool, 1, high· OpenRouter benchmark exports | 79.8% |
| 9 | Kimi K2.5Agent Swarm· Reported by Moonshot AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 79% |
| 10 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, native, server-tool, 5, high· OpenRouter benchmark exports | 78.4% |
| 11 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, exa, server-tool, 25, xhigh· OpenRouter benchmark exports | 78% |
| 12 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, parallel, server-tool, 5, high· OpenRouter benchmark exports | 77.8% |
| 13 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, parallel, server-tool, 1, high· OpenRouter benchmark exports | 77.4% |
| 14 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, exa, server-tool, 25, high· OpenRouter benchmark exports | 77.4% |
| 15 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, perplexity, server-tool, 25, high· OpenRouter benchmark exports | 77.1% |
| 16 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, native, server-tool, 1, high· OpenRouter benchmark exports | 76.9% |
| 17 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, exa, server-tool, 5, xhigh· OpenRouter benchmark exports | 75.7% |
| 18 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, exa, server-tool, 25, high· OpenRouter benchmark exports | 74.5% |
| 19 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, parallel, server-tool, 25, xhigh· OpenRouter benchmark exports | 74.4% |
| 20 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, exa, server-tool, 5, high· OpenRouter benchmark exports | 74.4% |
| 21 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, parallel, server-tool, 5, xhigh· OpenRouter benchmark exports | 72.9% |
| 22 | Kimi K2.5single agent· Reported by Moonshot AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 72.7% |
| 23 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, perplexity, server-tool, 5, high· OpenRouter benchmark exports | 72.1% |
| 24 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, parallel, server-tool, 25, high· OpenRouter benchmark exports | 71.2% |
| 25 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, perplexity, server-tool, 1, xhigh· OpenRouter benchmark exports | 71.1% |
| 26 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, exa, server-tool, 1, xhigh· OpenRouter benchmark exports | 69.1% |
| 27 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, perplexity, server-tool, 25, high· OpenRouter benchmark exports | 68.2% |
| 28 | GPT-5.6 SolOpenRouter harness, openai/gpt-5.6-sol, exa, server-tool, 1, high· OpenRouter benchmark exports | 68.2% |
| 29 | GPT-5.6 LunaOpenRouter harness, openai/gpt-5.6-luna, parallel, server-tool, 1, xhigh· OpenRouter benchmark exports | 67.9% |
| 30 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, perplexity, server-tool, 5, high· OpenRouter benchmark exports | 67.8% |
| 31 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, exa, server-tool, 25, high· OpenRouter benchmark exports | 67% |
| 32 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, exa, server-tool, 5, high· OpenRouter benchmark exports | 66.3% |
| 33 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, parallel, server-tool, 5, high· OpenRouter benchmark exports | 66.2% |
| 34 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, parallel, server-tool, 25, high· OpenRouter benchmark exports | 65.9% |
| 35 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, perplexity, server-tool, 1, high· OpenRouter benchmark exports | 65.8% |
| 36 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, exa, server-tool, 5, high· OpenRouter benchmark exports | 65.8% |
| 37 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, parallel, server-tool, 5, high· OpenRouter benchmark exports | 65.2% |
| 38 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, parallel, server-tool, 1, high· OpenRouter benchmark exports | 61.7% |
| 39 | Claude Opus 5OpenRouter harness, anthropic/claude-opus-5, exa, server-tool, 1, high· OpenRouter benchmark exports | 59.6% |
| 40 | DeepSeek V4 Flash 0731OpenRouter harness, deepseek/deepseek-v4-flash-0731, parallel, server-tool, 1, high· OpenRouter benchmark exports | 59.4% |
Data credits: OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.