Benchmark
MCPMark · Version Unspecified
Scores are percentages. Higher is better.
Benchmark sourceScores from BenchBoard docs.
- Models measured
- 7
- Scores recorded
- 8
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 46.4%
- Mean
- 48.2%
- Median
- 11.2%
- Std dev
- 37%
- 10th percentile
- 58.7%
- 90th percentile
- 26.5%
- Min
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Qwen3.7 MaxQwen3.7-Max release · GitHub MCP v0.30.3 · Playwright responses truncated at 32K· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 60.8% |
| 2 | Qwen3.7 PlusQwen3.7-Plus release · GitHub MCP v0.30.3 · Playwright responses truncated at 32K· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 58.7% |
| 3 | Kimi K2.6Kimi K2.6 official benchmark table · thinking · temp 1.0 · top_p 1.0 · 262,144 context· Reported by Moonshot AI· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 55.9% |
| 4 | Qwen3.6 PlusQwen official release table · thinking mode unless benchmark requires otherwise · GitHub MCP v0.30.3 · Playwright responses truncated at 32K· Reported by Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 48.2% |
| 5 | Qwen3.5 397B A17BQwen3.5 release/model card · GitHub MCP v0.30.3 · Playwright responses truncated at 32K· Reported by Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 46.1% |
| 6 | DeepSeek V3.2Thinking mode · temperature 1.0 · 128K context · internal search/Playwright environment · tool-role outputs· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 38% |
| 7 | Qwen3.6 FlashQwen3.6-35B-A3B official model card · hosted API name Qwen3.6-Flash· Reported by Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 37% |
| 8 | DeepSeek V3.2Non-thinking mode · temperature 1.0 · 128K context · internal search/Playwright environment · tool-role outputs· Reported by DeepSeek· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 26.5% |