Skip to content

Benchmark

SurveyReview v1.0 · Overall · Reason Quality Score

Higher scores are better.

Models and systems measured
7
Scores recorded
7
Sources
1
IQ weight
No weight published

Score distribution

0.379
Mean
0.37
Median
0.054
Std dev
0.36
10th percentile
0.42
90th percentile
0.29
Min
0.290.48
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#Model or systemScore
1Claude Opus 4.5SurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs0.48
2GPT 5.2SurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs0.42
3DeepSeek V3.2SurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs0.37
4Gemini 3 Pro PreviewSurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs0.29

Not ranked

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
GLM-4.7 (SurveyReview v1.0 label)SurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.0.37
Qwen3-32B (SurveyReview v1.0 label)SurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs0.36
SurveyReviewer (SurveyReview v1.0 label)SurveyReview v1.0 published leaderboard · text survey-paper evaluation · exact candidate snapshot, reasoning effort, prompt, run count, and harness are not specified in the summary table· Reported by SurveyReview authors / Z.ai· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it.0.36

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links.