Skip to content

Benchmark

Agentset Reranker Elo - MSMARCO

Rerank benchmarks measure how well models put the most relevant search results first. Higher scores are better.

Models measured
6
Scores recorded
6
Sources
1
IQ weight
No weight published

Score distribution

1,500
Mean
1,530
Median
71.5
Std dev
1,437
10th percentile
1,586
90th percentile
1,381
Min
1,3811,586
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Rerank V4.0 ProMSMARCO· Agentset1,586
2Rerank V3.5MSMARCO· Agentset1,565
3Qwen3 Reranker 8BMSMARCO· Agentset1,530
4Rerank V4.0 FastMSMARCO· Agentset1,501
5BGE Reranker v2 M3MSMARCO· Agentset1,437
6Jina Reranker v2 Base MultilingualMSMARCO· Agentset1,381