Skip to content

Benchmark

Agentset Embedding Win Rate - MSMARCO

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages. Higher is better.

Models measured
15
Scores recorded
15
Sources
1
IQ weight
0.52

Score distribution

44%
Mean
45.6%
Median
8.3%
Std dev
30%
10th percentile
55.6%
90th percentile
27.5%
Min
27.5%57.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.52 for embedding models, measured over 15 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard