Skip to content

Benchmark

MTEB(fas, v2) - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
5
Scores recorded
5
Sources
1
IQ weight
0.00

Score distribution

65.5%
Mean
67.4%
Median
3.5%
Std dev
59%
10th percentile
68.6%
90th percentile
59%
Min
59%68.6%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.00 for embedding models, measured over 5 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1BGE M3Mean (TaskType)· MTEB Leaderboard data68.6%
2Jina Embeddings v3Mean (TaskType)· MTEB Leaderboard data67.8%
3Multilingual E5 LargeMean (TaskType)· MTEB Leaderboard data67.4%
4E5 Mistral 7B InstructMean (TaskType)· MTEB Leaderboard data64.9%
5Text Embedding 3 SmallMean (TaskType)· MTEB Leaderboard data59%