Skip to content

Benchmark

MTEB(Scandinavian, v1) - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
22
Scores recorded
22
Sources
1
IQ weight
0.79

Score distribution

54.2%
Mean
53%
Median
8.6%
Std dev
46.4%
10th percentile
63.4%
90th percentile
40%
Min
40%71.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.79 for embedding models, measured over 22 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BMean (TaskType)· MTEB Leaderboard data71.5%
2Qwen3 Embedding 4BMean (TaskType)· MTEB Leaderboard data69.6%
3E5 Mistral 7B InstructMean (TaskType)· MTEB Leaderboard data63.4%
4Multilingual E5 Large InstructMean (TaskType)· MTEB Leaderboard data63%
5Text Embedding 3 LargeMean (TaskType)· MTEB Leaderboard data62.4%
6Qwen3 Embedding 0.6BMean (TaskType)· MTEB Leaderboard data62%
7Multilingual E5 LargeMean (TaskType)· MTEB Leaderboard data59.6%
8Text Embedding 3 SmallMean (TaskType)· MTEB Leaderboard data58.7%
9BGE M3Mean (TaskType)· MTEB Leaderboard data58.5%
10snowflake-arctic-embed-l-v2.0Mean (TaskType)· MTEB Leaderboard data57.4%
11Granite Embedding 278m MultilingualMean (TaskType)· MTEB Leaderboard data53%
12E5 Large V2Mean (TaskType)· MTEB Leaderboard data49.6%
13Paraphrase Multilingual MPNet v2Mean (TaskType)· MTEB Leaderboard data49.4%
14E5 Base V2Mean (TaskType)· MTEB Leaderboard data49.2%
15BGE Large En V1.5Mean (TaskType)· MTEB Leaderboard data47.7%
16Gte LargeMean (TaskType)· MTEB Leaderboard data47.7%
17UAE-Large-V1Mean (TaskType)· MTEB Leaderboard data47.5%
18BGE Base En V1.5Mean (TaskType)· MTEB Leaderboard data46.6%
19Gte BaseMean (TaskType)· MTEB Leaderboard data46.5%
20bge-small-en-v1.5Mean (TaskType)· MTEB Leaderboard data46.4%
21All Mpnet Base V2Mean (TaskType)· MTEB Leaderboard data42.9%
22All MiniLM L6 V2Mean (TaskType)· MTEB Leaderboard data40%