Skip to content

Benchmark

MTEB(eng, v1) - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
25
Scores recorded
25
Sources
1
IQ weight
0.75

Score distribution

61.2%
Mean
60.7%
Median
3.6%
Std dev
56.7%
10th percentile
67.4%
90th percentile
55.4%
Min
55.4%68.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.75 for embedding models, measured over 25 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BMean (TaskType)· MTEB Leaderboard data68.1%
2Qwen3 Embedding 4BMean (TaskType)· MTEB Leaderboard data67.6%
3BGE En IclMean (TaskType)· MTEB Leaderboard data67.4%
4BGE multilingual gemma2Mean (TaskType)· MTEB Leaderboard data66.1%
5E5 Mistral 7B InstructMean (TaskType)· MTEB Leaderboard data64.2%
6Qwen3 Embedding 0.6BMean (TaskType)· MTEB Leaderboard data64%
7UAE-Large-V1Mean (TaskType)· MTEB Leaderboard data62.9%
8BGE Large En V1.5Mean (TaskType)· MTEB Leaderboard data62.4%
9bge-large-enMean (TaskType)· MTEB Leaderboard data62.3%
10Multilingual E5 Large InstructMean (TaskType)· MTEB Leaderboard data62%
11BGE Base En V1.5Mean (TaskType)· MTEB Leaderboard data61.7%
12Gte LargeMean (TaskType)· MTEB Leaderboard data61.3%
13Gte BaseMean (TaskType)· MTEB Leaderboard data60.7%
14bge-small-en-v1.5Mean (TaskType)· MTEB Leaderboard data60.4%
15nomic-embed-text-v1Mean (TaskType)· MTEB Leaderboard data60.3%
16E5 Large V2Mean (TaskType)· MTEB Leaderboard data60.2%
17E5 Base V2Mean (TaskType)· MTEB Leaderboard data59.8%
18nomic-embed-text-v1.5Mean (TaskType)· MTEB Leaderboard data59.7%
19snowflake-arctic-embed-l-v2.0Mean (TaskType)· MTEB Leaderboard data59.1%
20snowflake-arctic-embed-m-v2.0Mean (TaskType)· MTEB Leaderboard data58.3%
21Granite Embedding Small English R2Mean (TaskType)· MTEB Leaderboard data57.1%
22Granite Embedding 278m MultilingualMean (TaskType)· MTEB Leaderboard data56.8%
23All MiniLM L6 V2Mean (TaskType)· MTEB Leaderboard data56.7%
24Paraphrase Multilingual MPNet v2Mean (TaskType)· MTEB Leaderboard data55.6%
25Jina Embeddings v2 Base ENMean (TaskType)· MTEB Leaderboard data55.4%