Skip to content

Benchmark

MTEB(eng, v2) - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
0.85

Score distribution

61.4%
Mean
61.2%
Median
4.6%
Std dev
56.9%
10th percentile
65.7%
90th percentile
44.7%
Min
44.7%68.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.85 for embedding models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BMean (TaskType)· MTEB Leaderboard data68.7%
2Qwen3 Embedding 4BMean (TaskType)· MTEB Leaderboard data68.1%
3Gemini Embedding 001Mean (TaskType)· MTEB Leaderboard data67.7%
4Jina Embeddings v5 Omni SmallMean (TaskType)· MTEB Leaderboard data65.7%
5Jina Embeddings v5 Omni NanoMean (TaskType)· MTEB Leaderboard data65.2%
6Jina Embeddings v5 Text NanoMean (TaskType)· MTEB Leaderboard data65.2%
7NV-Embed-v2Mean (TaskType)· MTEB Leaderboard data65%
8Text Embedding 004Mean (TaskType)· MTEB Leaderboard data64.8%
9Text Embedding 005Mean (TaskType)· MTEB Leaderboard data64.8%
10Qwen3 Embedding 0.6BMean (TaskType)· MTEB Leaderboard data64.7%
11E5 Mistral 7B InstructMean (TaskType)· MTEB Leaderboard data64%
12Text Multilingual Embedding 002Mean (TaskType)· MTEB Leaderboard data63.5%
13embeddinggemma-2Mean (TaskType)· MTEB Leaderboard data63.2%
14BGE Large En V1.5Mean (TaskType)· MTEB Leaderboard data61.9%
15UAE-Large-V1Mean (TaskType)· MTEB Leaderboard data61.9%
16Multilingual E5 Large InstructMean (TaskType)· MTEB Leaderboard data61.2%
17Gte LargeMean (TaskType)· MTEB Leaderboard data60.9%
18BGE Base En V1.5Mean (TaskType)· MTEB Leaderboard data60.8%
19Gte BaseMean (TaskType)· MTEB Leaderboard data59.9%
20bge-small-en-v1.5Mean (TaskType)· MTEB Leaderboard data59.9%
21snowflake-arctic-embed-l-v2.0Mean (TaskType)· MTEB Leaderboard data59.8%
22nomic-embed-text-v1Mean (TaskType)· MTEB Leaderboard data59.6%
23E5 Base V2Mean (TaskType)· MTEB Leaderboard data59.4%
24E5 Large V2Mean (TaskType)· MTEB Leaderboard data59.4%
25nomic-embed-text-v1.5Mean (TaskType)· MTEB Leaderboard data58.5%
26snowflake-arctic-embed-m-v2.0Mean (TaskType)· MTEB Leaderboard data58.5%
27Granite Embedding 278m MultilingualMean (TaskType)· MTEB Leaderboard data56.9%
28Granite Embedding Small English R2Mean (TaskType)· MTEB Leaderboard data56.9%
29All MiniLM L6 V2Mean (TaskType)· MTEB Leaderboard data55.9%
30Paraphrase Multilingual MPNet v2Mean (TaskType)· MTEB Leaderboard data55.7%
31Jina Embeddings v2 Base ENMean (TaskType)· MTEB Leaderboard data44.7%