Skip to content

Benchmark

MTEB(nld, v1) - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
23
Scores recorded
23
Sources
1
IQ weight
0.57

Score distribution

55%
Mean
56.2%
Median
8.1%
Std dev
44.8%
10th percentile
65.5%
90th percentile
43.2%
Min
43.2%70.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.57 for embedding models, measured over 23 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BMean (TaskType)· MTEB Leaderboard data70.1%
2Qwen3 Embedding 4BMean (TaskType)· MTEB Leaderboard data68.5%
3Multilingual E5 Large InstructMean (TaskType)· MTEB Leaderboard data65.5%
4Jina Embeddings v5 Text NanoMean (TaskType)· MTEB Leaderboard data63.6%
5Jina Embeddings v3Mean (TaskType)· MTEB Leaderboard data62.3%
6Multilingual E5 LargeMean (TaskType)· MTEB Leaderboard data62.2%
7BGE M3Mean (TaskType)· MTEB Leaderboard data61.6%
8snowflake-arctic-embed-l-v2.0Mean (TaskType)· MTEB Leaderboard data60.8%
9Qwen3 Embedding 0.6BMean (TaskType)· MTEB Leaderboard data58.8%
10Paraphrase Multilingual MPNet v2Mean (TaskType)· MTEB Leaderboard data58.4%
11Granite Embedding 278m MultilingualMean (TaskType)· MTEB Leaderboard data57.1%
12snowflake-arctic-embed-m-v2.0Mean (TaskType)· MTEB Leaderboard data56.2%
13E5 Large V2Mean (TaskType)· MTEB Leaderboard data50.9%
14BGE Large En V1.5Mean (TaskType)· MTEB Leaderboard data50.1%
15UAE-Large-V1Mean (TaskType)· MTEB Leaderboard data49.9%
16E5 Base V2Mean (TaskType)· MTEB Leaderboard data49.9%
17BGE Base En V1.5Mean (TaskType)· MTEB Leaderboard data48.3%
18bge-small-en-v1.5Mean (TaskType)· MTEB Leaderboard data47.4%
19Nemotron 3 Embed 1bMean (TaskType)· MTEB Leaderboard data46.4%
20All MiniLM L12 V2Mean (TaskType)· MTEB Leaderboard data45.2%
21All Mpnet Base V2Mean (TaskType)· MTEB Leaderboard data44.8%
22Jina Embedding B EN v1Mean (TaskType)· MTEB Leaderboard data44.7%
23All MiniLM L6 V2Mean (TaskType)· MTEB Leaderboard data43.2%