Skip to content

Benchmark

MTEB(Law, v1) - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
32
Scores recorded
32
Sources
1
IQ weight
0.99

Score distribution

47.6%
Mean
44.3%
Median
13.9%
Std dev
35.8%
10th percentile
64.3%
90th percentile
3.2%
Min
3.2%71.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.99 for embedding models, measured over 32 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BMean (TaskType)· MTEB Leaderboard data71.7%
2Qwen3 Embedding 4BMean (TaskType)· MTEB Leaderboard data69.6%
3Nemotron 3 Embed 1bMean (TaskType)· MTEB Leaderboard data68.6%
4Jina Embeddings v5 Text SmallMean (TaskType)· MTEB Leaderboard data64.3%
5Qwen3 Embedding 0.6BMean (TaskType)· MTEB Leaderboard data64.2%
6INF Retriever v1Mean (TaskType)· MTEB Leaderboard data63.7%
7Text Embedding 3 LargeMean (TaskType)· MTEB Leaderboard data59.4%
8snowflake-arctic-embed-l-v2.0Mean (TaskType)· MTEB Leaderboard data59%
9Jina Embeddings v3Mean (TaskType)· MTEB Leaderboard data56.9%
10snowflake-arctic-embed-m-v2.0Mean (TaskType)· MTEB Leaderboard data56.6%
11Text Embedding 3 SmallMean (TaskType)· MTEB Leaderboard data56.3%
12Multilingual E5 Large InstructMean (TaskType)· MTEB Leaderboard data54.9%
13E5 Mistral 7B InstructMean (TaskType)· MTEB Leaderboard data54.3%
14Multilingual E5 LargeMean (TaskType)· MTEB Leaderboard data48.4%
15Granite Embedding 278m MultilingualMean (TaskType)· MTEB Leaderboard data45.8%
16NV-Embed-v2Mean (TaskType)· MTEB Leaderboard data44.3%
17nomic-embed-text-v1Mean (TaskType)· MTEB Leaderboard data41.8%
18E5 Large V2Mean (TaskType)· MTEB Leaderboard data41.7%
19Gte LargeMean (TaskType)· MTEB Leaderboard data41.2%
20Jina Embedding B EN v1Mean (TaskType)· MTEB Leaderboard data40.8%
21BGE Base En V1.5Mean (TaskType)· MTEB Leaderboard data40.2%
22Gte BaseMean (TaskType)· MTEB Leaderboard data40%
23BGE Large En V1.5Mean (TaskType)· MTEB Leaderboard data39.6%
24E5 Base V2Mean (TaskType)· MTEB Leaderboard data39.5%
25UAE-Large-V1Mean (TaskType)· MTEB Leaderboard data39.3%
26bge-small-en-v1.5Mean (TaskType)· MTEB Leaderboard data38.2%
27All Mpnet Base V2Mean (TaskType)· MTEB Leaderboard data37.4%
28Paraphrase Multilingual MPNet v2Mean (TaskType)· MTEB Leaderboard data36.4%
29nomic-embed-text-v1.5Mean (TaskType)· MTEB Leaderboard data35.8%
30All MiniLM L6 V2Mean (TaskType)· MTEB Leaderboard data35.4%
31All MiniLM L12 V2Mean (TaskType)· MTEB Leaderboard data33.9%
32Jina Embeddings v2 Base ENMean (TaskType)· MTEB Leaderboard data3.2%