Skip to content

Benchmark

MTEB(deu, v1) - Retrieval

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
27
Scores recorded
27
Sources
1
IQ weight
0.59

Score distribution

47.1%
Mean
44.4%
Median
9.2%
Std dev
36%
10th percentile
58.7%
90th percentile
30.5%
Min
30.5%59.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.59 for embedding models, measured over 27 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BRetrieval· MTEB Leaderboard data59.9%
2Nemotron 3 Embed 1bRetrieval· MTEB Leaderboard data59.1%
3INF Retriever v1Retrieval· MTEB Leaderboard data58.9%
4Qwen3 Embedding 4BRetrieval· MTEB Leaderboard data58.7%
5Jina Embeddings v5 Text NanoRetrieval· MTEB Leaderboard data57.6%
6Jina Embeddings v5 Text SmallRetrieval· MTEB Leaderboard data57.3%
7snowflake-arctic-embed-l-v2.0Retrieval· MTEB Leaderboard data57.1%
8Jina Embeddings v3Retrieval· MTEB Leaderboard data55.3%
9snowflake-arctic-embed-m-v2.0Retrieval· MTEB Leaderboard data55.2%
10E5 Mistral 7B InstructRetrieval· MTEB Leaderboard data52.9%
11Qwen3 Embedding 0.6BRetrieval· MTEB Leaderboard data52.9%
12Multilingual E5 Large InstructRetrieval· MTEB Leaderboard data51.9%
13Multilingual E5 LargeRetrieval· MTEB Leaderboard data50%
14Granite Embedding 278m MultilingualRetrieval· MTEB Leaderboard data44.4%
15E5 Large V2Retrieval· MTEB Leaderboard data43.6%
16Jina Embedding B EN v1Retrieval· MTEB Leaderboard data42.7%
17Gte LargeRetrieval· MTEB Leaderboard data42%
18BGE Large En V1.5Retrieval· MTEB Leaderboard data41.1%
19UAE-Large-V1Retrieval· MTEB Leaderboard data41.1%
20E5 Base V2Retrieval· MTEB Leaderboard data39.7%
21Paraphrase Multilingual MPNet v2Retrieval· MTEB Leaderboard data39.7%
22Gte BaseRetrieval· MTEB Leaderboard data39.1%
23BGE Base En V1.5Retrieval· MTEB Leaderboard data38.9%
24bge-small-en-v1.5Retrieval· MTEB Leaderboard data36%
25All Mpnet Base V2Retrieval· MTEB Leaderboard data34.4%
26All MiniLM L12 V2Retrieval· MTEB Leaderboard data32%
27All MiniLM L6 V2Retrieval· MTEB Leaderboard data30.5%