Skip to content

Benchmark

MTEB(eng, v1) - Retrieval

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
37
Scores recorded
37
Sources
1
IQ weight
1.08

Score distribution

52.6%
Mean
52.9%
Median
6.1%
Std dev
44%
10th percentile
61.6%
90th percentile
35.3%
Min
35.3%63.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.08 for embedding models, measured over 37 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1NV-Embed-v2Retrieval· MTEB Leaderboard data63.2%
2Qwen3 Embedding 8BRetrieval· MTEB Leaderboard data62.8%
3BGE En IclRetrieval· MTEB Leaderboard data62.2%
4INF Retriever v1Retrieval· MTEB Leaderboard data61.7%
5Qwen3 Embedding 4BRetrieval· MTEB Leaderboard data61.6%
6BGE multilingual gemma2Retrieval· MTEB Leaderboard data59.2%
7E5 Mistral 7B InstructRetrieval· MTEB Leaderboard data57.1%
8Text Embedding 005Retrieval· MTEB Leaderboard data55.8%
9Qwen3 Embedding 0.6BRetrieval· MTEB Leaderboard data55.5%
10snowflake-arctic-embed-m-v2.0Retrieval· MTEB Leaderboard data55.5%
11Text Embedding 004Retrieval· MTEB Leaderboard data55.5%
12Text Embedding 3 LargeRetrieval· MTEB Leaderboard data55.4%
13snowflake-arctic-embed-l-v2.0Retrieval· MTEB Leaderboard data55.2%
14UAE-Large-V1Retrieval· MTEB Leaderboard data54.6%
15BGE Large En V1.5Retrieval· MTEB Leaderboard data54.3%
16bge-large-enRetrieval· MTEB Leaderboard data53.9%
17BGE Base En V1.5Retrieval· MTEB Leaderboard data53.2%
18Jina Embeddings v3Retrieval· MTEB Leaderboard data53.2%
19nomic-embed-text-v1Retrieval· MTEB Leaderboard data52.9%
20Multilingual E5 Large InstructRetrieval· MTEB Leaderboard data52.7%
21Gte LargeRetrieval· MTEB Leaderboard data52.2%
22nomic-embed-text-v1.5Retrieval· MTEB Leaderboard data51.8%
23bge-small-en-v1.5Retrieval· MTEB Leaderboard data51.7%
24Multilingual E5 LargeRetrieval· MTEB Leaderboard data51.5%
25Gte BaseRetrieval· MTEB Leaderboard data51.1%
26Text Embedding 3 SmallRetrieval· MTEB Leaderboard data51.1%
27Granite Embedding Small English R2Retrieval· MTEB Leaderboard data50.9%
28E5 Large V2Retrieval· MTEB Leaderboard data50.6%
29E5 Base V2Retrieval· MTEB Leaderboard data50.3%
30Text Embedding Ada 002Retrieval· MTEB Leaderboard data49.3%
31Granite Embedding 278m MultilingualRetrieval· MTEB Leaderboard data48.2%
32Jina Embeddings v2 Base ENRetrieval· MTEB Leaderboard data45.3%
33Jina Embedding B EN v1Retrieval· MTEB Leaderboard data44%
34All Mpnet Base V2Retrieval· MTEB Leaderboard data43.8%
35All MiniLM L12 V2Retrieval· MTEB Leaderboard data42.7%
36All MiniLM L6 V2Retrieval· MTEB Leaderboard data42%
37Paraphrase Multilingual MPNet v2Retrieval· MTEB Leaderboard data35.3%