Skip to content

Benchmark

MTEB(Europe, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
0.68

Score distribution

85.9%
Mean
84.9%
Median
5.1%
Std dev
80.5%
10th percentile
91.5%
90th percentile
68.5%
Min
68.5%93.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.68 for embedding models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data93.7%
2Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data93%
3Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data91.5%
4Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data91.5%
5E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data91.2%
6Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data90.9%
7Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data90.7%
8BGE M3PairClassification· MTEB Leaderboard data90.6%
9Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data89.9%
10Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data89.8%
11NV-Embed-v2PairClassification· MTEB Leaderboard data88.9%
12Jina Embeddings v3PairClassification· MTEB Leaderboard data88.8%
13Multilingual E5 LargePairClassification· MTEB Leaderboard data88.8%
14snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data85.9%
15Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data85%
16E5 Large V2PairClassification· MTEB Leaderboard data84.9%
17snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data84.5%
18UAE-Large-V1PairClassification· MTEB Leaderboard data84.4%
19E5 Base V2PairClassification· MTEB Leaderboard data84.4%
20BGE Large En V1.5PairClassification· MTEB Leaderboard data84.1%
21Gte LargePairClassification· MTEB Leaderboard data83.6%
22Gte BasePairClassification· MTEB Leaderboard data83.4%
23nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data83.2%
24BGE Base En V1.5PairClassification· MTEB Leaderboard data83.1%
25bge-small-en-v1.5PairClassification· MTEB Leaderboard data83%
26nomic-embed-text-v1PairClassification· MTEB Leaderboard data82.8%
27All MiniLM L12 V2PairClassification· MTEB Leaderboard data81.5%
28All Mpnet Base V2PairClassification· MTEB Leaderboard data80.5%
29Jina Embedding B EN v1PairClassification· MTEB Leaderboard data80.5%
30All MiniLM L6 V2PairClassification· MTEB Leaderboard data80.2%
31Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data68.5%