Skip to content

Benchmark

MTEB(pol, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
33
Scores recorded
33
Sources
1
IQ weight
0.65

Score distribution

74.8%
Mean
77.7%
Median
11.8%
Std dev
61.6%
10th percentile
87.2%
90th percentile
41%
Min
41%89.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.65 for embedding models, measured over 33 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1BGE multilingual gemma2PairClassification· MTEB Leaderboard data89.8%
2Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data87.7%
3Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data87.7%
4Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data87.2%
5E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data87%
6Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data86.9%
7Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data86.9%
8Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data86.9%
9Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data86.2%
10Multilingual E5 LargePairClassification· MTEB Leaderboard data85.3%
11NV-Embed-v2PairClassification· MTEB Leaderboard data85%
12Jina Embeddings v3PairClassification· MTEB Leaderboard data83.7%
13Text Embedding 3 LargePairClassification· MTEB Leaderboard data82.9%
14Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data81.4%
15snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data80.2%
16snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data78.3%
17Text Embedding 3 SmallPairClassification· MTEB Leaderboard data77.7%
18E5 Large V2PairClassification· MTEB Leaderboard data76.3%
19Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data75.9%
20E5 Base V2PairClassification· MTEB Leaderboard data69.3%
21Gte LargePairClassification· MTEB Leaderboard data65.8%
22UAE-Large-V1PairClassification· MTEB Leaderboard data65.7%
23nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data65.6%
24bge-small-en-v1.5PairClassification· MTEB Leaderboard data65.2%
25All MiniLM L12 V2PairClassification· MTEB Leaderboard data64.6%
26nomic-embed-text-v1PairClassification· MTEB Leaderboard data64.6%
27BGE Large En V1.5PairClassification· MTEB Leaderboard data64%
28Gte BasePairClassification· MTEB Leaderboard data63.8%
29BGE Base En V1.5PairClassification· MTEB Leaderboard data62.6%
30All MiniLM L6 V2PairClassification· MTEB Leaderboard data61.6%
31Jina Embedding B EN v1PairClassification· MTEB Leaderboard data60.8%
32All Mpnet Base V2PairClassification· MTEB Leaderboard data60.5%
33Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data41%