Skip to content

Benchmark

MTEB(eng, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
41
Scores recorded
41
Sources
1
IQ weight
0.40

Score distribution

85.2%
Mean
85.2%
Median
2.1%
Std dev
82.4%
10th percentile
87.7%
90th percentile
78.6%
Min
78.6%88.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.40 for embedding models, measured over 41 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1NV-Embed-v2PairClassification· MTEB Leaderboard data88.7%
2E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data88.4%
3BGE En IclPairClassification· MTEB Leaderboard data88.2%
4Gemini Embedding 001PairClassification· MTEB Leaderboard data87.7%
5Text Embedding 004PairClassification· MTEB Leaderboard data87.7%
6Text Embedding 005PairClassification· MTEB Leaderboard data87.6%
7Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data87.5%
8UAE-Large-V1PairClassification· MTEB Leaderboard data87.3%
9BGE Large En V1.5PairClassification· MTEB Leaderboard data87.1%
10Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data87%
11Text Multilingual Embedding 002PairClassification· MTEB Leaderboard data86.6%
12BGE Base En V1.5PairClassification· MTEB Leaderboard data86.6%
13embeddinggemma-2PairClassification· MTEB Leaderboard data86.4%
14Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data86.2%
15bge-large-enPairClassification· MTEB Leaderboard data86.1%
16E5 Large V2PairClassification· MTEB Leaderboard data86.1%
17BGE multilingual gemma2PairClassification· MTEB Leaderboard data86%
18E5 Base V2PairClassification· MTEB Leaderboard data85.6%
19Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data85.4%
20nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data85.2%
21nomic-embed-text-v1PairClassification· MTEB Leaderboard data85.2%
22Gte LargePairClassification· MTEB Leaderboard data85.1%
23bge-small-en-v1.5PairClassification· MTEB Leaderboard data85%
24Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data85%
25Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data85%
26Text Embedding Ada 002PairClassification· MTEB Leaderboard data84.9%
27Multilingual E5 LargePairClassification· MTEB Leaderboard data84.8%
28Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data84.7%
29Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data84.7%
30Gte BasePairClassification· MTEB Leaderboard data84.7%
31Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data84.4%
32Jina Embeddings v3PairClassification· MTEB Leaderboard data84%
33All Mpnet Base V2PairClassification· MTEB Leaderboard data83%
34Jina Embedding B EN v1PairClassification· MTEB Leaderboard data83%
35snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data83%
36All MiniLM L12 V2PairClassification· MTEB Leaderboard data82.5%
37All MiniLM L6 V2PairClassification· MTEB Leaderboard data82.4%
38snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data82.3%
39Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data81.7%
40Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data81.4%
41Granite Embedding Small English R2PairClassification· MTEB Leaderboard data78.6%