Skip to content

Benchmark

MTEB(Multilingual, v2) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
0.58

Score distribution

76.9%
Mean
76.7%
Median
5%
Std dev
71.6%
10th percentile
82.9%
90th percentile
68.2%
Min
68.2%86.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.58 for embedding models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data86.4%
2Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data85%
3Gemini Embedding 001PairClassification· MTEB Leaderboard data83.6%
4Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data82.9%
5Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data81.9%
6Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data81.9%
7Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data81.2%
8Text Multilingual Embedding 002PairClassification· MTEB Leaderboard data81.1%
9E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data81.1%
10Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data80.8%
11Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data80.8%
12BGE M3PairClassification· MTEB Leaderboard data80.8%
13Jina Embeddings v3PairClassification· MTEB Leaderboard data79.3%
14NV-Embed-v2PairClassification· MTEB Leaderboard data78.9%
15embeddinggemma-2PairClassification· MTEB Leaderboard data78.7%
16snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data76.7%
17Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data75.7%
18snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data74.9%
19E5 Large V2PairClassification· MTEB Leaderboard data73.9%
20UAE-Large-V1PairClassification· MTEB Leaderboard data72.8%
21E5 Base V2PairClassification· MTEB Leaderboard data72.6%
22BGE Large En V1.5PairClassification· MTEB Leaderboard data72%
23nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data71.9%
24Gte LargePairClassification· MTEB Leaderboard data71.7%
25BGE Base En V1.5PairClassification· MTEB Leaderboard data71.7%
26nomic-embed-text-v1PairClassification· MTEB Leaderboard data71.7%
27Jina Embedding B EN v1PairClassification· MTEB Leaderboard data71.6%
28bge-small-en-v1.5PairClassification· MTEB Leaderboard data71.6%
29Gte BasePairClassification· MTEB Leaderboard data71.4%
30All MiniLM L6 V2PairClassification· MTEB Leaderboard data71.2%
31Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data68.2%