Skip to content

Benchmark

MTEB(deu, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
35
Scores recorded
35
Sources
1
IQ weight
0.68

Score distribution

52.7%
Mean
51.9%
Median
4.2%
Std dev
48.7%
10th percentile
58.6%
90th percentile
46.7%
Min
46.7%64.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.68 for embedding models, measured over 34 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data64.7%
2Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data61.8%
3Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data58.7%
4Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data58.6%
5Text Embedding 3 LargePairClassification· MTEB Leaderboard data57.8%
6Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data56.3%
7Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data56.2%
8Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data55.5%
9E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data55.2%
10snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data54.9%
11Text Embedding 3 SmallPairClassification· MTEB Leaderboard data54.6%
12Jina Embeddings v3PairClassification· MTEB Leaderboard data54.5%
13Multilingual E5 LargePairClassification· MTEB Leaderboard data54.1%
14NV-Embed-v2PairClassification· MTEB Leaderboard data53.7%
15Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data53.1%
16Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data52.8%
17Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data52.5%
18snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data51.9%
19Nemotron 3 Embed 1bPairClassification· MTEB Leaderboard data51.1%
20Jina Embedding B EN v1PairClassification· MTEB Leaderboard data50.1%
21UAE-Large-V1PairClassification· MTEB Leaderboard data50.1%
22Gte LargePairClassification· MTEB Leaderboard data50%
23Text2vec Base ChinesePairClassification· MTEB Leaderboard data50%
24nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data49.8%
25Gte BasePairClassification· MTEB Leaderboard data49.5%
26BGE Large En V1.5PairClassification· MTEB Leaderboard data49.1%
27All Mpnet Base V2PairClassification· MTEB Leaderboard data49%
28BGE Base En V1.5PairClassification· MTEB Leaderboard data48.9%
29bge-small-en-v1.5PairClassification· MTEB Leaderboard data48.8%
30All MiniLM L6 V2PairClassification· MTEB Leaderboard data48.8%
31E5 Large V2PairClassification· MTEB Leaderboard data48.8%
32nomic-embed-text-v1PairClassification· MTEB Leaderboard data48.7%
33E5 Base V2PairClassification· MTEB Leaderboard data48.4%
34All MiniLM L12 V2PairClassification· MTEB Leaderboard data48.4%
35Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data46.7%