Skip to content

Benchmark

MTEB(nld, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
26
Scores recorded
26
Sources
1
IQ weight
0.41

Score distribution

70%
Mean
72.7%
Median
9.8%
Std dev
58.4%
10th percentile
81.5%
90th percentile
57.2%
Min
57.2%82.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.41 for embedding models, measured over 26 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data82.4%
2Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data82%
3Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data81.5%
4Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data81.5%
5Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data81.2%
6Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data81.2%
7Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data81%
8Multilingual E5 LargePairClassification· MTEB Leaderboard data80.3%
9BGE M3PairClassification· MTEB Leaderboard data78.3%
10Jina Embeddings v3PairClassification· MTEB Leaderboard data76.8%
11Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data75.2%
12snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data74.2%
13E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data72.7%
14Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data71%
15snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data66.7%
16E5 Large V2PairClassification· MTEB Leaderboard data62.4%
17Jina Embedding B EN v1PairClassification· MTEB Leaderboard data61.6%
18BGE Large En V1.5PairClassification· MTEB Leaderboard data60.4%
19UAE-Large-V1PairClassification· MTEB Leaderboard data60.1%
20E5 Base V2PairClassification· MTEB Leaderboard data59.5%
21Nemotron 3 Embed 1bPairClassification· MTEB Leaderboard data58.9%
22bge-small-en-v1.5PairClassification· MTEB Leaderboard data58.8%
23All MiniLM L12 V2PairClassification· MTEB Leaderboard data58.4%
24BGE Base En V1.5PairClassification· MTEB Leaderboard data58.4%
25All Mpnet Base V2PairClassification· MTEB Leaderboard data57.9%
26All MiniLM L6 V2PairClassification· MTEB Leaderboard data57.2%