Skip to content

Benchmark

MTEB(rus, v1.1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
37
Scores recorded
37
Sources
1
IQ weight
0.50

Score distribution

55.3%
Mean
56.3%
Median
8.1%
Std dev
46.3%
10th percentile
64.6%
90th percentile
44.2%
Min
44.2%71.3%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.50 for embedding models, measured over 37 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data71.3%
2Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data67.3%
3Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data67.3%
4Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data66.6%
5Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data64.6%
6Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data64.6%
7Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data64.6%
8Gemini Embedding 001PairClassification· MTEB Leaderboard data63.9%
9Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data63.9%
10E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data60.8%
11Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data60.7%
12BGE M3PairClassification· MTEB Leaderboard data60.6%
13Text Multilingual Embedding 002PairClassification· MTEB Leaderboard data60.4%
14NV-Embed-v2PairClassification· MTEB Leaderboard data60.3%
15Jina Embeddings v3PairClassification· MTEB Leaderboard data59.2%
16Multilingual E5 LargePairClassification· MTEB Leaderboard data58.4%
17Text Embedding 3 LargePairClassification· MTEB Leaderboard data58.1%
18embeddinggemma-2PairClassification· MTEB Leaderboard data57.1%
19Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data56.3%
20snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data53.8%
21Text Embedding 3 SmallPairClassification· MTEB Leaderboard data53.7%
22snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data51.9%
23E5 Base V2PairClassification· MTEB Leaderboard data49.1%
24Jina Embedding B EN v1PairClassification· MTEB Leaderboard data48.8%
25Gte LargePairClassification· MTEB Leaderboard data48.5%
26UAE-Large-V1PairClassification· MTEB Leaderboard data47.8%
27BGE Large En V1.5PairClassification· MTEB Leaderboard data47.6%
28E5 Large V2PairClassification· MTEB Leaderboard data47.3%
29nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data47.1%
30BGE Base En V1.5PairClassification· MTEB Leaderboard data47.1%
31Gte BasePairClassification· MTEB Leaderboard data46.9%
32All MiniLM L12 V2PairClassification· MTEB Leaderboard data46.4%
33nomic-embed-text-v1PairClassification· MTEB Leaderboard data46.3%
34All MiniLM L6 V2PairClassification· MTEB Leaderboard data45%
35Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data44.8%
36All Mpnet Base V2PairClassification· MTEB Leaderboard data44.5%
37bge-small-en-v1.5PairClassification· MTEB Leaderboard data44.2%