Skip to content

Benchmark

MTEB(rus, v1.1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
27
Scores recorded
27
Sources
1
IQ weight
0.56

Score distribution

49.4%
Mean
56.8%
Median
15.9%
Std dev
31.2%
10th percentile
67.2%
90th percentile
28.7%
Min
28.7%74.3%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.56 for embedding models, measured over 27 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BClassification· MTEB Leaderboard data74.3%
2Qwen3 Embedding 4BClassification· MTEB Leaderboard data73.6%
3E5 Mistral 7B InstructClassification· MTEB Leaderboard data69.1%
4Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data67.2%
5Multilingual E5 Large InstructClassification· MTEB Leaderboard data66.3%
6Jina Embeddings v3Classification· MTEB Leaderboard data65.2%
7Text Embedding 3 LargeClassification· MTEB Leaderboard data62.9%
8NV-Embed-v2Classification· MTEB Leaderboard data61.9%
9Multilingual E5 LargeClassification· MTEB Leaderboard data60.9%
10BGE M3Classification· MTEB Leaderboard data60.4%
11snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data58.4%
12Text Embedding 3 SmallClassification· MTEB Leaderboard data58.3%
13Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data57%
14Jina Embeddings v5 Omni NanoClassification· MTEB Leaderboard data56.8%
15Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data52.5%
16E5 Large V2Classification· MTEB Leaderboard data38.2%
17E5 Base V2Classification· MTEB Leaderboard data36%
18UAE-Large-V1Classification· MTEB Leaderboard data34.5%
19Gte LargeClassification· MTEB Leaderboard data33.7%
20BGE Large En V1.5Classification· MTEB Leaderboard data33.7%
21nomic-embed-text-v1Classification· MTEB Leaderboard data32.2%
22BGE Base En V1.5Classification· MTEB Leaderboard data31.9%
23nomic-embed-text-v1.5Classification· MTEB Leaderboard data31.4%
24Gte BaseClassification· MTEB Leaderboard data31.2%
25bge-small-en-v1.5Classification· MTEB Leaderboard data29.6%
26All Mpnet Base V2Classification· MTEB Leaderboard data28.8%
27All MiniLM L6 V2Classification· MTEB Leaderboard data28.7%