Skip to content

Benchmark

MTEB(rus, v1.1) - MultilabelClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
32
Scores recorded
32
Sources
1
IQ weight
0.83

Score distribution

32.5%
Mean
31.1%
Median
6.8%
Std dev
26%
10th percentile
41.8%
90th percentile
23.6%
Min
23.6%44.6%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.83 for embedding models, measured over 32 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BMultilabelClassification· MTEB Leaderboard data44.6%
2Qwen3 Embedding 4BMultilabelClassification· MTEB Leaderboard data43.3%
3E5 Mistral 7B InstructMultilabelClassification· MTEB Leaderboard data42.9%
4Jina Embeddings v5 Omni NanoMultilabelClassification· MTEB Leaderboard data41.8%
5Jina Embeddings v5 Omni SmallMultilabelClassification· MTEB Leaderboard data41.7%
6Jina Embeddings v5 Text SmallMultilabelClassification· MTEB Leaderboard data41.7%
7Multilingual E5 Large InstructMultilabelClassification· MTEB Leaderboard data41.2%
8Qwen3 Embedding 0.6BMultilabelClassification· MTEB Leaderboard data40.1%
9Text Embedding 3 LargeMultilabelClassification· MTEB Leaderboard data39.4%
10Jina Embeddings v3MultilabelClassification· MTEB Leaderboard data39.2%
11Multilingual E5 LargeMultilabelClassification· MTEB Leaderboard data36%
12BGE M3MultilabelClassification· MTEB Leaderboard data34.9%
13snowflake-arctic-embed-l-v2.0MultilabelClassification· MTEB Leaderboard data33.4%
14Text Embedding 3 SmallMultilabelClassification· MTEB Leaderboard data33.3%
15Paraphrase Multilingual MPNet v2MultilabelClassification· MTEB Leaderboard data32.9%
16NV-Embed-v2MultilabelClassification· MTEB Leaderboard data31.1%
17Granite Embedding 278m MultilingualMultilabelClassification· MTEB Leaderboard data30.2%
18E5 Large V2MultilabelClassification· MTEB Leaderboard data27.2%
19Gte LargeMultilabelClassification· MTEB Leaderboard data27.2%
20bge-small-en-v1.5MultilabelClassification· MTEB Leaderboard data27.1%
21BGE Large En V1.5MultilabelClassification· MTEB Leaderboard data27.1%
22All Mpnet Base V2MultilabelClassification· MTEB Leaderboard data26.9%
23Jina Embedding B EN v1MultilabelClassification· MTEB Leaderboard data26.5%
24nomic-embed-text-v1MultilabelClassification· MTEB Leaderboard data26.4%
25UAE-Large-V1MultilabelClassification· MTEB Leaderboard data26.2%
26Gte BaseMultilabelClassification· MTEB Leaderboard data26.2%
27E5 Base V2MultilabelClassification· MTEB Leaderboard data26.1%
28nomic-embed-text-v1.5MultilabelClassification· MTEB Leaderboard data26.1%
29All MiniLM L12 V2MultilabelClassification· MTEB Leaderboard data26%
30BGE Base En V1.5MultilabelClassification· MTEB Leaderboard data25.8%
31All MiniLM L6 V2MultilabelClassification· MTEB Leaderboard data25.3%
32Jina Embeddings v2 Base ENMultilabelClassification· MTEB Leaderboard data23.6%