Skip to content

Benchmark

MTEB(deu, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
29
Scores recorded
29
Sources
1
IQ weight
0.70

Score distribution

58.2%
Mean
53.7%
Median
14.7%
Std dev
46.8%
10th percentile
75.9%
90th percentile
19.3%
Min
19.3%86.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.70 for embedding models, measured over 28 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Jina Embeddings v5 Text SmallClassification· MTEB Leaderboard data86.4%
2Jina Embeddings v5 Text NanoClassification· MTEB Leaderboard data85.4%
3Jina Embeddings v3Classification· MTEB Leaderboard data79.2%
4Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data75.9%
5E5 Mistral 7B InstructClassification· MTEB Leaderboard data72.5%
6NV-Embed-v2Classification· MTEB Leaderboard data72.1%
7Multilingual E5 Large InstructClassification· MTEB Leaderboard data69.5%
8BGE M3Classification· MTEB Leaderboard data68.9%
9Multilingual E5 LargeClassification· MTEB Leaderboard data67.5%
10snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data66.3%
11Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data64.9%
12snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data64.9%
13Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data64%
14E5 Large V2Classification· MTEB Leaderboard data56.1%
15UAE-Large-V1Classification· MTEB Leaderboard data53.7%
16E5 Base V2Classification· MTEB Leaderboard data52.5%
17BGE Large En V1.5Classification· MTEB Leaderboard data50.8%
18Gte LargeClassification· MTEB Leaderboard data50.1%
19Gte BaseClassification· MTEB Leaderboard data49.1%
20All Mpnet Base V2Classification· MTEB Leaderboard data49.1%
21All MiniLM L12 V2Classification· MTEB Leaderboard data49.1%
22All MiniLM L6 V2Classification· MTEB Leaderboard data49%
23nomic-embed-text-v1Classification· MTEB Leaderboard data48.6%
24BGE Base En V1.5Classification· MTEB Leaderboard data48.5%
25bge-small-en-v1.5Classification· MTEB Leaderboard data47.5%
26nomic-embed-text-v1.5Classification· MTEB Leaderboard data46.8%
27Text2vec Base ChineseClassification· MTEB Leaderboard data43%
28Nemotron 3 Embed 1bClassification· MTEB Leaderboard data37.9%
29Jina Embeddings v2 Base ENClassification· MTEB Leaderboard data19.3%