Skip to content

Benchmark

MTEB(eng, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
0.96

Score distribution

73.7%
Mean
73.2%
Median
8.8%
Std dev
63.3%
10th percentile
86.5%
90th percentile
46.5%
Min
46.5%89%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.96 for embedding models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1BGE En IclClassification· MTEB Leaderboard data89%
2BGE multilingual gemma2Classification· MTEB Leaderboard data88.1%
3Qwen3 Embedding 8BClassification· MTEB Leaderboard data87.1%
4Qwen3 Embedding 4BClassification· MTEB Leaderboard data86.5%
5NV-Embed-v2Classification· MTEB Leaderboard data85.1%
6Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data82%
7Text Embedding 004Classification· MTEB Leaderboard data81.1%
8Text Embedding 005Classification· MTEB Leaderboard data80.8%
9E5 Mistral 7B InstructClassification· MTEB Leaderboard data77.4%
10bge-large-enClassification· MTEB Leaderboard data76.2%
11UAE-Large-V1Classification· MTEB Leaderboard data75.2%
12Text Embedding 3 LargeClassification· MTEB Leaderboard data75.1%
13BGE Large En V1.5Classification· MTEB Leaderboard data74.2%
14BGE Base En V1.5Classification· MTEB Leaderboard data73.7%
15Multilingual E5 Large InstructClassification· MTEB Leaderboard data73.4%
16Text Embedding 3 SmallClassification· MTEB Leaderboard data73.2%
17nomic-embed-text-v1Classification· MTEB Leaderboard data72.4%
18E5 Large V2Classification· MTEB Leaderboard data72.4%
19bge-small-en-v1.5Classification· MTEB Leaderboard data72.2%
20nomic-embed-text-v1.5Classification· MTEB Leaderboard data71.5%
21E5 Base V2Classification· MTEB Leaderboard data71.2%
22Gte LargeClassification· MTEB Leaderboard data71.1%
23Text Embedding Ada 002Classification· MTEB Leaderboard data70.9%
24Gte BaseClassification· MTEB Leaderboard data70.8%
25Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data67.5%
26snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data67.4%
27snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data65.4%
28Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data63.3%
29All MiniLM L6 V2Classification· MTEB Leaderboard data62.6%
30Granite Embedding Small English R2Classification· MTEB Leaderboard data61.7%
31Jina Embeddings v2 Base ENClassification· MTEB Leaderboard data46.5%