Skip to content

Benchmark

MTEB(Europe, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
25
Scores recorded
25
Sources
1
IQ weight
1.31

Score distribution

56%
Mean
53%
Median
8.2%
Std dev
50.2%
10th percentile
65.3%
90th percentile
35.3%
Min
35.3%74.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.31 for embedding models, measured over 25 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BClassification· MTEB Leaderboard data74.4%
2Qwen3 Embedding 4BClassification· MTEB Leaderboard data72.3%
3Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data65.3%
4Multilingual E5 Large InstructClassification· MTEB Leaderboard data63.2%
5Jina Embeddings v3Classification· MTEB Leaderboard data63.2%
6E5 Mistral 7B InstructClassification· MTEB Leaderboard data63%
7Text Embedding 3 LargeClassification· MTEB Leaderboard data62.6%
8BGE M3Classification· MTEB Leaderboard data61.6%
9NV-Embed-v2Classification· MTEB Leaderboard data58.4%
10snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data57.4%
11Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data56.6%
12snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data54.1%
13Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data53%
14UAE-Large-V1Classification· MTEB Leaderboard data52.5%
15E5 Base V2Classification· MTEB Leaderboard data52%
16nomic-embed-text-v1Classification· MTEB Leaderboard data51.7%
17E5 Large V2Classification· MTEB Leaderboard data51.5%
18BGE Large En V1.5Classification· MTEB Leaderboard data51.1%
19Gte LargeClassification· MTEB Leaderboard data51.1%
20Gte BaseClassification· MTEB Leaderboard data50.8%
21BGE Base En V1.5Classification· MTEB Leaderboard data50.8%
22nomic-embed-text-v1.5Classification· MTEB Leaderboard data50.8%
23bge-small-en-v1.5Classification· MTEB Leaderboard data50.2%
24All MiniLM L6 V2Classification· MTEB Leaderboard data47.8%
25Jina Embeddings v2 Base ENClassification· MTEB Leaderboard data35.3%