Skip to content

Benchmark

MTEB(pol, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
27
Scores recorded
27
Sources
1
IQ weight
1.05

Score distribution

52.7%
Mean
47.1%
Median
13.4%
Std dev
40.5%
10th percentile
69.7%
90th percentile
27.3%
Min
27.3%76.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.05 for embedding models, measured over 27 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Jina Embeddings v5 Omni NanoClassification· MTEB Leaderboard data76.1%
2Qwen3 Embedding 8BClassification· MTEB Leaderboard data75.6%
3Qwen3 Embedding 4BClassification· MTEB Leaderboard data74.1%
4Jina Embeddings v3Classification· MTEB Leaderboard data69.7%
5E5 Mistral 7B InstructClassification· MTEB Leaderboard data69.5%
6Multilingual E5 Large InstructClassification· MTEB Leaderboard data67%
7Text Embedding 3 LargeClassification· MTEB Leaderboard data66.2%
8Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data64.3%
9Multilingual E5 LargeClassification· MTEB Leaderboard data61%
10snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data57.6%
11Text Embedding 3 SmallClassification· MTEB Leaderboard data57.6%
12snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data54.3%
13Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data54.1%
14Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data47.1%
15E5 Large V2Classification· MTEB Leaderboard data44%
16UAE-Large-V1Classification· MTEB Leaderboard data43.9%
17E5 Base V2Classification· MTEB Leaderboard data42.8%
18BGE Base En V1.5Classification· MTEB Leaderboard data42.4%
19nomic-embed-text-v1Classification· MTEB Leaderboard data42.1%
20Gte BaseClassification· MTEB Leaderboard data42%
21nomic-embed-text-v1.5Classification· MTEB Leaderboard data41.7%
22BGE Large En V1.5Classification· MTEB Leaderboard data41.3%
23bge-small-en-v1.5Classification· MTEB Leaderboard data40.9%
24Gte LargeClassification· MTEB Leaderboard data40.5%
25All MiniLM L6 V2Classification· MTEB Leaderboard data39.9%
26All Mpnet Base V2Classification· MTEB Leaderboard data39.7%
27Jina Embeddings v2 Base ENClassification· MTEB Leaderboard data27.3%