Skip to content

Benchmark

MTEB(nld, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
24
Scores recorded
24
Sources
1
IQ weight
0.45

Score distribution

54.6%
Mean
55.1%
Median
8.7%
Std dev
44.8%
10th percentile
64.7%
90th percentile
39.1%
Min
39.1%73%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.45 for embedding models, measured over 24 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BClassification· MTEB Leaderboard data73%
2Qwen3 Embedding 4BClassification· MTEB Leaderboard data70.7%
3Multilingual E5 Large InstructClassification· MTEB Leaderboard data64.7%
4Jina Embeddings v3Classification· MTEB Leaderboard data62.6%
5E5 Mistral 7B InstructClassification· MTEB Leaderboard data62.5%
6Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data61.5%
7BGE M3Classification· MTEB Leaderboard data61.2%
8Multilingual E5 LargeClassification· MTEB Leaderboard data60.6%
9snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data59.8%
10Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data58.7%
11Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data55.4%
12snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data55.1%
13Jina Embeddings v5 Text NanoClassification· MTEB Leaderboard data53.4%
14UAE-Large-V1Classification· MTEB Leaderboard data50.9%
15E5 Large V2Classification· MTEB Leaderboard data50.4%
16E5 Base V2Classification· MTEB Leaderboard data49.2%
17BGE Large En V1.5Classification· MTEB Leaderboard data48.3%
18BGE Base En V1.5Classification· MTEB Leaderboard data46.7%
19bge-small-en-v1.5Classification· MTEB Leaderboard data46.6%
20All Mpnet Base V2Classification· MTEB Leaderboard data46%
21All MiniLM L12 V2Classification· MTEB Leaderboard data45.5%
22Jina Embedding B EN v1Classification· MTEB Leaderboard data44.8%
23All MiniLM L6 V2Classification· MTEB Leaderboard data44.3%
24Nemotron 3 Embed 1bClassification· MTEB Leaderboard data39.1%