Skip to content

Benchmark

MTEB(kor, v2) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
29
Scores recorded
29
Sources
1
IQ weight
0.69

Score distribution

38.5%
Mean
33.3%
Median
18%
Std dev
21.3%
10th percentile
62.2%
90th percentile
20.6%
Min
20.6%69.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.69 for embedding models, measured over 29 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BClassification· MTEB Leaderboard data69.1%
2Qwen3 Embedding 4BClassification· MTEB Leaderboard data67.4%
3BGE multilingual gemma2Classification· MTEB Leaderboard data62.7%
4Multilingual E5 Large InstructClassification· MTEB Leaderboard data62.2%
5Multilingual E5 LargeClassification· MTEB Leaderboard data60.8%
6Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data60.6%
7E5 Mistral 7B InstructClassification· MTEB Leaderboard data60.1%
8snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data58.4%
9Jina Embeddings v3Classification· MTEB Leaderboard data58.3%
10Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data52%
11Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data49.1%
12snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data46.8%
13Jina Embeddings v5 Omni NanoClassification· MTEB Leaderboard data33.4%
14Jina Embeddings v5 Text SmallClassification· MTEB Leaderboard data33.3%
15Jina Embeddings v5 Omni SmallClassification· MTEB Leaderboard data33.3%
16UAE-Large-V1Classification· MTEB Leaderboard data23.4%
17All Mpnet Base V2Classification· MTEB Leaderboard data23.1%
18bge-small-en-v1.5Classification· MTEB Leaderboard data23.1%
19E5 Large V2Classification· MTEB Leaderboard data23.1%
20E5 Base V2Classification· MTEB Leaderboard data22.9%
21nomic-embed-text-v1Classification· MTEB Leaderboard data21.9%
22nomic-embed-text-v1.5Classification· MTEB Leaderboard data21.9%
23All MiniLM L12 V2Classification· MTEB Leaderboard data21.7%
24Gte BaseClassification· MTEB Leaderboard data21.6%
25Gte LargeClassification· MTEB Leaderboard data21.5%
26BGE Base En V1.5Classification· MTEB Leaderboard data21.3%
27All MiniLM L6 V2Classification· MTEB Leaderboard data20.9%
28Jina Embedding B EN v1Classification· MTEB Leaderboard data20.8%
29BGE Large En V1.5Classification· MTEB Leaderboard data20.6%