Skip to content

Benchmark

MTEB(Multilingual, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
0.69

Score distribution

57.1%
Mean
57.3%
Median
9.7%
Std dev
47.4%
10th percentile
71.3%
90th percentile
34.2%
Min
34.2%74%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.69 for embedding models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BClassification· MTEB Leaderboard data74%
2Qwen3 Embedding 4BClassification· MTEB Leaderboard data72.3%
3Gemini Embedding 001Classification· MTEB Leaderboard data71.8%
4Jina Embeddings v5 Omni SmallClassification· MTEB Leaderboard data71.3%
5Jina Embeddings v5 Omni NanoClassification· MTEB Leaderboard data69.2%
6Jina Embeddings v5 Text NanoClassification· MTEB Leaderboard data69.2%
7Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data66.8%
8Multilingual E5 Large InstructClassification· MTEB Leaderboard data64.9%
9Text Multilingual Embedding 002Classification· MTEB Leaderboard data64.6%
10embeddinggemma-2Classification· MTEB Leaderboard data62.3%
11BGE M3Classification· MTEB Leaderboard data60.4%
12E5 Mistral 7B InstructClassification· MTEB Leaderboard data60.3%
13Text Embedding 3 LargeClassification· MTEB Leaderboard data60.3%
14Jina Embeddings v3Classification· MTEB Leaderboard data58.8%
15snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data57.4%
16NV-Embed-v2Classification· MTEB Leaderboard data57.3%
17Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data55.1%
18snowflake-arctic-embed-m-v2.0Classification· MTEB Leaderboard data54.4%
19Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data54.1%
20E5 Large V2Classification· MTEB Leaderboard data49.8%
21UAE-Large-V1Classification· MTEB Leaderboard data49.7%
22E5 Base V2Classification· MTEB Leaderboard data49.5%
23nomic-embed-text-v1Classification· MTEB Leaderboard data49.4%
24nomic-embed-text-v1.5Classification· MTEB Leaderboard data48.5%
25BGE Large En V1.5Classification· MTEB Leaderboard data48%
26BGE Base En V1.5Classification· MTEB Leaderboard data48%
27Gte LargeClassification· MTEB Leaderboard data47.6%
28bge-small-en-v1.5Classification· MTEB Leaderboard data47.4%
29Gte BaseClassification· MTEB Leaderboard data47.2%
30All MiniLM L6 V2Classification· MTEB Leaderboard data46.2%
31Jina Embeddings v2 Base ENClassification· MTEB Leaderboard data34.2%