Skip to content

Benchmark

MTEB(Indic, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
37
Scores recorded
37
Sources
1
IQ weight
0.59

Score distribution

65.9%
Mean
62.7%
Median
12.1%
Std dev
52.6%
10th percentile
79.8%
90th percentile
50.4%
Min
50.4%86.6%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.59 for embedding models, measured over 37 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data86.6%
2Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data85.6%
3Gemini Embedding 001PairClassification· MTEB Leaderboard data82.7%
4Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data82%
5Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data79.8%
6Jina Embeddings v5 Text SmallPairClassification· MTEB Leaderboard data79.8%
7Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data78.8%
8Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data78.8%
9BGE M3PairClassification· MTEB Leaderboard data77.5%
10Text Multilingual Embedding 002PairClassification· MTEB Leaderboard data77.4%
11Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data77.2%
12Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data76.3%
13embeddinggemma-2PairClassification· MTEB Leaderboard data75.1%
14Multilingual E5 LargePairClassification· MTEB Leaderboard data75.1%
15Jina Embeddings v3PairClassification· MTEB Leaderboard data74.5%
16E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data73%
17Text Embedding 3 LargePairClassification· MTEB Leaderboard data68.6%
18NV-Embed-v2PairClassification· MTEB Leaderboard data63.9%
19snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data62.7%
20Text Embedding 3 SmallPairClassification· MTEB Leaderboard data62.5%
21Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data61.6%
22snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data61.2%
23E5 Large V2PairClassification· MTEB Leaderboard data57.2%
24All MiniLM L12 V2PairClassification· MTEB Leaderboard data55%
25E5 Base V2PairClassification· MTEB Leaderboard data54.6%
26BGE Base En V1.5PairClassification· MTEB Leaderboard data54.1%
27nomic-embed-text-v1PairClassification· MTEB Leaderboard data53.9%
28All MiniLM L6 V2PairClassification· MTEB Leaderboard data53.7%
29UAE-Large-V1PairClassification· MTEB Leaderboard data53.6%
30nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data53.5%
31Gte BasePairClassification· MTEB Leaderboard data52.9%
32BGE Large En V1.5PairClassification· MTEB Leaderboard data52.8%
33All Mpnet Base V2PairClassification· MTEB Leaderboard data52.6%
34Jina Embedding B EN v1PairClassification· MTEB Leaderboard data52.6%
35Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data50.9%
36bge-small-en-v1.5PairClassification· MTEB Leaderboard data50.9%
37Gte LargePairClassification· MTEB Leaderboard data50.4%