Skip to content

Benchmark

MTEB(fra, v1) - PairClassification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
34
Scores recorded
34
Sources
1
IQ weight
1.00

Score distribution

60.4%
Mean
58.6%
Median
5.9%
Std dev
55%
10th percentile
67.5%
90th percentile
50%
Min
50%79.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.00 for embedding models, measured over 34 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BPairClassification· MTEB Leaderboard data79.2%
2Qwen3 Embedding 4BPairClassification· MTEB Leaderboard data72.6%
3Jina Embeddings v5 Omni SmallPairClassification· MTEB Leaderboard data70.5%
4Qwen3 Embedding 0.6BPairClassification· MTEB Leaderboard data67.5%
5Jina Embeddings v5 Omni NanoPairClassification· MTEB Leaderboard data66.7%
6Jina Embeddings v5 Text NanoPairClassification· MTEB Leaderboard data66.7%
7Text Embedding 3 LargePairClassification· MTEB Leaderboard data65%
8Gemini Embedding 001PairClassification· MTEB Leaderboard data65%
9E5 Mistral 7B InstructPairClassification· MTEB Leaderboard data62.5%
10Text Multilingual Embedding 002PairClassification· MTEB Leaderboard data62.3%
11Text Embedding 3 SmallPairClassification· MTEB Leaderboard data61.5%
12snowflake-arctic-embed-l-v2.0PairClassification· MTEB Leaderboard data61.1%
13BGE multilingual gemma2PairClassification· MTEB Leaderboard data60.8%
14NV-Embed-v2PairClassification· MTEB Leaderboard data59.6%
15Multilingual E5 Large InstructPairClassification· MTEB Leaderboard data59.4%
16BGE M3PairClassification· MTEB Leaderboard data59.2%
17Granite Embedding 278m MultilingualPairClassification· MTEB Leaderboard data58.6%
18Jina Embeddings v3PairClassification· MTEB Leaderboard data58.6%
19Jina Embedding B EN v1PairClassification· MTEB Leaderboard data58.5%
20snowflake-arctic-embed-m-v2.0PairClassification· MTEB Leaderboard data58.5%
21Paraphrase Multilingual MPNet v2PairClassification· MTEB Leaderboard data58%
22embeddinggemma-2PairClassification· MTEB Leaderboard data57.9%
23Gte LargePairClassification· MTEB Leaderboard data57.5%
24UAE-Large-V1PairClassification· MTEB Leaderboard data57.2%
25nomic-embed-text-v1.5PairClassification· MTEB Leaderboard data57%
26Gte BasePairClassification· MTEB Leaderboard data56.5%
27E5 Large V2PairClassification· MTEB Leaderboard data56%
28BGE Base En V1.5PairClassification· MTEB Leaderboard data55.6%
29All MiniLM L6 V2PairClassification· MTEB Leaderboard data55.6%
30nomic-embed-text-v1PairClassification· MTEB Leaderboard data55.2%
31BGE Large En V1.5PairClassification· MTEB Leaderboard data55%
32bge-small-en-v1.5PairClassification· MTEB Leaderboard data54.3%
33E5 Base V2PairClassification· MTEB Leaderboard data54.3%
34Jina Embeddings v2 Base ENPairClassification· MTEB Leaderboard data50%