Skip to content

Benchmark

MTEB(eng, v2) - STS

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
40
Scores recorded
40
Sources
1
IQ weight
0.66

Score distribution

82.7%
Mean
82.8%
Median
3.7%
Std dev
78.1%
10th percentile
88.1%
90th percentile
74.2%
Min
74.2%88.7%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.66 for embedding models, measured over 40 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 4BSTS· MTEB Leaderboard data88.7%
2Qwen3 Embedding 8BSTS· MTEB Leaderboard data88.6%
3Jina Embeddings v5 Omni NanoSTS· MTEB Leaderboard data88.3%
4Jina Embeddings v5 Text NanoSTS· MTEB Leaderboard data88.3%
5Jina Embeddings v5 Omni SmallSTS· MTEB Leaderboard data88.1%
6Jina Embeddings v5 Text SmallSTS· MTEB Leaderboard data88.1%
7Qwen3 Embedding 0.6BSTS· MTEB Leaderboard data86.6%
8Jina Embeddings v4STS· MTEB Leaderboard data85.9%
9Jina Embeddings v3STS· MTEB Leaderboard data85.8%
10Gemini Embedding 001STS· MTEB Leaderboard data85.3%
11Text Embedding 005STS· MTEB Leaderboard data85.2%
12Text Embedding 004STS· MTEB Leaderboard data84.8%
13Multilingual E5 Large InstructSTS· MTEB Leaderboard data84.7%
14UAE-Large-V1STS· MTEB Leaderboard data84.4%
15E5 Mistral 7B InstructSTS· MTEB Leaderboard data84.3%
16Text Multilingual Embedding 002STS· MTEB Leaderboard data83.9%
17NV-Embed-v2STS· MTEB Leaderboard data83.8%
18Gte LargeSTS· MTEB Leaderboard data83.3%
19BGE Large En V1.5STS· MTEB Leaderboard data82.8%
20embeddinggemma-2STS· MTEB Leaderboard data82.8%
21Gte BaseSTS· MTEB Leaderboard data82.2%
22BGE Base En V1.5STS· MTEB Leaderboard data82.1%
23nomic-embed-text-v1STS· MTEB Leaderboard data81.8%
24Text Embedding 3 LargeSTS· MTEB Leaderboard data81.5%
25Multilingual E5 LargeSTS· MTEB Leaderboard data81.4%
26Text Embedding 3 SmallSTS· MTEB Leaderboard data81.3%
27bge-small-en-v1.5STS· MTEB Leaderboard data81.3%
28E5 Large V2STS· MTEB Leaderboard data80.7%
29E5 Base V2STS· MTEB Leaderboard data80.6%
30Paraphrase Multilingual MPNet v2STS· MTEB Leaderboard data80.5%
31All Mpnet Base V2STS· MTEB Leaderboard data80.4%
32Jina Embedding B EN v1STS· MTEB Leaderboard data80%
33All MiniLM L12 V2STS· MTEB Leaderboard data79.8%
34All MiniLM L6 V2STS· MTEB Leaderboard data79%
35nomic-embed-text-v1.5STS· MTEB Leaderboard data78.7%
36snowflake-arctic-embed-l-v2.0STS· MTEB Leaderboard data78.1%
37snowflake-arctic-embed-m-v2.0STS· MTEB Leaderboard data76.6%
38Granite Embedding Small English R2STS· MTEB Leaderboard data76.6%
39Granite Embedding 278m MultilingualSTS· MTEB Leaderboard data76.6%
40Jina Embeddings v2 Base ENSTS· MTEB Leaderboard data74.2%