Skip to content

Benchmark

MTEB(eng, v1) - STS

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
32
Scores recorded
32
Sources
1
IQ weight
0.56

Score distribution

82.4%
Mean
82.1%
Median
3.1%
Std dev
78.6%
10th percentile
85.8%
90th percentile
76.7%
Min
76.7%89.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.56 for embedding models, measured over 32 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 4BSTS· MTEB Leaderboard data89.2%
2Qwen3 Embedding 8BSTS· MTEB Leaderboard data89.1%
3Qwen3 Embedding 0.6BSTS· MTEB Leaderboard data86.9%
4Jina Embeddings v3STS· MTEB Leaderboard data85.8%
5Text Embedding 005STS· MTEB Leaderboard data85.3%
6Multilingual E5 Large InstructSTS· MTEB Leaderboard data85%
7Text Embedding 004STS· MTEB Leaderboard data85%
8E5 Mistral 7B InstructSTS· MTEB Leaderboard data84.7%
9UAE-Large-V1STS· MTEB Leaderboard data84.6%
10BGE En IclSTS· MTEB Leaderboard data84.3%
11BGE multilingual gemma2STS· MTEB Leaderboard data83.7%
12Gte LargeSTS· MTEB Leaderboard data83.4%
13BGE Large En V1.5STS· MTEB Leaderboard data83.2%
14BGE Base En V1.5STS· MTEB Leaderboard data82.5%
15Gte BaseSTS· MTEB Leaderboard data82.3%
16nomic-embed-text-v1STS· MTEB Leaderboard data82.1%
17Text Embedding 3 LargeSTS· MTEB Leaderboard data81.8%
18bge-small-en-v1.5STS· MTEB Leaderboard data81.6%
19Text Embedding 3 SmallSTS· MTEB Leaderboard data81.6%
20bge-large-enSTS· MTEB Leaderboard data81.6%
21E5 Large V2STS· MTEB Leaderboard data81.2%
22E5 Base V2STS· MTEB Leaderboard data81%
23Text Embedding Ada 002STS· MTEB Leaderboard data81%
24Paraphrase Multilingual MPNet v2STS· MTEB Leaderboard data80.8%
25Jina Embeddings v2 Base ENSTS· MTEB Leaderboard data80.7%
26Jina Embedding B EN v1STS· MTEB Leaderboard data80.1%
27nomic-embed-text-v1.5STS· MTEB Leaderboard data79.3%
28All MiniLM L6 V2STS· MTEB Leaderboard data79%
29snowflake-arctic-embed-l-v2.0STS· MTEB Leaderboard data78.6%
30snowflake-arctic-embed-m-v2.0STS· MTEB Leaderboard data77.1%
31Granite Embedding 278m MultilingualSTS· MTEB Leaderboard data77.1%
32Granite Embedding Small English R2STS· MTEB Leaderboard data76.7%