Skip to content

Benchmark

MTEB(kor, v1) - STS

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
29
Scores recorded
29
Sources
1
IQ weight
0.64

Score distribution

60.5%
Mean
66.6%
Median
24.6%
Std dev
32.9%
10th percentile
87.2%
90th percentile
3.9%
Min
3.9%89.6%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.64 for embedding models, measured over 29 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 4BSTS· MTEB Leaderboard data89.6%
2Qwen3 Embedding 8BSTS· MTEB Leaderboard data89.6%
3Jina Embeddings v5 Text SmallSTS· MTEB Leaderboard data87.2%
4Jina Embeddings v5 Omni SmallSTS· MTEB Leaderboard data87.2%
5Jina Embeddings v5 Omni NanoSTS· MTEB Leaderboard data87%
6Multilingual E5 Large InstructSTS· MTEB Leaderboard data85.6%
7E5 Mistral 7B InstructSTS· MTEB Leaderboard data85%
8Jina Embeddings v3STS· MTEB Leaderboard data84.9%
9Qwen3 Embedding 0.6BSTS· MTEB Leaderboard data84.4%
10Multilingual E5 LargeSTS· MTEB Leaderboard data82%
11Paraphrase Multilingual MPNet v2STS· MTEB Leaderboard data81%
12BGE multilingual gemma2STS· MTEB Leaderboard data80.2%
13snowflake-arctic-embed-l-v2.0STS· MTEB Leaderboard data78.2%
14Granite Embedding 278m MultilingualSTS· MTEB Leaderboard data72.7%
15snowflake-arctic-embed-m-v2.0STS· MTEB Leaderboard data66.6%
16nomic-embed-text-v1.5STS· MTEB Leaderboard data48.6%
17nomic-embed-text-v1STS· MTEB Leaderboard data47.1%
18BGE Base En V1.5STS· MTEB Leaderboard data44.4%
19E5 Large V2STS· MTEB Leaderboard data42.2%
20Gte BaseSTS· MTEB Leaderboard data39.9%
21bge-small-en-v1.5STS· MTEB Leaderboard data39.6%
22UAE-Large-V1STS· MTEB Leaderboard data39.4%
23E5 Base V2STS· MTEB Leaderboard data37.9%
24Gte LargeSTS· MTEB Leaderboard data36.8%
25All MiniLM L12 V2STS· MTEB Leaderboard data36.2%
26BGE Large En V1.5STS· MTEB Leaderboard data32.9%
27All MiniLM L6 V2STS· MTEB Leaderboard data32.3%
28All Mpnet Base V2STS· MTEB Leaderboard data31%
29Jina Embedding B EN v1STS· MTEB Leaderboard data3.9%