Skip to content

Benchmark

JMTEB(v2) - STS

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
29
Scores recorded
29
Sources
1
IQ weight
0.90

Score distribution

72.8%
Mean
77%
Median
12.3%
Std dev
62.2%
10th percentile
83.6%
90th percentile
27.7%
Min
27.7%87.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.90 for embedding models, measured over 29 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BSTS· MTEB Extra Text Boards data87.8%
2Qwen3 Embedding 4BSTS· MTEB Extra Text Boards data87.3%
3Qwen3 Embedding 0.6BSTS· MTEB Extra Text Boards data83.9%
4E5 Mistral 7B InstructSTS· MTEB Extra Text Boards data83.6%
5Multilingual E5 Large InstructSTS· MTEB Extra Text Boards data82.9%
6Text Embedding 3 LargeSTS· MTEB Extra Text Boards data82.5%
7Jina Embeddings v5 Omni SmallSTS· MTEB Extra Text Boards data82.5%
8Jina Embeddings v5 Text SmallSTS· MTEB Extra Text Boards data82.5%
9Jina Embeddings v5 Omni NanoSTS· MTEB Extra Text Boards data82.2%
10NV-Embed-v2STS· MTEB Extra Text Boards data81.3%
11Jina Embeddings v3STS· MTEB Extra Text Boards data80%
12BGE M3STS· MTEB Extra Text Boards data79.7%
13snowflake-arctic-embed-l-v2.0STS· MTEB Extra Text Boards data79.7%
14Text Embedding 3 SmallSTS· MTEB Extra Text Boards data79.5%
15Granite Embedding 278m MultilingualSTS· MTEB Extra Text Boards data77%
16snowflake-arctic-embed-m-v2.0STS· MTEB Extra Text Boards data76.7%
17Paraphrase Multilingual MPNet v2STS· MTEB Extra Text Boards data72.1%
18E5 Large V2STS· MTEB Extra Text Boards data67.7%
19All MiniLM L6 V2STS· MTEB Extra Text Boards data67%
20E5 Base V2STS· MTEB Extra Text Boards data65.9%
21nomic-embed-text-v1STS· MTEB Extra Text Boards data65.5%
22nomic-embed-text-v1.5STS· MTEB Extra Text Boards data65%
23Gte LargeSTS· MTEB Extra Text Boards data62.7%
24bge-small-en-v1.5STS· MTEB Extra Text Boards data62.6%
25Gte BaseSTS· MTEB Extra Text Boards data62.4%
26BGE Large En V1.5STS· MTEB Extra Text Boards data62.2%
27BGE Base En V1.5STS· MTEB Extra Text Boards data61.6%
28UAE-Large-V1STS· MTEB Extra Text Boards data61.4%
29Jina Embeddings v2 Base ENSTS· MTEB Extra Text Boards data27.7%