Skip to content

Benchmark

MTEB(Indic, v1) - STS

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
38
Scores recorded
38
Sources
1
IQ weight
0.49

Score distribution

25.4%
Mean
30.8%
Median
22.6%
Std dev
-1.3%
10th percentile
53.7%
90th percentile
-6.3%
Min
-6.3%62.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.49 for embedding models, measured over 38 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemini Embedding 001STS· MTEB Leaderboard data62.9%
2Qwen3 Embedding 8BSTS· MTEB Leaderboard data61.6%
3Qwen3 Embedding 4BSTS· MTEB Leaderboard data60.8%
4Jina Embeddings v3STS· MTEB Leaderboard data54.7%
5Multilingual E5 Large InstructSTS· MTEB Leaderboard data53.7%
6Text Multilingual Embedding 002STS· MTEB Leaderboard data53.6%
7BGE M3STS· MTEB Leaderboard data52.1%
8Jina Embeddings v5 Omni SmallSTS· MTEB Leaderboard data47.8%
9Jina Embeddings v5 Text SmallSTS· MTEB Leaderboard data47.8%
10snowflake-arctic-embed-l-v2.0STS· MTEB Leaderboard data47.2%
11Multilingual E5 LargeSTS· MTEB Leaderboard data43.9%
12Jina Embeddings v5 Omni NanoSTS· MTEB Leaderboard data41.4%
13Jina Embeddings v5 Text NanoSTS· MTEB Leaderboard data41.4%
14Qwen3 Embedding 0.6BSTS· MTEB Leaderboard data39%
15embeddinggemma-2STS· MTEB Leaderboard data36.8%
16Jina Embeddings v4STS· MTEB Leaderboard data35.2%
17Granite Embedding 278m MultilingualSTS· MTEB Leaderboard data34.5%
18Paraphrase Multilingual MPNet v2STS· MTEB Leaderboard data34.1%
19snowflake-arctic-embed-m-v2.0STS· MTEB Leaderboard data30.8%
20E5 Mistral 7B InstructSTS· MTEB Leaderboard data23%
21NV-Embed-v2STS· MTEB Leaderboard data13.4%
22Text Embedding 3 LargeSTS· MTEB Leaderboard data12.6%
23nomic-embed-text-v1STS· MTEB Leaderboard data10.8%
24nomic-embed-text-v1.5STS· MTEB Leaderboard data7.7%
25BGE Base En V1.5STS· MTEB Leaderboard data7.4%
26Gte BaseSTS· MTEB Leaderboard data5.7%
27Text Embedding 3 SmallSTS· MTEB Leaderboard data4.1%
28BGE Large En V1.5STS· MTEB Leaderboard data3.9%
29bge-small-en-v1.5STS· MTEB Leaderboard data3.2%
30E5 Large V2STS· MTEB Leaderboard data3.1%
31Jina Embedding B EN v1STS· MTEB Leaderboard data3%
32UAE-Large-V1STS· MTEB Leaderboard data2.3%
33Gte LargeSTS· MTEB Leaderboard data1.5%
34E5 Base V2STS· MTEB Leaderboard data-1.3%
35Jina Embeddings v2 Base ENSTS· MTEB Leaderboard data-2.1%
36All Mpnet Base V2STS· MTEB Leaderboard data-2.5%
37All MiniLM L12 V2STS· MTEB Leaderboard data-5.3%
38All MiniLM L6 V2STS· MTEB Leaderboard data-6.3%