Skip to content

Benchmark

MTEB(Africa, v1) - STS

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
37
Scores recorded
37
Sources
1
IQ weight
0.67

Score distribution

50.8%
Mean
54.9%
Median
12.7%
Std dev
37.2%
10th percentile
63.9%
90th percentile
13.9%
Min
13.9%71.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.67 for embedding models, measured over 37 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemini Embedding 001STS· MTEB Multimodal Boards data docs71.8%
2Text Multilingual Embedding 002STS· MTEB Multimodal Boards data docs67.6%
3Multilingual E5 Large InstructSTS· MTEB Multimodal Boards data docs66.9%
4Multilingual E5 LargeSTS· MTEB Multimodal Boards data docs64.5%
5E5 Mistral 7B InstructSTS· MTEB Multimodal Boards data docs63.9%
6snowflake-arctic-embed-l-v2.0STS· MTEB Multimodal Boards data docs63.3%
7Text Embedding 3 LargeSTS· MTEB Multimodal Boards data docs62.2%
8embeddinggemma-2STS· MTEB Multimodal Boards data docs61.3%
9BGE M3STS· MTEB Multimodal Boards data docs61.2%
10Qwen3 Embedding 8BSTS· MTEB Multimodal Boards data docs60.3%
11Jina Embeddings v3STS· MTEB Multimodal Boards data docs60.2%
12Qwen3 Embedding 4BSTS· MTEB Multimodal Boards data docs58.4%
13Text Embedding 3 SmallSTS· MTEB Multimodal Boards data docs58.3%
14Jina Embeddings v5 Omni NanoSTS· MTEB Multimodal Boards data docs57.8%
15Jina Embeddings v5 Text NanoSTS· MTEB Multimodal Boards data docs57.8%
16Granite Embedding 278m MultilingualSTS· MTEB Multimodal Boards data docs57.8%
17Jina Embeddings v5 Omni SmallSTS· MTEB Multimodal Boards data docs56%
18Jina Embeddings v5 Text SmallSTS· MTEB Multimodal Boards data docs56%
19NV-Embed-v2STS· MTEB Multimodal Boards data docs54.9%
20Qwen3 Embedding 0.6BSTS· MTEB Multimodal Boards data docs54.4%
21snowflake-arctic-embed-m-v2.0STS· MTEB Multimodal Boards data docs53.8%
22Paraphrase Multilingual MPNet v2STS· MTEB Multimodal Boards data docs52.1%
23E5 Large V2STS· MTEB Multimodal Boards data docs44.5%
24nomic-embed-text-v1STS· MTEB Multimodal Boards data docs43.4%
25E5 Base V2STS· MTEB Multimodal Boards data docs43.2%
26nomic-embed-text-v1.5STS· MTEB Multimodal Boards data docs42.9%
27BGE Base En V1.5STS· MTEB Multimodal Boards data docs41.8%
28All MiniLM L6 V2STS· MTEB Multimodal Boards data docs40.8%
29Gte BaseSTS· MTEB Multimodal Boards data docs40.3%
30Gte LargeSTS· MTEB Multimodal Boards data docs39.6%
31All Mpnet Base V2STS· MTEB Multimodal Boards data docs37.7%
32All MiniLM L12 V2STS· MTEB Multimodal Boards data docs37.3%
33bge-small-en-v1.5STS· MTEB Multimodal Boards data docs37.2%
34UAE-Large-V1STS· MTEB Multimodal Boards data docs36.8%
35BGE Large En V1.5STS· MTEB Multimodal Boards data docs34.4%
36Jina Embedding B EN v1STS· MTEB Multimodal Boards data docs26.6%
37Jina Embeddings v2 Base ENSTS· MTEB Multimodal Boards data docs13.9%