Skip to content

Benchmark

MTEB(Africa, v1) - Reranking

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
22
Scores recorded
22
Sources
1
IQ weight
0.93

Score distribution

49.7%
Mean
49.5%
Median
8.1%
Std dev
39.9%
10th percentile
62.8%
90th percentile
37.1%
Min
37.1%63.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.93 for embedding models, measured over 22 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1E5 Mistral 7B InstructReranking· MTEB Multimodal Boards data docs63.5%
2snowflake-arctic-embed-l-v2.0Reranking· MTEB Multimodal Boards data docs63.4%
3Multilingual E5 LargeReranking· MTEB Multimodal Boards data docs62.8%
4snowflake-arctic-embed-m-v2.0Reranking· MTEB Multimodal Boards data docs59.6%
5Granite Embedding 278m MultilingualReranking· MTEB Multimodal Boards data docs59.2%
6Multilingual E5 Large InstructReranking· MTEB Multimodal Boards data docs58.7%
7BGE Base En V1.5Reranking· MTEB Multimodal Boards data docs51.3%
8UAE-Large-V1Reranking· MTEB Multimodal Boards data docs50.6%
9BGE Large En V1.5Reranking· MTEB Multimodal Boards data docs50.3%
10bge-small-en-v1.5Reranking· MTEB Multimodal Boards data docs49.8%
11Gte LargeReranking· MTEB Multimodal Boards data docs49.5%
12E5 Base V2Reranking· MTEB Multimodal Boards data docs48.6%
13Gte BaseReranking· MTEB Multimodal Boards data docs48.4%
14E5 Large V2Reranking· MTEB Multimodal Boards data docs46.5%
15nomic-embed-text-v1Reranking· MTEB Multimodal Boards data docs44.7%
16Jina Embeddings v3Reranking· MTEB Multimodal Boards data docs43.9%
17Jina Embedding B EN v1Reranking· MTEB Multimodal Boards data docs43.3%
18nomic-embed-text-v1.5Reranking· MTEB Multimodal Boards data docs42%
19All MiniLM L12 V2Reranking· MTEB Multimodal Boards data docs40.3%
20Paraphrase Multilingual MPNet v2Reranking· MTEB Multimodal Boards data docs39.9%
21All MiniLM L6 V2Reranking· MTEB Multimodal Boards data docs39.7%
22All Mpnet Base V2Reranking· MTEB Multimodal Boards data docs37.1%