Skip to content

Benchmark

RAR-b

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
29
Scores recorded
29
Sources
1
IQ weight
0.90

Score distribution

20.9%
Mean
19%
Median
7.7%
Std dev
13.7%
10th percentile
30.6%
90th percentile
0.06%
Min
0.06%36.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.90 for embedding models, measured over 29 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1INF Retriever v1· MTEB Extra Text Boards data36.4%
2Qwen3 Embedding 8B· MTEB Extra Text Boards data33.1%
3NV-Embed-v2· MTEB Extra Text Boards data32.7%
4Qwen3 Embedding 4B· MTEB Extra Text Boards data30.6%
5Multilingual E5 Large Instruct· MTEB Extra Text Boards data28.8%
6E5 Mistral 7B Instruct· MTEB Extra Text Boards data28.6%
7Text Embedding 3 Large· MTEB Extra Text Boards data28.5%
8E5 Large V2· MTEB Extra Text Boards data27.3%
9Multilingual E5 Large· MTEB Extra Text Boards data25%
10E5 Base V2· MTEB Extra Text Boards data23.8%
11snowflake-arctic-embed-m-v2.0· MTEB Extra Text Boards data23.3%
12Text Embedding 3 Small· MTEB Extra Text Boards data23.2%
13snowflake-arctic-embed-l-v2.0· MTEB Extra Text Boards data22.1%
14UAE-Large-V1· MTEB Extra Text Boards data20.6%
15Jina Embeddings v3· MTEB Extra Text Boards data19%
16Granite Embedding 278m Multilingual· MTEB Extra Text Boards data18.9%
17All MiniLM L6 V2· MTEB Extra Text Boards data18.6%
18BGE Large En V1.5· MTEB Extra Text Boards data17.7%
19Jina Embedding B EN v1· MTEB Extra Text Boards data17.1%
20All Mpnet Base V2· MTEB Extra Text Boards data17%
21All MiniLM L12 V2· MTEB Extra Text Boards data16.5%
22nomic-embed-text-v1· MTEB Extra Text Boards data15.8%
23nomic-embed-text-v1.5· MTEB Extra Text Boards data15.4%
24Gte Large· MTEB Extra Text Boards data15%
25BGE Base En V1.5· MTEB Extra Text Boards data14.6%
26bge-small-en-v1.5· MTEB Extra Text Boards data13.7%
27Gte Base· MTEB Extra Text Boards data12.3%
28Paraphrase Multilingual MPNet v2· MTEB Extra Text Boards data11.5%
29Jina Embeddings v2 Base EN· MTEB Extra Text Boards data0.06%