Skip to content

Benchmark

BEIR

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
37
Scores recorded
37
Sources
1
IQ weight
1.08

Score distribution

52.6%
Mean
52.9%
Median
6.1%
Std dev
44%
10th percentile
61.6%
90th percentile
35.3%
Min
35.3%63.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.08 for embedding models, measured over 37 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1NV-Embed-v2· MTEB Extra Text Boards data63.2%
2Qwen3 Embedding 8B· MTEB Extra Text Boards data62.8%
3BGE En Icl· MTEB Extra Text Boards data62.2%
4INF Retriever v1· MTEB Extra Text Boards data61.7%
5Qwen3 Embedding 4B· MTEB Extra Text Boards data61.6%
6BGE multilingual gemma2· MTEB Extra Text Boards data59.2%
7E5 Mistral 7B Instruct· MTEB Extra Text Boards data57.1%
8Text Embedding 005· MTEB Extra Text Boards data55.8%
9Qwen3 Embedding 0.6B· MTEB Extra Text Boards data55.5%
10snowflake-arctic-embed-m-v2.0· MTEB Extra Text Boards data55.5%
11Text Embedding 004· MTEB Extra Text Boards data55.5%
12Text Embedding 3 Large· MTEB Extra Text Boards data55.4%
13snowflake-arctic-embed-l-v2.0· MTEB Extra Text Boards data55.2%
14UAE-Large-V1· MTEB Extra Text Boards data54.6%
15BGE Large En V1.5· MTEB Extra Text Boards data54.3%
16bge-large-en· MTEB Extra Text Boards data53.9%
17BGE Base En V1.5· MTEB Extra Text Boards data53.2%
18Jina Embeddings v3· MTEB Extra Text Boards data53.2%
19nomic-embed-text-v1· MTEB Extra Text Boards data52.9%
20Multilingual E5 Large Instruct· MTEB Extra Text Boards data52.7%
21Gte Large· MTEB Extra Text Boards data52.2%
22nomic-embed-text-v1.5· MTEB Extra Text Boards data51.8%
23bge-small-en-v1.5· MTEB Extra Text Boards data51.7%
24Multilingual E5 Large· MTEB Extra Text Boards data51.5%
25Gte Base· MTEB Extra Text Boards data51.1%
26Text Embedding 3 Small· MTEB Extra Text Boards data51.1%
27Granite Embedding Small English R2· MTEB Extra Text Boards data50.9%
28E5 Large V2· MTEB Extra Text Boards data50.6%
29E5 Base V2· MTEB Extra Text Boards data50.3%
30Text Embedding Ada 002· MTEB Extra Text Boards data49.3%
31Granite Embedding 278m Multilingual· MTEB Extra Text Boards data48.2%
32Jina Embeddings v2 Base EN· MTEB Extra Text Boards data45.3%
33Jina Embedding B EN v1· MTEB Extra Text Boards data44%
34All Mpnet Base V2· MTEB Extra Text Boards data43.8%
35All MiniLM L12 V2· MTEB Extra Text Boards data42.7%
36All MiniLM L6 V2· MTEB Extra Text Boards data42%
37Paraphrase Multilingual MPNet v2· MTEB Extra Text Boards data35.3%