Skip to content

Benchmark

LMEB

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
35
Scores recorded
35
Sources
1
IQ weight
0.60

Score distribution

52.6%
Mean
53.3%
Median
4.9%
Std dev
45.1%
10th percentile
57.9%
90th percentile
41.2%
Min
41.2%61.5%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.60 for embedding models, measured over 35 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Nemotron 3 Embed 1b· MTEB Extra Text Boards data61.5%
2BGE multilingual gemma2· MTEB Extra Text Boards data61.3%
3NV-Embed-v2· MTEB Extra Text Boards data60%
4Embed v1 0.6b· MTEB Extra Text Boards data57.9%
5snowflake-arctic-embed-m-v2.0· MTEB Extra Text Boards data57%
6snowflake-arctic-embed-l-v2.0· MTEB Extra Text Boards data56.9%
7E5 Large V2· MTEB Extra Text Boards data56%
8Qwen3 Embedding 8B· MTEB Extra Text Boards data55.9%
9Multilingual E5 Large· MTEB Extra Text Boards data55.5%
10E5 Mistral 7B Instruct· MTEB Extra Text Boards data55.2%
11nomic-embed-text-v1· MTEB Extra Text Boards data55.1%
12Multilingual E5 Large Instruct· MTEB Extra Text Boards data55%
13Jina Embeddings v5 Text Nano· MTEB Extra Text Boards data54.7%
14bge-large-en· MTEB Extra Text Boards data54.6%
15Qwen3 Embedding 0.6B· MTEB Extra Text Boards data54.6%
16E5 Base V2· MTEB Extra Text Boards data54.4%
17Jina Embeddings v5 Text Small· MTEB Extra Text Boards data54.2%
18Qwen3 Embedding 4B· MTEB Extra Text Boards data53.3%
19BGE Base En V1.5· MTEB Extra Text Boards data52.6%
20Granite Embedding 278m Multilingual· MTEB Extra Text Boards data52.3%
21nomic-embed-text-v1.5· MTEB Extra Text Boards data52%
22Gte Large· MTEB Extra Text Boards data51.4%
23Gte Base· MTEB Extra Text Boards data51.1%
24bge-small-en-v1.5· MTEB Extra Text Boards data51%
25BGE M3· MTEB Extra Text Boards data50.9%
26UAE-Large-V1· MTEB Extra Text Boards data50.6%
27Jina Embeddings v3· MTEB Extra Text Boards data50.5%
28Granite Embedding Small English R2· MTEB Extra Text Boards data49.8%
29Jina Embeddings v2 Base EN· MTEB Extra Text Boards data48.8%
30BGE En Icl· MTEB Extra Text Boards data47.7%
31All MiniLM L12 V2· MTEB Extra Text Boards data45.8%
32All Mpnet Base V2· MTEB Extra Text Boards data45.1%
33All MiniLM L6 V2· MTEB Extra Text Boards data43.8%
34BGE Large En V1.5· MTEB Extra Text Boards data42.1%
35Paraphrase Multilingual MPNet v2· MTEB Extra Text Boards data41.2%