Skip to content

Benchmark

LongEmbed

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
35
Scores recorded
35
Sources
1
IQ weight
0.73

Score distribution

46.5%
Mean
41.8%
Median
17.6%
Std dev
25.4%
10th percentile
69.9%
90th percentile
1.8%
Min
1.8%78.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.73 for embedding models, measured over 35 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 4B· MTEB Extra Text Boards data78.9%
2Qwen3 Embedding 8B· MTEB Extra Text Boards data78.3%
3INF Retriever v1· MTEB Extra Text Boards data73.2%
4Jina Embeddings v4· MTEB Extra Text Boards data69.9%
5Jina Embeddings v5 Omni Small· MTEB Extra Text Boards data66.4%
6Jina Embeddings v5 Text Small· MTEB Extra Text Boards data66.4%
7Granite Embedding Small English R2· MTEB Extra Text Boards data63.7%
8snowflake-arctic-embed-l-v2.0· MTEB Extra Text Boards data63.7%
9Jina Embeddings v5 Omni Nano· MTEB Extra Text Boards data63.7%
10Jina Embeddings v5 Text Nano· MTEB Extra Text Boards data63.7%
11BGE M3· MTEB Extra Text Boards data59.5%
12snowflake-arctic-embed-m-v2.0· MTEB Extra Text Boards data55.4%
13Text Embedding 3 Small· MTEB Extra Text Boards data53.6%
14Text Embedding 3 Large· MTEB Extra Text Boards data52.4%
15nomic-embed-text-v1· MTEB Extra Text Boards data47.7%
16E5 Mistral 7B Instruct· MTEB Extra Text Boards data43.7%
17E5 Large V2· MTEB Extra Text Boards data42.9%
18Multilingual E5 Large Instruct· MTEB Extra Text Boards data41.8%
19E5 Base V2· MTEB Extra Text Boards data41.1%
20Multilingual E5 Large· MTEB Extra Text Boards data40.4%
21UAE-Large-V1· MTEB Extra Text Boards data40.1%
22BGE Large En V1.5· MTEB Extra Text Boards data40.1%
23Gte Large· MTEB Extra Text Boards data38.7%
24Granite Embedding 278m Multilingual· MTEB Extra Text Boards data37.7%
25Jina Embedding B EN v1· MTEB Extra Text Boards data37.2%
26Gte Base· MTEB Extra Text Boards data34.8%
27BGE Base En V1.5· MTEB Extra Text Boards data33.9%
28bge-small-en-v1.5· MTEB Extra Text Boards data32.1%
29All Mpnet Base V2· MTEB Extra Text Boards data31.1%
30nomic-embed-text-v1.5· MTEB Extra Text Boards data30.6%
31All MiniLM L6 V2· MTEB Extra Text Boards data29.8%
32NV-Embed-v2· MTEB Extra Text Boards data25.4%
33All MiniLM L12 V2· MTEB Extra Text Boards data25.3%
34Paraphrase Multilingual MPNet v2· MTEB Extra Text Boards data21.7%
35Jina Embeddings v2 Base EN· MTEB Extra Text Boards data1.8%