Skip to content

Benchmark

RTEB(deu, beta)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
47
Scores recorded
49
Sources
1
IQ weight
0.52

Score distribution

41.3%
Mean
45.2%
Median
23.1%
Std dev
11.7%
10th percentile
67.7%
90th percentile
2.6%
Min
2.6%76.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.52 for embedding models, measured over 46 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1VoyageAI by MongoDB: voyage-4-largeembed_dim: 2048, evolved_prompts=True· MTEB Extra Text Boards data76.9%
2VoyageAI by MongoDB: voyage-4-largeembed_dim: 2048· MTEB Extra Text Boards data75%
3Nemotron 3 Embed 1b· MTEB Extra Text Boards data73.2%
4VoyageAI by MongoDB: voyage-4-large· MTEB Extra Text Boards data72.1%
5VoyageAI by MongoDB: voyage-4· MTEB Extra Text Boards data70.8%
6VoyageAI by MongoDB: voyage-4-lite· MTEB Extra Text Boards data67.7%
7Qwen3 Embedding 8B· MTEB Extra Text Boards data66.9%
8Qwen3 Embedding 4B· MTEB Extra Text Boards data66.6%
9Gemini Embedding 001· MTEB Extra Text Boards data65.5%
10snowflake-arctic-embed-l-v2.0· MTEB Extra Text Boards data65.5%
11Jina Embeddings v4· MTEB Extra Text Boards data63.9%
12Jina Embeddings v5 Omni Small· MTEB Extra Text Boards data63.6%
13Jina Embeddings v5 Text Small· MTEB Extra Text Boards data63.6%
14INF Retriever v1· MTEB Extra Text Boards data63.2%
15Jina Embeddings v3· MTEB Extra Text Boards data59.4%
16snowflake-arctic-embed-m-v2.0· MTEB Extra Text Boards data58%
17Jina Embeddings v5 Omni Nano· MTEB Extra Text Boards data57.8%
18Jina Embeddings v5 Text Nano· MTEB Extra Text Boards data57.8%
19Text Embedding 3 Large· MTEB Extra Text Boards data56.3%
20Text Embedding 3 Small· MTEB Extra Text Boards data54.8%
21Qwen3 Embedding 0.6B· MTEB Extra Text Boards data52.5%
22Multilingual E5 Large Instruct· MTEB Extra Text Boards data51.3%
23BGE M3· MTEB Extra Text Boards data50.4%
24Text Embedding 004· MTEB Extra Text Boards data48.6%
25Text Embedding 005· MTEB Extra Text Boards data45.2%
26E5 Mistral 7B Instruct· MTEB Extra Text Boards data44.4%
27Multilingual E5 Large· MTEB Extra Text Boards data43.2%
28Granite Embedding 278m Multilingual· MTEB Extra Text Boards data36.8%
29Jina Embedding B EN v1· MTEB Extra Text Boards data29.9%
30E5 Large V2· MTEB Extra Text Boards data27.2%
31Gemini Embedding 2· MTEB Extra Text Boards data26.4%
32nomic-embed-text-v1· MTEB Extra Text Boards data26%
33Granite Embedding Small English R2· MTEB Extra Text Boards data24.6%
34E5 Base V2· MTEB Extra Text Boards data22.3%
35Gte Large· MTEB Extra Text Boards data19.8%
36bge-large-en· MTEB Extra Text Boards data18.8%
37NV-Embed-v2· MTEB Extra Text Boards data18.4%
38Paraphrase Multilingual MPNet v2· MTEB Extra Text Boards data17.8%
39BGE Large En V1.5· MTEB Extra Text Boards data16.6%
40UAE-Large-V1· MTEB Extra Text Boards data16.5%
41BGE Base En V1.5· MTEB Extra Text Boards data16%
42Gte Base· MTEB Extra Text Boards data15.7%
43All MiniLM L6 V2· MTEB Extra Text Boards data11.8%
44bge-small-en-v1.5· MTEB Extra Text Boards data11.7%
45All Mpnet Base V2· MTEB Extra Text Boards data10.7%
46nomic-embed-text-v1.5· MTEB Extra Text Boards data9%
47All MiniLM L12 V2· MTEB Extra Text Boards data7.4%
48Text2vec Base Chinese· MTEB Extra Text Boards data3%
49Jina Embeddings v2 Base EN· MTEB Extra Text Boards data2.6%