Skip to content

Benchmark

ChemTEB - Retrieval

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
27
Scores recorded
27
Sources
1
IQ weight
0.79

Score distribution

70%
Mean
72.8%
Median
5.9%
Std dev
63.7%
10th percentile
74.4%
90th percentile
49.6%
Min
49.6%76.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.79 for embedding models, measured over 27 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1E5 Large V2Retrieval· MTEB Extra Text Boards data76.9%
2nomic-embed-text-v1.5Retrieval· MTEB Extra Text Boards data75.7%
3Qwen3 Embedding 8BRetrieval· MTEB Extra Text Boards data74.6%
4Multilingual E5 Large InstructRetrieval· MTEB Extra Text Boards data74.4%
5Jina Embeddings v5 Text SmallRetrieval· MTEB Extra Text Boards data74.3%
6Qwen3 Embedding 4BRetrieval· MTEB Extra Text Boards data74%
7BGE Large En V1.5Retrieval· MTEB Extra Text Boards data73.9%
8BGE Base En V1.5Retrieval· MTEB Extra Text Boards data73.7%
9Embed Multilingual V3.0Retrieval· MTEB Extra Text Boards data73.6%
10Embed English V3.0Retrieval· MTEB Extra Text Boards data73.1%
11nomic-embed-text-v1Retrieval· MTEB Extra Text Boards data73%
12Multilingual E5 LargeRetrieval· MTEB Extra Text Boards data73%
13Text Embedding 3 LargeRetrieval· MTEB Extra Text Boards data72.9%
14Jina Embeddings v5 Omni NanoRetrieval· MTEB Extra Text Boards data72.8%
15E5 Base V2Retrieval· MTEB Extra Text Boards data72.3%
16Qwen3 Embedding 0.6BRetrieval· MTEB Extra Text Boards data72%
17BGE M3Retrieval· MTEB Extra Text Boards data70.5%
18Titan Text Embeddings V2Retrieval· MTEB Extra Text Boards data70.1%
19Titan Embeddings G1 - TextRetrieval· MTEB Extra Text Boards data68.4%
20Text Embedding 3 SmallRetrieval· MTEB Extra Text Boards data67.9%
21Text Embedding Ada 002Retrieval· MTEB Extra Text Boards data66.7%
22bge-small-en-v1.5Retrieval· MTEB Extra Text Boards data66.7%
23All MiniLM L12 V2Retrieval· MTEB Extra Text Boards data64.1%
24All MiniLM L6 V2Retrieval· MTEB Extra Text Boards data63.7%
25Multi Qa Mpnet Base Dot V1Retrieval· MTEB Extra Text Boards data61.2%
26All Mpnet Base V2Retrieval· MTEB Extra Text Boards data60.7%
27bge-large-enRetrieval· MTEB Extra Text Boards data49.6%