Skip to content

Benchmark

ChemTEB - Mean (TaskType)

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
26
Scores recorded
26
Sources
1
IQ weight
0.64

Score distribution

51.1%
Mean
51.6%
Median
2.4%
Std dev
48.1%
10th percentile
53.6%
90th percentile
46.4%
Min
46.4%56.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.64 for embedding models, measured over 26 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Text Embedding 3 LargeMean (TaskType)· MTEB Extra Text Boards data56.8%
2Qwen3 Embedding 8BMean (TaskType)· MTEB Extra Text Boards data54.9%
3Embed English V3.0Mean (TaskType)· MTEB Extra Text Boards data53.6%
4Embed Multilingual V3.0Mean (TaskType)· MTEB Extra Text Boards data53.3%
5Qwen3 Embedding 0.6BMean (TaskType)· MTEB Extra Text Boards data53%
6nomic-embed-text-v1.5Mean (TaskType)· MTEB Extra Text Boards data52.8%
7Qwen3 Embedding 4BMean (TaskType)· MTEB Extra Text Boards data52.7%
8Text Embedding 3 SmallMean (TaskType)· MTEB Extra Text Boards data52.5%
9Titan Text Embeddings V2Mean (TaskType)· MTEB Extra Text Boards data52.3%
10Text Embedding Ada 002Mean (TaskType)· MTEB Extra Text Boards data52.1%
11Jina Embeddings v5 Text SmallMean (TaskType)· MTEB Extra Text Boards data51.7%
12BGE Base En V1.5Mean (TaskType)· MTEB Extra Text Boards data51.7%
13Titan Embeddings G1 - TextMean (TaskType)· MTEB Extra Text Boards data51.6%
14nomic-embed-text-v1Mean (TaskType)· MTEB Extra Text Boards data51.5%
15BGE Large En V1.5Mean (TaskType)· MTEB Extra Text Boards data50.7%
16BGE M3Mean (TaskType)· MTEB Extra Text Boards data50.3%
17E5 Large V2Mean (TaskType)· MTEB Extra Text Boards data50.2%
18Multilingual E5 Large InstructMean (TaskType)· MTEB Extra Text Boards data49.7%
19All MiniLM L12 V2Mean (TaskType)· MTEB Extra Text Boards data49.7%
20All MiniLM L6 V2Mean (TaskType)· MTEB Extra Text Boards data49.5%
21All Mpnet Base V2Mean (TaskType)· MTEB Extra Text Boards data49.3%
22Multilingual E5 LargeMean (TaskType)· MTEB Extra Text Boards data48.5%
23E5 Base V2Mean (TaskType)· MTEB Extra Text Boards data48.1%
24bge-small-en-v1.5Mean (TaskType)· MTEB Extra Text Boards data47.6%
25Multi Qa Mpnet Base Dot V1Mean (TaskType)· MTEB Extra Text Boards data46.9%
26bge-large-enMean (TaskType)· MTEB Extra Text Boards data46.4%