Skip to content

Benchmark

ChemTEB(v1.1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
26
Scores recorded
26
Sources
1
IQ weight
0.30

Score distribution

81.6%
Mean
81.7%
Median
3.3%
Std dev
79.8%
10th percentile
85.3%
90th percentile
68.4%
Min
68.4%85.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.30 for embedding models, measured over 26 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Text Embedding 3 LargeClassification· MTEB Extra Text Boards data85.9%
2Qwen3 Embedding 8BClassification· MTEB Extra Text Boards data85.7%
3Titan Embeddings G1 - TextClassification· MTEB Extra Text Boards data85.3%
4Embed English V3.0Classification· MTEB Extra Text Boards data84.6%
5Text Embedding 3 SmallClassification· MTEB Extra Text Boards data84.5%
6Embed Multilingual V3.0Classification· MTEB Extra Text Boards data84.1%
7Text Embedding Ada 002Classification· MTEB Extra Text Boards data84.1%
8Qwen3 Embedding 4BClassification· MTEB Extra Text Boards data83%
9nomic-embed-text-v1.5Classification· MTEB Extra Text Boards data82.9%
10BGE Large En V1.5Classification· MTEB Extra Text Boards data82.2%
11All Mpnet Base V2Classification· MTEB Extra Text Boards data82.2%
12nomic-embed-text-v1Classification· MTEB Extra Text Boards data81.8%
13bge-small-en-v1.5Classification· MTEB Extra Text Boards data81.7%
14bge-large-enClassification· MTEB Extra Text Boards data81.6%
15All MiniLM L6 V2Classification· MTEB Extra Text Boards data81.5%
16Qwen3 Embedding 0.6BClassification· MTEB Extra Text Boards data81.4%
17BGE Base En V1.5Classification· MTEB Extra Text Boards data81.1%
18Multilingual E5 Large InstructClassification· MTEB Extra Text Boards data81.1%
19BGE M3Classification· MTEB Extra Text Boards data80.7%
20All MiniLM L12 V2Classification· MTEB Extra Text Boards data80.2%
21Titan Text Embeddings V2Classification· MTEB Extra Text Boards data80.2%
22E5 Large V2Classification· MTEB Extra Text Boards data80.1%
23E5 Base V2Classification· MTEB Extra Text Boards data79.8%
24Multilingual E5 LargeClassification· MTEB Extra Text Boards data79.2%
25Multi Qa Mpnet Base Dot V1Classification· MTEB Extra Text Boards data78.6%
26Jina Embeddings v5 Text SmallClassification· MTEB Extra Text Boards data68.4%