Skip to content

Benchmark

MTEB(Scandinavian, v1) - Classification

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
26
Scores recorded
28
Sources
1
IQ weight
0.72

Score distribution

57.3%
Mean
58.9%
Median
8.6%
Std dev
47.8%
10th percentile
64.9%
90th percentile
47.5%
Min
47.5%74.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.72 for embedding models, measured over 26 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BClassification· MTEB Leaderboard data74.8%
2Qwen3 Embedding 4BClassification· MTEB Leaderboard data72.9%
3Gemini Embedding 001Classification· MTEB Leaderboard data72.4%
4E5 Mistral 7B InstructClassification· MTEB Leaderboard data64.9%
5Text Embedding 3 LargeClassification· MTEB Leaderboard data64.8%
6Qwen3 Embedding 0.6BClassification· MTEB Leaderboard data64.6%
7Multilingual E5 Large InstructClassification· MTEB Leaderboard data63.9%
8Text Embedding 3 LargeClassification, embed_dim: 512· MTEB Leaderboard data63.7%
9Jina Embeddings v3Classification· MTEB Leaderboard data63.2%
10Multilingual E5 LargeClassification· MTEB Leaderboard data63%
11BGE M3Classification· MTEB Leaderboard data61.7%
12Text Embedding 3 SmallClassification· MTEB Leaderboard data60.8%
13Text Embedding 3 SmallClassification, embed_dim: 512· MTEB Leaderboard data60.2%
14snowflake-arctic-embed-l-v2.0Classification· MTEB Leaderboard data58.9%
15Paraphrase Multilingual MPNet v2Classification· MTEB Leaderboard data58.6%
16Granite Embedding 278m MultilingualClassification· MTEB Leaderboard data51.9%
17E5 Large V2Classification· MTEB Leaderboard data51.7%
18E5 Base V2Classification· MTEB Leaderboard data49.9%
19nomic-embed-text-v1Classification· MTEB Leaderboard data48.8%
20BGE Large En V1.5Classification· MTEB Leaderboard data48.7%
21UAE-Large-V1Classification· MTEB Leaderboard data48.6%
22bge-small-en-v1.5Classification· MTEB Leaderboard data48.4%
23nomic-embed-text-v1.5Classification· MTEB Leaderboard data48.4%
24BGE Base En V1.5Classification· MTEB Leaderboard data48.2%
25All MiniLM L6 V2Classification· MTEB Leaderboard data47.8%
26Gte LargeClassification· MTEB Leaderboard data47.6%
27Gte BaseClassification· MTEB Leaderboard data47.6%
28All Mpnet Base V2Classification· MTEB Leaderboard data47.5%