Skip to content

Benchmark

MTEB(Scandinavian, v1) - BitextMining

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
39
Scores recorded
41
Sources
1
IQ weight
1.01

Score distribution

67.9%
Mean
67.3%
Median
13.6%
Std dev
58.6%
10th percentile
86%
90th percentile
4.3%
Min
4.3%95.8%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.01 for embedding models, measured over 39 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemini Embedding 2BitextMining· MTEB Leaderboard data95.8%
2Jina Embeddings v5 Omni SmallBitextMining· MTEB Leaderboard data86%
3Jina Embeddings v5 Text SmallBitextMining· MTEB Leaderboard data86%
4Jina Embeddings v5 Omni NanoBitextMining· MTEB Leaderboard data86%
5Jina Embeddings v5 Text NanoBitextMining· MTEB Leaderboard data86%
6Qwen3 Embedding 8BBitextMining· MTEB Leaderboard data84.7%
7Qwen3 Embedding 4BBitextMining· MTEB Leaderboard data82.2%
8E5 Mistral 7B InstructBitextMining· MTEB Leaderboard data75.2%
9Multilingual E5 Large InstructBitextMining· MTEB Leaderboard data74.5%
10Qwen3 Embedding 0.6BBitextMining· MTEB Leaderboard data73.5%
11Gemini Embedding 001BitextMining· MTEB Leaderboard data72.5%
12embeddinggemma-2BitextMining· MTEB Leaderboard data71.2%
13nomic-embed-text-v1BitextMining· MTEB Leaderboard data70.8%
14nomic-embed-text-v1.5BitextMining· MTEB Leaderboard data69.9%
15BGE M3BitextMining· MTEB Leaderboard data69.3%
16Multilingual E5 LargeBitextMining· MTEB Leaderboard data69.1%
17Text Embedding 3 LargeBitextMining· MTEB Leaderboard data68.8%
18NV-Embed-v2BitextMining· MTEB Leaderboard data67.9%
19Text Multilingual Embedding 002BitextMining· MTEB Leaderboard data67.9%
20snowflake-arctic-embed-m-v2.0BitextMining· MTEB Leaderboard data67.5%
21snowflake-arctic-embed-l-v2.0BitextMining· MTEB Leaderboard data67.3%
22Text Embedding 3 SmallBitextMining· MTEB Leaderboard data66.9%
23E5 Large V2BitextMining· MTEB Leaderboard data66.7%
24Text Embedding Ada 002BitextMining· MTEB Leaderboard data66.7%
25Granite Embedding 278m MultilingualBitextMining· MTEB Leaderboard data66.6%
26Text Embedding 3 LargeBitextMining, embed_dim: 512· MTEB Leaderboard data66.3%
27E5 Base V2BitextMining· MTEB Leaderboard data65.6%
28Text Embedding 3 SmallBitextMining, embed_dim: 512· MTEB Leaderboard data65.4%
29Jina Embeddings v3BitextMining· MTEB Leaderboard data65%
30All MiniLM L12 V2BitextMining· MTEB Leaderboard data63.5%
31bge-small-en-v1.5BitextMining· MTEB Leaderboard data62.4%
32Gte BaseBitextMining· MTEB Leaderboard data62.4%
33BGE Large En V1.5BitextMining· MTEB Leaderboard data62.3%
34Gte LargeBitextMining· MTEB Leaderboard data62.1%
35UAE-Large-V1BitextMining· MTEB Leaderboard data61.8%
36BGE Base En V1.5BitextMining· MTEB Leaderboard data59.1%
37All Mpnet Base V2BitextMining· MTEB Leaderboard data58.6%
38All MiniLM L6 V2BitextMining· MTEB Leaderboard data58.1%
39Jina Embedding B EN v1BitextMining· MTEB Leaderboard data57.2%
40Paraphrase Multilingual MPNet v2BitextMining· MTEB Leaderboard data52.7%
41Jina Embeddings v2 Base ENBitextMining· MTEB Leaderboard data4.3%