Skip to content

Benchmark

MTEB(Indic, v1) - BitextMining

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
31
Scores recorded
31
Sources
1
IQ weight
1.30

Score distribution

32.6%
Mean
12.2%
Median
30.9%
Std dev
2.5%
10th percentile
77.7%
90th percentile
0.23%
Min
0.23%81.2%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.30 for embedding models, measured over 31 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen3 Embedding 8BBitextMining· MTEB Leaderboard data81.2%
2Multilingual E5 Large InstructBitextMining· MTEB Leaderboard data80.4%
3Qwen3 Embedding 4BBitextMining· MTEB Leaderboard data80.2%
4Multilingual E5 LargeBitextMining· MTEB Leaderboard data77.7%
5Jina Embeddings v5 Omni SmallBitextMining· MTEB Leaderboard data70.5%
6Jina Embeddings v5 Text SmallBitextMining· MTEB Leaderboard data70.5%
7Jina Embeddings v3BitextMining· MTEB Leaderboard data70.3%
8Qwen3 Embedding 0.6BBitextMining· MTEB Leaderboard data67.2%
9snowflake-arctic-embed-l-v2.0BitextMining· MTEB Leaderboard data66.2%
10E5 Mistral 7B InstructBitextMining· MTEB Leaderboard data59.1%
11Granite Embedding 278m MultilingualBitextMining· MTEB Leaderboard data48.7%
12Paraphrase Multilingual MPNet v2BitextMining· MTEB Leaderboard data44.2%
13NV-Embed-v2BitextMining· MTEB Leaderboard data42.7%
14snowflake-arctic-embed-m-v2.0BitextMining· MTEB Leaderboard data41.7%
15Text Embedding 3 LargeBitextMining· MTEB Leaderboard data38.1%
16Text Embedding 3 SmallBitextMining· MTEB Leaderboard data12.2%
17E5 Large V2BitextMining· MTEB Leaderboard data7.6%
18Jina Embedding B EN v1BitextMining· MTEB Leaderboard data6.8%
19E5 Base V2BitextMining· MTEB Leaderboard data6.5%
20nomic-embed-text-v1BitextMining· MTEB Leaderboard data5.6%
21nomic-embed-text-v1.5BitextMining· MTEB Leaderboard data5.2%
22UAE-Large-V1BitextMining· MTEB Leaderboard data4%
23All Mpnet Base V2BitextMining· MTEB Leaderboard data3.7%
24All MiniLM L12 V2BitextMining· MTEB Leaderboard data3.5%
25BGE Large En V1.5BitextMining· MTEB Leaderboard data3.4%
26BGE Base En V1.5BitextMining· MTEB Leaderboard data3.4%
27bge-small-en-v1.5BitextMining· MTEB Leaderboard data2.6%
28All MiniLM L6 V2BitextMining· MTEB Leaderboard data2.5%
29Gte BaseBitextMining· MTEB Leaderboard data2.4%
30Gte LargeBitextMining· MTEB Leaderboard data2.2%
31Jina Embeddings v2 Base ENBitextMining· MTEB Leaderboard data0.23%