Skip to content

Benchmark

MLEB - Irish Legislative Summaries

Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.

Models measured
18
Scores recorded
18
Sources
1
IQ weight
0.68

Score distribution

84.5%
Mean
83.9%
Median
5.9%
Std dev
77.4%
10th percentile
91.6%
90th percentile
74.6%
Min
74.6%94.9%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.68 for embedding models, measured over 18 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemini Embedding 001Irish Legislative Summaries· MLEB data94.9%
2voyage-4Irish Legislative Summaries· MLEB data93.3%
3voyage-4-largeIrish Legislative Summaries· MLEB data91.6%
4voyage-4-liteIrish Legislative Summaries· MLEB data90.9%
5Qwen3 Embedding 8BIrish Legislative Summaries· MLEB data89.1%
6Jina Embeddings v4Irish Legislative Summaries· MLEB data88.3%
7Qwen3 Embedding 4BIrish Legislative Summaries· MLEB data88.3%
8Jina Embeddings v5 Text SmallIrish Legislative Summaries· MLEB data84.3%
9Text Embedding Ada 002Irish Legislative Summaries· MLEB data83.9%
10Qwen3 Embedding 0.6BIrish Legislative Summaries· MLEB data83.8%
11Multilingual E5 Large InstructIrish Legislative Summaries· MLEB data82.4%
12Jina Embeddings v5 Text NanoIrish Legislative Summaries· MLEB data82%
13Granite Embedding Small English R2Irish Legislative Summaries· MLEB data81.1%
14Text Embedding 3 SmallIrish Legislative Summaries· MLEB data79.5%
15snowflake-arctic-embed-m-v2.0Irish Legislative Summaries· MLEB data78.7%
16Text Embedding 3 LargeIrish Legislative Summaries· MLEB data77.4%
17BGE M3Irish Legislative Summaries· MLEB data75.9%
18snowflake-arctic-embed-l-v2.0Irish Legislative Summaries· MLEB data74.6%

Data credits: MLEB (Isaacus), MIT (licence)