Benchmark
MLEB - Irish Legislative Summaries
Embedding benchmarks measure how well models find related items, for example when matching a search to relevant results. Scores are percentages.
- Models measured
- 18
- Scores recorded
- 18
- Sources
- 1
- IQ weight
- 0.68
Score distribution
- 84.5%
- Mean
- 83.9%
- Median
- 5.9%
- Std dev
- 77.4%
- 10th percentile
- 91.6%
- 90th percentile
- 74.6%
- Min
This benchmark has a weight of 0.68 for embedding models, measured over 18 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.
Leaderboard
| # | Model | Score |
|---|---|---|
| 1 | Gemini Embedding 001Irish Legislative Summaries· MLEB data | 94.9% |
| 2 | voyage-4Irish Legislative Summaries· MLEB data | 93.3% |
| 3 | voyage-4-largeIrish Legislative Summaries· MLEB data | 91.6% |
| 4 | voyage-4-liteIrish Legislative Summaries· MLEB data | 90.9% |
| 5 | Qwen3 Embedding 8BIrish Legislative Summaries· MLEB data | 89.1% |
| 6 | Jina Embeddings v4Irish Legislative Summaries· MLEB data | 88.3% |
| 7 | Qwen3 Embedding 4BIrish Legislative Summaries· MLEB data | 88.3% |
| 8 | Jina Embeddings v5 Text SmallIrish Legislative Summaries· MLEB data | 84.3% |
| 9 | Text Embedding Ada 002Irish Legislative Summaries· MLEB data | 83.9% |
| 10 | Qwen3 Embedding 0.6BIrish Legislative Summaries· MLEB data | 83.8% |
| 11 | Multilingual E5 Large InstructIrish Legislative Summaries· MLEB data | 82.4% |
| 12 | Jina Embeddings v5 Text NanoIrish Legislative Summaries· MLEB data | 82% |
| 13 | Granite Embedding Small English R2Irish Legislative Summaries· MLEB data | 81.1% |
| 14 | Text Embedding 3 SmallIrish Legislative Summaries· MLEB data | 79.5% |
| 15 | snowflake-arctic-embed-m-v2.0Irish Legislative Summaries· MLEB data | 78.7% |
| 16 | Text Embedding 3 LargeIrish Legislative Summaries· MLEB data | 77.4% |
| 17 | BGE M3Irish Legislative Summaries· MLEB data | 75.9% |
| 18 | snowflake-arctic-embed-l-v2.0Irish Legislative Summaries· MLEB data | 74.6% |
Data credits: MLEB (Isaacus), MIT (licence)