Skip to content

Benchmark

FinBen Regulations Rouge-1

Scores are percentages. Higher is better.

Models measured
3
Scores recorded
3
Sources
1
IQ weight
No weight published

Score distribution

22.7%
Mean
27%
Median
9.1%
Std dev
10%
10th percentile
31%
90th percentile
10%
Min
10%31%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Qwen 2 (72B)published-demo-leaderboard, Regulations, Rouge-1· TheFinAI public numeric results31%
2Llama 3.1 8Bpublished-demo-leaderboard, Regulations, Rouge-1· TheFinAI public numeric results27%
3Llama 3.1 70Bpublished-demo-leaderboard, Regulations, Rouge-1· TheFinAI public numeric results10%

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.