Skip to content

Benchmark

FinBen CIKM18 F1

Scores are percentages. Higher is better.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

48.3%
Mean
51.9%
Median
3.6%
Std dev
44.7%
10th percentile
51.9%
90th percentile
44.7%
Min
44.7%51.9%
The band covers the middle 80% of scores. The line marks the median.

Leaderboard

#ModelScore
1Llama 3.2 3Bpublished-demo-leaderboard, CIKM18, F1· TheFinAI public numeric results51.9%
2code-llama-7b-instructpublished-demo-leaderboard, CIKM18, F1· TheFinAI public numeric results44.7%

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.