Skip to content

Benchmark

FinBen MultiFin-ES MCC

Higher scores are better.

Models measured
6
Scores recorded
6
Sources
1
IQ weight
1.47

Score distribution

0.241
Mean
0.262
Median
0.09
Std dev
0.236
10th percentile
0.357
90th percentile
0.0589
Min

This benchmark has a weight of 1.47 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen2.5 7B Instructpublished-demo-leaderboard, MultiFin-ES, MCC· TheFinAI public numeric results0.357
2Llama 3.2 3Bpublished-demo-leaderboard, MultiFin-ES, MCC· TheFinAI public numeric results0.283
3codellama-7bpublished-demo-leaderboard, MultiFin-ES, MCC· TheFinAI public numeric results0.262
4Mistral (7B) Instruct v0.3published-demo-leaderboard, MultiFin-ES, MCC· TheFinAI public numeric results0.25
5Qwen2.5 7Bpublished-demo-leaderboard, MultiFin-ES, MCC· TheFinAI public numeric results0.236
6code-llama-7b-instructpublished-demo-leaderboard, MultiFin-ES, MCC· TheFinAI public numeric results0.0589

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.