Skip to content

Benchmark

FinBen FinanceES MCC

Higher scores are better.

Models measured
6
Scores recorded
6
Sources
1
IQ weight
0.00

Score distribution

-0.129
Mean
-0.069
Median
0.132
Std dev
-0.159
10th percentile
0
90th percentile
-0.397
Min
-0.3970
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.00 for chat models, measured over 6 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1codellama-7bpublished-demo-leaderboard, FinanceES, MCC· TheFinAI public numeric results0
2code-llama-7b-instructpublished-demo-leaderboard, FinanceES, MCC· TheFinAI public numeric results-0.0258
3Llama 3.2 3Bpublished-demo-leaderboard, FinanceES, MCC· TheFinAI public numeric results-0.0693
4Qwen2.5 7B Instructpublished-demo-leaderboard, FinanceES, MCC· TheFinAI public numeric results-0.122
5Qwen2.5 7Bpublished-demo-leaderboard, FinanceES, MCC· TheFinAI public numeric results-0.159
6Mistral (7B) Instruct v0.3published-demo-leaderboard, FinanceES, MCC· TheFinAI public numeric results-0.397

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.