Skip to content

Benchmark

Open Greek FinLLM FNS raw score

Higher scores are better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
1.37

Score distribution

0.162
Mean
0.097
Median
0.127
Std dev
0.045
10th percentile
0.377
90th percentile
0.0238
Min
0.02380.38
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.37 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT 4greek-contents, FNS, FNS Raw· TheFinAI public numeric results0.38
2DeepSeek Chatgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.377
3GPT-4.5 Previewgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.377
4GPT-4o minigreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.355
5GPT-3.5 Turbogreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.314
6GPT 4ogreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.255
7Llama 3.1 8B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.202
8Mistral (7B) Instruct v0.1greek-contents, FNS, FNS Raw· TheFinAI public numeric results0.143
9Llama 3.2 1B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.14
10Qwen2.5 32B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0971
11Gemma 2 27B ITgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0896
12Mistral (7B) Instruct v0.3greek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0839
13Llama 3 70B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0812
14Llama 3 8B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0743
15Qwen2.5 7B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0699
16Gemma 2 9B ITgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0591
17QwQ 32Bgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0545
18Qwen2.5 72B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0447
19Gemma 2 2B ITgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0261
20Qwen2.5 1.5B Instructgreek-contents, FNS, FNS Raw· TheFinAI public numeric results0.0238

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.