Skip to content

Benchmark

Open Greek FinLLM FinNum normalized score

Scores are index points out of 100. Higher is better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
1.19

Score distribution

10.5
Mean
7.4
Median
12
Std dev
0
10th percentile
28
90th percentile
0
Min
036.8
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.19 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen2.5 32B Instructgreek-contents, FinNum· TheFinAI public numeric results36.8
2Qwen2.5 72B Instructgreek-contents, FinNum· TheFinAI public numeric results32.5
3GPT 4greek-contents, FinNum· TheFinAI public numeric results28
4GPT-4o minigreek-contents, FinNum· TheFinAI public numeric results24.8
5GPT-4.5 Previewgreek-contents, FinNum· TheFinAI public numeric results21.8
6Gemma 2 27B ITgreek-contents, FinNum· TheFinAI public numeric results18.2
7GPT-3.5 Turbogreek-contents, FinNum· TheFinAI public numeric results14.1
8Llama 3.1 8B Instructgreek-contents, FinNum· TheFinAI public numeric results10.3
9GPT 4ogreek-contents, FinNum· TheFinAI public numeric results9.2
10DeepSeek Chatgreek-contents, FinNum· TheFinAI public numeric results7.4
11Llama 3 70B Instructgreek-contents, FinNum· TheFinAI public numeric results5
12Gemma 2 9B ITgreek-contents, FinNum· TheFinAI public numeric results1.9
13Gemma 2 2B ITgreek-contents, FinNum· TheFinAI public numeric results0
14Llama 3 8B Instructgreek-contents, FinNum· TheFinAI public numeric results0
15Llama 3.2 1B Instructgreek-contents, FinNum· TheFinAI public numeric results0
16Mistral (7B) Instruct v0.1greek-contents, FinNum· TheFinAI public numeric results0
17Mistral (7B) Instruct v0.3greek-contents, FinNum· TheFinAI public numeric results0
18Qwen2.5 1.5B Instructgreek-contents, FinNum· TheFinAI public numeric results0
19Qwen2.5 7B Instructgreek-contents, FinNum· TheFinAI public numeric results0
20QwQ 32Bgreek-contents, FinNum· TheFinAI public numeric results0

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.