Skip to content

Benchmark

Open Greek FinLLM FinNum raw score

Higher scores are better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
1.19

Score distribution

0.105
Mean
0.074
Median
0.12
Std dev
0
10th percentile
0.28
90th percentile
0
Min
00.368
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.19 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen2.5 32B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.368
2Qwen2.5 72B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.325
3GPT 4greek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.28
4GPT-4o minigreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.248
5GPT-4.5 Previewgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.218
6Gemma 2 27B ITgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.182
7GPT-3.5 Turbogreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.141
8Llama 3.1 8B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.103
9GPT 4ogreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.0918
10DeepSeek Chatgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.0743
11Llama 3 70B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.05
12Gemma 2 9B ITgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0.0189
13Gemma 2 2B ITgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
14Llama 3 8B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
15Llama 3.2 1B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
16Mistral (7B) Instruct v0.1greek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
17Mistral (7B) Instruct v0.3greek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
18Qwen2.5 1.5B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
19Qwen2.5 7B Instructgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0
20QwQ 32Bgreek-contents, FinNum, FinNum Raw· TheFinAI public numeric results0

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.