Skip to content

Benchmark

Open Greek FinLLM overall normalized index

Scores are index points out of 100. Higher is better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
0.95

Score distribution

23.8
Mean
22.7
Median
13
Std dev
8.9
10th percentile
42.5
90th percentile
6.5
Min
6.548.3
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.95 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT 4greek-contents, published-average· TheFinAI public numeric results48.3
2GPT-4.5 Previewgreek-contents, published-average· TheFinAI public numeric results43.4
3Qwen2.5 32B Instructgreek-contents, published-average· TheFinAI public numeric results42.5
4Qwen2.5 72B Instructgreek-contents, published-average· TheFinAI public numeric results41.4
5GPT 4ogreek-contents, published-average· TheFinAI public numeric results37.5
6Llama 3 70B Instructgreek-contents, published-average· TheFinAI public numeric results31.2
7DeepSeek Chatgreek-contents, published-average· TheFinAI public numeric results29.5
8GPT-4o minigreek-contents, published-average· TheFinAI public numeric results28.3
9GPT-3.5 Turbogreek-contents, published-average· TheFinAI public numeric results23.2
10Llama 3.1 8B Instructgreek-contents, published-average· TheFinAI public numeric results22.7
11Gemma 2 27B ITgreek-contents, published-average· TheFinAI public numeric results19.8
12Llama 3 8B Instructgreek-contents, published-average· TheFinAI public numeric results18.9
13Qwen2.5 7B Instructgreek-contents, published-average· TheFinAI public numeric results17.4
14Mistral (7B) Instruct v0.3greek-contents, published-average· TheFinAI public numeric results14.7
15Gemma 2 9B ITgreek-contents, published-average· TheFinAI public numeric results14.3
16Gemma 2 2B ITgreek-contents, published-average· TheFinAI public numeric results9.5
17Mistral (7B) Instruct v0.1greek-contents, published-average· TheFinAI public numeric results9.1
18Llama 3.2 1B Instructgreek-contents, published-average· TheFinAI public numeric results8.9
19QwQ 32Bgreek-contents, published-average· TheFinAI public numeric results7.8
20Qwen2.5 1.5B Instructgreek-contents, published-average· TheFinAI public numeric results6.5

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.