Skip to content

Benchmark

Open Greek FinLLM FinText normalized score

Scores are index points out of 100. Higher is better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
0.69

Score distribution

20.9
Mean
18.5
Median
19.1
Std dev
0
10th percentile
44.6
90th percentile
0
Min
060
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.69 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT 4greek-contents, FinText· TheFinAI public numeric results60
2Qwen2.5 32B Instructgreek-contents, FinText· TheFinAI public numeric results55.2
3Llama 3 70B Instructgreek-contents, FinText· TheFinAI public numeric results44.6
4GPT-4.5 Previewgreek-contents, FinText· TheFinAI public numeric results40.7
5Qwen2.5 72B Instructgreek-contents, FinText· TheFinAI public numeric results38.8
6GPT 4ogreek-contents, FinText· TheFinAI public numeric results31.3
7GPT-3.5 Turbogreek-contents, FinText· TheFinAI public numeric results30.3
8GPT-4o minigreek-contents, FinText· TheFinAI public numeric results30.2
9Llama 3.1 8B Instructgreek-contents, FinText· TheFinAI public numeric results20.7
10Gemma 2 27B ITgreek-contents, FinText· TheFinAI public numeric results18.5
11Gemma 2 2B ITgreek-contents, FinText· TheFinAI public numeric results16
12Llama 3 8B Instructgreek-contents, FinText· TheFinAI public numeric results13.3
13Qwen2.5 7B Instructgreek-contents, FinText· TheFinAI public numeric results13.2
14Gemma 2 9B ITgreek-contents, FinText· TheFinAI public numeric results4.6
15DeepSeek Chatgreek-contents, FinText· TheFinAI public numeric results0.25
16Llama 3.2 1B Instructgreek-contents, FinText· TheFinAI public numeric results0
17Mistral (7B) Instruct v0.1greek-contents, FinText· TheFinAI public numeric results0
18Mistral (7B) Instruct v0.3greek-contents, FinText· TheFinAI public numeric results0
19Qwen2.5 1.5B Instructgreek-contents, FinText· TheFinAI public numeric results0
20QwQ 32Bgreek-contents, FinText· TheFinAI public numeric results0

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.