Skip to content

Benchmark

Open Greek FinLLM FinText raw score

Higher scores are better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
0.69

Score distribution

0.209
Mean
0.185
Median
0.191
Std dev
0
10th percentile
0.446
90th percentile
0
Min
00.6
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.69 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1GPT 4greek-contents, FinText, FinText Raw· TheFinAI public numeric results0.6
2Qwen2.5 32B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.552
3Llama 3 70B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.446
4GPT-4.5 Previewgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.407
5Qwen2.5 72B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.388
6GPT 4ogreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.313
7GPT-3.5 Turbogreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.303
8GPT-4o minigreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.302
9Llama 3.1 8B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.207
10Gemma 2 27B ITgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.185
11Gemma 2 2B ITgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.16
12Llama 3 8B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.133
13Qwen2.5 7B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.132
14Gemma 2 9B ITgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.0455
15DeepSeek Chatgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0.0025
16Llama 3.2 1B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0
17Mistral (7B) Instruct v0.1greek-contents, FinText, FinText Raw· TheFinAI public numeric results0
18Mistral (7B) Instruct v0.3greek-contents, FinText, FinText Raw· TheFinAI public numeric results0
19Qwen2.5 1.5B Instructgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0
20QwQ 32Bgreek-contents, FinText, FinText Raw· TheFinAI public numeric results0

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.