Skip to content

Benchmark

Open Greek FinLLM MultiFin raw score

Higher scores are better.

Models measured
20
Scores recorded
20
Sources
1
IQ weight
1.20

Score distribution

0.545
Mean
0.593
Median
0.113
Std dev
0.389
10th percentile
0.704
90th percentile
0.315
Min
0.3150.722
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.20 for chat models, measured over 20 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Qwen2.5 72B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.722
2Llama 3 8B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.704
3Qwen2.5 32B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.704
4GPT 4greek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.63
5DeepSeek Chatgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.611
6Gemma 2 27B ITgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.611
7Gemma 2 9B ITgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.611
8Llama 3 70B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.611
9GPT 4ogreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.593
10GPT-4o minigreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.593
11Llama 3.1 8B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.537
12Qwen2.5 7B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.537
13GPT-4.5 Previewgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.519
14Mistral (7B) Instruct v0.3greek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.519
15GPT-3.5 Turbogreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.5
16Gemma 2 2B ITgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.407
17QwQ 32Bgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.407
18Llama 3.2 1B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.389
19Mistral (7B) Instruct v0.1greek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.389
20Qwen2.5 1.5B Instructgreek-contents, MultiFin, MultiFin Raw· TheFinAI public numeric results0.315

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.