Skip to content

Benchmark

FinBen ECTSUM BertScore

Higher scores are better.

Models measured
9
Scores recorded
9
Sources
1
IQ weight
No weight published

Score distribution

0
Mean
0
Median
0
Std dev
0
10th percentile
0
90th percentile
0
Min

Leaderboard

#ModelScore
1DeepSeek R1 Distill Qwen 7Bpublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
2DeepSeek V3published-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
3gemini-1.0-propublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
4GPT-3.5 Turbopublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
5GPT-4 Turbopublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
6Llama 2 70bpublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
7Llama-2-7b-chat-hfpublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
8Mixtral 8X7b V0.1published-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0
9Qwen2 7B Instructpublished-demo-leaderboard, ECTSUM, BertScore· TheFinAI public numeric results0

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.