Skip to content

Benchmark

FinBen ECTSUM Rouge-1

Scores are percentages. Higher is better.

Models measured
12
Scores recorded
12
Sources
1
IQ weight
No weight published

Score distribution

0%
Mean
0%
Median
0%
Std dev
0%
10th percentile
0%
90th percentile
0%
Min

Leaderboard

#ModelScore
1DeepSeek R1 Distill Qwen 7Bpublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
2DeepSeek V3published-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
3gemini-1.0-propublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
4GPT-3.5 Turbopublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
5GPT-4 Turbopublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
6Llama 2 70bpublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
7Llama 3.1 70Bpublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
8Llama 3.1 8Bpublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
9Llama-2-7b-chat-hfpublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
10Mixtral 8X7b V0.1published-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
11Qwen 2 (72B)published-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%
12Qwen2 7B Instructpublished-demo-leaderboard, ECTSUM, Rouge-1· TheFinAI public numeric results0%

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.