Skip to content

Benchmark

AfriHG headline generation Igbo (ibo) ROUGE-1

Multilingual benchmarks compare model performance across languages. Higher scores are better.

Models and systems measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

29.8
Mean
31
Median
1.3
Std dev
28.5
10th percentile
31
90th percentile
28.5
Min
28.531
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

Model or systemScore
AfriTeVa V2 (base)headline generation fine-tunedtable: 1, system: AfriTeVa V2 (base), task: headline generation, language: ibo, metric: ROUGE-1· AfriHG (arXiv:2412.20223v1) data31
mT5-baseheadline generation fine-tunedtable: 1, system: mT5-base, task: headline generation, language: ibo, metric: ROUGE-1· AfriHG (arXiv:2412.20223v1) data28.5

Data credits: Toyib Ogunremi, Serah Akojenu, Anthony Soronnadi, Olubayo Adekanmbi and David Ifeoluwa Adelani. AfriHG: News headline generation for African Languages, arXiv:2412.20223v1. CC BY 4.0 article numeric/protocol extract, restructured with values unchanged. Relayed summarization scores credited to Hasan et al. (2021); no task or model rights asserted. (licence)