Benchmark
AfriHG headline generation Arabic (arb) ROUGE-2
Multilingual benchmarks compare model performance across languages. Higher scores are better.
- Models and systems measured
- 2
- Scores recorded
- 2
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 8.6
- Mean
- 9
- Median
- 0.4
- Std dev
- 8.2
- 10th percentile
- 9
- 90th percentile
- 8.2
- Min
Results
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| AfriTeVa V2 (base)headline generation fine-tunedtable: 1, system: AfriTeVa V2 (base), task: headline generation, language: arb, metric: ROUGE-2· AfriHG (arXiv:2412.20223v1) data | 8.2 |
| mT5-baseheadline generation fine-tunedtable: 1, system: mT5-base, task: headline generation, language: arb, metric: ROUGE-2· AfriHG (arXiv:2412.20223v1) data | 9 |
Data credits: Toyib Ogunremi, Serah Akojenu, Anthony Soronnadi, Olubayo Adekanmbi and David Ifeoluwa Adelani. AfriHG: News headline generation for African Languages, arXiv:2412.20223v1. CC BY 4.0 article numeric/protocol extract, restructured with values unchanged. Relayed summarization scores credited to Hasan et al. (2021); no task or model rights asserted. (licence)