Skip to content

Benchmark

HF Hallucinations HaluEval Summarization, Accuracy

Factuality benchmarks measure how often models get facts right. Higher scores are better.

Models measured
2
Scores recorded
2
Sources
1
IQ weight
No weight published

Score distribution

0.484
Mean
0.491
Median
0.007
Std dev
0.477
10th percentile
0.491
90th percentile
0.477
Min

Leaderboard

#ModelScore
1Llama-2-7b-chat-hfclustermap_all/HaluEval Summarization, Accuracy· HF Hallucinations aggregate matrix0.491
2Llama-2-13b-chat-hfclustermap_all/HaluEval Summarization, Accuracy· HF Hallucinations aggregate matrix0.477

Data credits: Hallucinations Leaderboard, Apache-2.0. Publisher-selected archived score matrix; native normalized fractions. (licence)