Skip to content

Benchmark

pfgen-bench Japanese generation: Fluency

Higher scores are better.

Models measured
101
Scores recorded
156
Sources
1
IQ weight
1.56

Score distribution

0.573
Mean
0.557
Median
0.195
Std dev
0.351
10th percentile
0.839
90th percentile
0.001
Min
0.0011
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.56 for chat models, measured over 101 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Showing 151–156 of 156 results.

Data credits: pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence)