Skip to content

Benchmark

pfgen-bench Japanese generation: Score

Higher scores are better.

Models measured
101
Scores recorded
156
Sources
1
IQ weight
1.59

Score distribution

0.498
Mean
0.483
Median
0.202
Std dev
0.256
10th percentile
0.804
90th percentile
0.0006
Min
0.00060.958
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 1.59 for chat models, measured over 101 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

Showing 151–156 of 156 results.

Data credits: pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence)