Skip to content

Benchmark

NepNewsBench v2 draft Nepali prose quality (English-source questions)

Multilingual benchmarks compare model performance across languages. Higher scores are better.

Models measured
16
Scores recorded
16
Sources
1
IQ weight
No weight published

Score distribution

7.9
Mean
8.2
Median
1.1
Std dev
7.3
10th percentile
8.9
90th percentile
5
Min
59
The band covers the middle 80% of scores. The line marks the median.

Results

The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.

ModelScore
Claude Fable 5.1Anthropic via openrouter, reasoning low· NepNewsBench v2 (draft candidate release) data8.9
Claude Haiku 4.5Anthropic via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data5.6
Claude Opus 5Anthropic via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data8.7
Claude Sonnet 4.6Anthropic via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data7.7
Claude Sonnet 5Anthropic via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data7.3
Gemini 3 FlashGoogle AI Studio via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data8.7
Gemini 3.1 Pro PreviewGoogle AI Studio via openrouter, reasoning low· NepNewsBench v2 (draft candidate release) data8.8
Gemini 3.8 FlashGoogle AI Studio via openrouter, reasoning low· NepNewsBench v2 (draft candidate release) data8.5
Gemma 4 31B ITVenice via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data7.8
GLM 5.3Z.AI via openrouter, reasoning low· NepNewsBench v2 (draft candidate release) data8.4
GPT-5.6 LunaOpenAI via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data7.8
GPT-5.6 SolOpenAI via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data9
Grok 4.6xAI via openrouter, reasoning low· NepNewsBench v2 (draft candidate release) data7.8
Kimi K3Moonshot AI via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data8.2
Qwen 3.8 27BAlibaba via openrouter, reasoning off· NepNewsBench v2 (draft candidate release) data5
Qwen3.8 MaxAlibaba via openrouter, reasoning minimal· NepNewsBench v2 (draft candidate release) data7.8

Data credits: Outback Yak Research, NepNewsBench v2 research draft. Public numerical aggregates from a candidate preview that the publisher says is not evidence of publication; no release licence assigned and none asserted here.