Skip to content

Benchmark

Artificial Analysis Multilingual Index

Multilingual benchmarks compare model performance across languages. Scores are index points out of 100.

Models measured
55
Scores recorded
55
Sources
1
IQ weight
2.27

Score distribution

0.812
Mean
0.838
Median
0.107
Std dev
0.683
10th percentile
0.906
90th percentile
0.351
Min
0.3510.932
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.27 for chat models, measured over 55 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Gemini 3.1 Pro Preview· OpenRouter data docs0.932
2Claude Opus 4.6· OpenRouter data docs0.922
3Gemini 3 Flash· OpenRouter data docs0.914
4Claude Opus 4.5· OpenRouter data docs0.913
5GPT 5· OpenRouter data docs0.907
6GPT 5.1· OpenRouter data docs0.906
7Claude Sonnet 4.6· OpenRouter data docs0.905
8Gemini 2.5 Pro· OpenRouter data docs0.903
9Qwen3.5 397B A17B· OpenRouter data docs0.9
10GPT 5.2· OpenRouter data docs0.898
11GPT-5.1 Codex· OpenRouter data docs0.897
12Grok 4.20· OpenRouter data docs0.895
13GPT-5.4 mini· OpenRouter data docs0.894
14Claude Sonnet 4.5· OpenRouter data docs0.893
15Qwen3.5 122B-A10B· OpenRouter data docs0.891
16Gemini 2.5 Flash· OpenRouter data docs0.888
17GPT-5 mini· OpenRouter data docs0.874
18Qwen3.5 27B· OpenRouter data docs0.868
19DeepSeek V3.2 Exp· OpenRouter data docs0.867
20DeepSeek V3.2· OpenRouter data docs0.865
21Qwen3.5 35B A3B· OpenRouter data docs0.864
22DeepSeek R1· OpenRouter data docs0.86
23GLM 4.6· OpenRouter data docs0.856
24Qwen 3 235B A22B Thinking 2507· OpenRouter data docs0.853
25GPT-5.1 Codex Mini· OpenRouter data docs0.85
26MiniMax M2.5· OpenRouter data docs0.842
27Kimi K2.5· OpenRouter data docs0.84
28Gemini 2.5 Flash-Lite· OpenRouter data docs0.838
29Claude Haiku 4.5· OpenRouter data docs0.834
30GPT OSS 120B· OpenRouter data docs0.828
31DeepSeek V3.1 Terminus· OpenRouter data docs0.827
32Llama 4 Maverick· OpenRouter data docs0.825
33GLM 5· OpenRouter data docs0.819
34GPT-5 nano· OpenRouter data docs0.812
35Kimi K2 0905· OpenRouter data docs0.808
36GLM 4.6v· OpenRouter data docs0.806
37Mistral Large 3· OpenRouter data docs0.803
38GLM 4.7· OpenRouter data docs0.799
39Nova Premier 1.0· OpenRouter data docs0.796
40Qwen3 Coder Next· OpenRouter data docs0.794
41Kimi K2· OpenRouter data docs0.786
42Devstral 2 123b Instruct 2512· OpenRouter data docs0.775
43Gemma 3 27B IT· OpenRouter data docs0.764
44Llama 3.3 70B Instruct· OpenRouter data docs0.764
45GPT OSS 20b· OpenRouter data docs0.752
46Llama 4 Scout· OpenRouter data docs0.741
47Kimi K2 Thinking· OpenRouter data docs0.735
48Qwen3 30B A3B Instruct· OpenRouter data docs0.72
49Gemma 3 12B IT· OpenRouter data docs0.709
50Ministral 14B2512· OpenRouter data docs0.683

Showing 1–50 of 55 results.