Skip to content

Benchmark

Artificial Analysis Openness Index

Scores are index points out of 100.

Scores from OpenRouter data docs.
Models measured
117
Scores recorded
117
Sources
1
IQ weight
0.00

Score distribution

39
Mean
38.9
Median
17.9
Std dev
11.1
10th percentile
52.8
90th percentile
5.6
Min
5.688.9
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.00 for chat models, measured over 117 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Kimi K2· OpenRouter data docs88.9
2Kimi K2 Thinking· OpenRouter data docs88.9
3Nemotron 3 Nano 30B A3B· OpenRouter data docs83.3
4Nemotron 3 Super 120B A12B· OpenRouter data docs83.3
5Nemotron 3 Ultra· OpenRouter data docs83.3
6Nemotron 3.5 Lightning· OpenRouter data docs83.3
7Nemotron 3.5 Super VL· OpenRouter data docs83.3
8Granite 4.2 8B· OpenRouter data docs72.2
9GLM 4.5· OpenRouter data docs55.6
10GLM 4.5 Air· OpenRouter data docs55.6
11Nemotron 3 Nano Omni 30b A3b Reasoning· OpenRouter data docs55.6
12GLM 4.5V· OpenRouter data docs52.8
13MiMo V2.6 Flash· OpenRouter data docs52.8
14MiMo V2.6 Pro· OpenRouter data docs52.8
15DeepSeek R1· OpenRouter data docs50
16DeepSeek V4 Flash· OpenRouter data docs50
17DeepSeek V4 Pro· OpenRouter data docs50
18Gemma 3 12B IT· OpenRouter data docs50
19Gemma 3 27B IT· OpenRouter data docs50
20Gemma 3 4B IT· OpenRouter data docs50
21GLM 5· OpenRouter data docs50
22Phi 4· OpenRouter data docs50
23Qwen3 VL 235B· OpenRouter data docs50
24Qwen3 VL 8B Instruct· OpenRouter data docs50
25qwen3-vl-30b· OpenRouter data docs50
26Hermes 4 405B· OpenRouter data docs47.2
27DeepSeek V3.2 Exp· OpenRouter data docs44.4
28DeepSeek V4 Flash 0731· OpenRouter data docs44.4
29DeepSeek V4 Pro 0813· OpenRouter data docs44.4
30DeepSeek V4.1 Flash· OpenRouter data docs44.4
31DeepSeek V4.1 Flash 1017· OpenRouter data docs44.4
32GLM 4.6· OpenRouter data docs44.4
33GLM 4.7· OpenRouter data docs44.4
34GLM 4.7 Flash· OpenRouter data docs44.4
35GLM 5.1· OpenRouter data docs44.4
36GLM 5.2· OpenRouter data docs44.4
37GLM 5.3 Flash· OpenRouter data docs44.4
38Ling 3.0 Flash· OpenRouter data docs44.4
39Ling 3.0 Flash VL· OpenRouter data docs44.4
40Motif 3· OpenRouter data docs44.4
41Muse Glimmer 30B· OpenRouter data docs44.4
42Qwen 3 235B A22B Thinking 2507· OpenRouter data docs44.4
43Qwen3 235B A22B Instruct 2507· OpenRouter data docs44.4
44Qwen3 30B A3B Instruct· OpenRouter data docs44.4
45Qwen3 Coder· OpenRouter data docs44.4
46Qwen3 Coder 30B A3B Instruct· OpenRouter data docs44.4
47Qwen3 Next 80B A3B Instruct· OpenRouter data docs44.4
48Qwen3 Coder Next· OpenRouter data docs41.7
49Beam 1.0 501B A23B· OpenRouter data docs38.9
50Command A Plus· OpenRouter data docs38.9

Showing 1–50 of 117 results.