Skip to content

Benchmark

Vals MortgageTax

Scores are percentages.

Models measured
88
Scores recorded
93
Sources
1
IQ weight
2.02

Score distribution

60.6%
Mean
64.1%
Median
11%
Std dev
45.4%
10th percentile
68.8%
90th percentile
3.5%
Min
3.5%72.1%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 2.02 for chat models, measured over 88 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
51GPT-5.4 mini· Vals AI63.5%
52gemini-2.5-flash-preview-09-2025· Vals AI62.6%
53Claude Sonnet 4· Vals AI62.5%
54Inkling Small· Vals AI62.3%
55Claude Haiku 4.5thinking· Vals AI62.2%
56Magistral Small 2509· Vals AI62.1%
57gemini-2.5-flash-preview-09-2025thinking· Vals AI61.9%
58Grok 4.5· Vals AI61.8%
59Gemma 4 31B IT· Vals AI61.4%
60GPT 5.1· Vals AI61.4%
61Mistral Small· Vals AI61.2%
62Claude Opus 4.1· Vals AI61.1%
63GPT 4o· Vals AI61%
64Qwen3.5 Plusthinking· Vals AI60.8%
65Gemini 2.0 Flash Experimental· Vals AI60.4%
66Gemini 2.0 Flash· Vals AI59.7%
67MiMo V2.5· Vals AI59.3%
68GPT 5.4 Nano· Vals AI59.1%
69Claude Opus 4· Vals AI58.6%
70Llama 4 Maverick· Vals AI58.5%
71gemini-2.5-flash-preview-04-17· Vals AI58.4%
72Llama 4 Scout· Vals AI57.8%
73Gemini 2.5 Flash Lite Preview 09-2025thinking· Vals AI57.6%
74gemini-2.5-flash-preview-04-17thinking· Vals AI57.5%
75gemini-1.5-pro-002· Vals AI56.8%
76Gemini 2.5 Flash Lite Preview 09-2025· Vals AI55.8%
77GPT-4o mini· Vals AI54.5%
78GPT-5 nano· Vals AI53.6%
79GPT-4.1 nano· Vals AI52.8%
80Mistral Large 3· Vals AI52.1%
81Magistral Medium· Vals AI51.9%
82Claude Sonnet 4thinking· Vals AI49.9%
83Grok 4.3· Vals AI48.3%
84Grok 4.20· Vals AI45.4%
85Grok 4· Vals AI44.5%
86gemini-1.5-flash-002· Vals AI42.8%
87Grok 4.1 Fast· Vals AI42.6%
88Grok 4 Fast· Vals AI42.1%
89Llama-3.2-90B-Vision-Instruct-Turbo· Vals AI38.8%
90Mistral Medium 3· Vals AI36.4%
91Mistral Medium 3.5· Vals AI28.9%
92Llama-3.2-11B-Vision-Instruct-Turbo· Vals AI23.3%
93Grok 2 Vision 1212· Vals AI3.5%

Showing 51–93 of 93 results.