Skip to content

Benchmark

Finance Agent

Agentic benchmarks measure how well models carry out tasks that take several steps. Scores are percentages.

Models measured
8
Scores recorded
8
Sources
1
IQ weight
0.28

Score distribution

58.7%
Mean
60%
Median
3.8%
Std dev
53.9%
10th percentile
63.3%
90th percentile
53.7%
Min
53.7%64.4%
The band covers the middle 80% of scores. The line marks the median.

This benchmark has a weight of 0.28 for chat models, measured over 8 models. The weight is how much it counts toward llminfo IQ. We measure it from the data, not from the raw scores.

Leaderboard

#ModelScore
1Claude Opus 4.7· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim64.4%
2Claude Sonnet 4.6· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim63.3%
3Claude Opus 4.6· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim60.7%
4GPT 5.5· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim60%
5Gemini 3.5 Flash· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim57.9%
6GPT 5.4· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim56%
7Claude Opus 4.8· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim53.9%
8Nemotron 3 Ultra· LLM Stats data· Reported by the model's developer. The source relaying it did not verify it. claim53.7%

Data credits: Data by LLM Stats