Skip to content

Anthropic · Chat

Claude Sonnet 5

Anthropic 🇺🇸ChatClaude familyOne of its sources says the weights aren't publicly available.The maker currently lists 30 Jun 2027 as the deprecation date. Plans can change.

Newer version: Claude Sonnet 5.5. We compared release dates and version names in our catalogue.

From Neosantara's listing:
Claude Sonnet 5 represents the latest in agentic and high-intelligence reasoning from Anthropic.
llminfo IQ
136.3
Maker's price
$4.00 blended / 1M
Max context
1M
Listings
114

Evidence and sources

llminfo IQ 136.3, ranked among chat models. From 360 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 115.2, 95% interval 111–120. From 28 benchmark families across 12 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (37.4). Costs more per task than its benchmark results predict. From 45 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsChatty (57 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. Little data behind it, so treat it as a rough estimate. By effort: default 55 · low 50 · medium 57 · high 65 · max 69.Median 38,269 output tokens per task at medium effort.How the Yap score worksReleased 30 Jun 2026Maker HQ: US (according to Anthropic's own website)
All rankings: #12 in Google Trends interest this week #44 on OpenRouter this month #55 on OpenRouter this week #63 on OpenRouter today #116 on NanoGPT recentlyAll rankings: #12 in Google Trends interest this week #44 on OpenRouter this month #55 on OpenRouter this week #63 on OpenRouter today #116 on NanoGPT recentlySources: Anthropic API data, LiteLLM data, Models.dev data, AI/ML API data, Neosantara Inference data, llminfo researchPrimary data from Anthropic API from LiteLLM: deprecation date from Models.dev: weights availability from AI/ML API: primary mode from Neosantara Inference: description from llminfo research: release date
Tags from its sources:instructtoolsvisionreasoningdocumentproprietarycodingagenticlong-context

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Trade-offs

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 9 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputComputer useWeb searchBatch API

Listings

 Anthropicclaude-sonnet-5Sources: Anthropic API data, GenAI Prices data, LiteLLM data, Models.dev data1M$2.00cache read $0.20batch $1.00$10.00cache write 5m $2.50cache write 1h $4.00batch $5.00
 Teapot Routerclaude-sonnet-5Source: Models.dev data1M$0.70$3.50
 Xxapiclaude-sonnet-5Source: Models.dev data1M$0.7692cache read $0.0769$3.846cache write $0.9615
 Jzstokenclaude-sonnet-5Source: Models.dev data1M$0.7784cache read $0.0778$3.89cache write $0.9731
 OpenRouteranthropic/claude-sonnet-5:batch · batchSource: OpenRouter data docs1M$1.00cache read $0.10$5.00cache write 5m $1.25cache write 1h $2.00
 Vercelanthropic/claude-sonnet-5-batch · batchSource: Vercel AI Gateway data1M$1.00cache read $0.10$5.00
 Outerlabsclaude-sonnet-5Source: Models.dev data1M$1.20cache read $0.12$6.00cache write $1.50
 Korouterclaude-sonnet-5Source: Models.dev data1M$1.30cache read $0.13$6.50cache write $1.63
 Kunavoclaude-sonnet-5Source: Models.dev data1M$1.40cache read $0.14$7.00cache write $1.75
 Kenariclaude-sonnet-5Source: Models.dev data1M$1.43cache read $0.5714$7.14cache write $1.71

12 listings without a price are hidden.

Included in plans

Copilot EnterprisegithubSubscription$39/moextra use billed past the allowancePlan page
Copilot ProgithubSubscription$10/moextra use billed past the allowancePlan page
Copilot Pro+githubSubscription$39/moextra use billed past the allowancePlan page
Copilot BusinessgithubSubscription$19/moextra use billed past the allowancePlan page
Copilot MaxgithubSubscription$100/moextra use billed past the allowancePlan page

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Arena ELO64 related benchmarks · 64 results
Source: LMArena data · Nov 2026
Arena ELO
Chinese
Show 58 more resultsHide 58 results
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026

Multilingual

Bangla LLM BenchSource: Bangla LLM Bench data docs
EKI EstonianSource: Keelemudelite mõõdupuu data docs
NepNewsBench v2 draft40 related benchmarks · 40 results
entity F1 (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
core fact recall (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
core fact recall (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
core fact recall (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
coverage precision proxy (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
Show 34 more resultsHide 34 results
coverage precision proxy (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
coverage precision proxy (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
effective score (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
effective score (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
effective score (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
English prose quality (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
English prose quality (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
English prose quality (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity F1 (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity F1 (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity precision (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity precision (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity precision (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity recall (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity recall (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
entity recall (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
Nepali prose quality (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
Nepali prose quality (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
Nepali prose quality (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
supporting fact recall (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
supporting fact recall (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
supporting fact recall (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
valid-answer quality (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
valid-answer quality (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
valid-answer quality (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Anthropic via openrouter, reasoning off
PashtoBench10 related benchmarks · 10 results
Show 4 more resultsHide 4 results

Agentic

Arena AgentSource: LMArena data
BrowseComp3 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
multi-agent · max effort
single agent · search/fetch/code · 10M token limit · max effort
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
GDPval-AA v22 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Artificial Analysis · as of 2026-06-17
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini 3.6 Flash Model Card · July 2026
MLE-BenchGemini 3.6 Flash Model Card · July 2026 · Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
361 tasks · 1080p · 100 steps · pass@1 · 5 runs
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini 3.6 Flash Model Card · July 2026
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · 100 EHR tasks · max · five attempts/task
Source: Clinical Benchmarks data docs · Reported by the model's developer. The source relaying it did not verify it. claim · Sep 2026
Setting not stated
SWE-Bench Pro3 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · 5 trials
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini 3.6 Flash Model Card · July 2026 · Public
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Source: OpenRouter benchmark exports
30 Jun 2026 version · 90-day results
Across 5 providers lowest 74.2% median 74.3% highest 74.9%OpenRouter's automatic routing 74.1%
Show results from 5 providers and OpenRouter's automatic routingHide results from 5 providers and OpenRouter's automatic routing
  • Amazon Bedrock
  • Anthropic
  • Claude Platform on AWS
  • Azure
  • Google
  • OpenRouter's automatic routing
Terminal-Bench3 related benchmarks · 6 results
Terminal-Bench 2.0
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Terminal-Bench 2.1
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini 3.6 Flash Model Card · July 2026 · Terminus-2
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
mini-SWE-agent · xhigh · 89 tasks × 5 attempts
Terminal-Bench 4.0
Reported by Terminal-Bench / Stanford / Harbor / Laude Institute · via BenchBoard docs
Terminal-Bench 4.0 official leaderboard · Claude Code · max effort
Source: LLM Stats data
Setting not stated
Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Harbor · provider harness · task success rate · max effort

Coding

Arena ELOSource: LMArena data · Nov 2026
BenchCADSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
CursorBenchCursor production Agent harness · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
CursorBench 4.0Reasoning effort · Cursor production agent · Reported by Cursor · via BenchBoard docs
SWE-bench3 related benchmarks · 6 results
Verified
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · 5 trials
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Multilingual
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · 5 trials
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Multimodal
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
internal harness · adaptive thinking · max effort · 5 trials
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
ValsSource: Vals AI

Reasoning

Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Zapier private held-out set · max effort
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
human-difficult subset · source plots 0.35
human-solvable subset · source plots 0.82
Opus 5.5 System Card · adaptive thinking · max effort unless stated · Human Difficult · 17 tasks
Opus 5.5 System Card · adaptive thinking · max effort unless stated · Human Solvable · 73 tasks
ChartMuseum3 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
test split · Sonnet 4.6 grader · 5 runs
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
GDP.pdf3 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
mean criteria pass rate · no tools · base64 PDF · 5 runs
mean criteria pass rate · Python + image crop · 5 runs
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
no tools · auto thinking · 1M total tokens
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Humanity's Last Exam (with tools)Reasoning effort · search/fetch/code · 1M total tokens · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MILU2 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Opus 5.5 System Card · adaptive thinking · max effort unless stated
overall average · adaptive thinking · max effort · 5 trials
OfficeQAextracted-text sandbox + code · exact match · max effort · 5 trials · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OfficeQA Pro2 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
133-question subset · extracted-text sandbox + code · max effort · 5 trials
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Attempts · internal pinned harness · 3 trials · max effort
internal pinned harness · adaptive thinking · max · 108 tasks · 3 trials · Pass@1
internal pinned harness · Pass³ · 3 trials · max effort

General

Science

GPQA Diamond8 results
Source: Epoch AI Benchmarking Hub data
Reasoning effort
Source: OpenRouter benchmark exports · Oct 2026
30 Jun 2026 version · 90-day results
Across 5 providers lowest 85.7% median 87.3% highest 87.5%OpenRouter's automatic routing 85.5%
Show results from 5 providers and OpenRouter's automatic routingHide results from 5 providers and OpenRouter's automatic routing
  • Azure
  • Amazon Bedrock
  • Anthropic
  • Google
  • Claude Platform on AWS
  • OpenRouter's automatic routing
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted
Opus 5.5 System Card · adaptive thinking · max effort unless stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted
Opus 5.5 System Card · adaptive thinking · max effort unless stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted
Opus 5.5 System Card · adaptive thinking · max effort unless stated

Math

ArxivMath3 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
April + May 2026 · extended thinking · 4 attempts/problem
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
USAMO 20262 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
high effort · 300K token limit · 10 attempts per problem
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

Vision

Biomedical image analysisOpus 5.5 System Card · adaptive thinking · max effort unless stated · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
1,000 validation questions · Sonnet 4.6 grader · 5 runs
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini 3.6 Flash Model Card · July 2026 · reasoning
CharXiv-RSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Long context

Safety

PhareSource: Phare

Instruction following

Factuality

Knowledge

Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Opus 5.5 System Card · adaptive thinking · max effort unless stated
overall average · adaptive thinking · max effort · 1 trial
Includeoverall average · adaptive thinking · max effort · 5 trials · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.

OCR

Speech

Other

DeepSWE v1.12 results
Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Datacurve mini-SWE-agent · Pass@1 · max effort
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini 3.6 Flash Model Card · July 2026
HealthBench2 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
length-adjusted · Opus 4.8 grader · no tools · 5 trials
Opus 5.5 System Card · adaptive thinking · max effort unless stated · raw · same Opus 5.5 card setup
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
length-adjusted · Opus 4.8 grader · no tools · 5 trials
Opus 5.5 System Card · adaptive thinking · max effort unless stated · raw · same Opus 5.5 card setup
Source: Clinical Benchmarks data docs · Reported by the model's developer. The source relaying it did not verify it. claim · Jun 2026
Setting not stated
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Horangi36 related benchmarks · 36 results
LatchBio Capabilities v1.011-benchmark live-suite snapshot · equally weighted overall · max effort · Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MentalHealthBench17 related benchmarks · 17 results
Overall
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Acuity · Emergent
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Acuity · High acuity
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Acuity · Non-acute
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Actionable guidance and coping
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Alarmism and under-response
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Show 11 more resultsHide 11 results
Behavior · Collaboration and user agency
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Communication and writing
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Context seeking and assessment
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Empathy and emotional support
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Interpretation and cognitive reframing
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Reality-testing calibration
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Refusals and harm avoidance
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Caregiver
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Clinician
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Layperson
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Teen
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Organic Chemistrysource plots 0.81 · Sonnet 5 system-card suite · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
ProgramBench · Average Pass Rateadaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · 166 golden tasks · mini-swe-agent · no 6-hour timeout · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted
Opus 5.5 System Card · adaptive thinking · max effort unless stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
LatchBio Bioinformatics
Opus 5.5 System Card · adaptive thinking · max effort unless stated
SkillsBench · Vals6 related benchmarks · 6 results
With Skills · Accuracy
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000
With Skills · Mean cost / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000
With Skills · Mean duration / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000
Without Skills · Accuracy
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · Without Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000
Without Skills · Mean cost / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · Without Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000
Without Skills · Mean duration / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · Without Skills · system=anthropic/claude-sonnet-5 · provider=Anthropic · compute_effort=max · temperature=1 · max_output_tokens=128000
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
LatchBio Bioinformatics
Opus 5.5 System Card · adaptive thinking · max effort unless stated
Structural Biologyopen ended · source plots 0.69 · Sonnet 5 system-card suite · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
SWE-Marathon v1.1native provider harnesses · 8 trials/task · resolution rate · max effort · Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Toolathlon VerifiedReported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals12 related benchmarks · 14 results
EMB
Source: Vals AI
LegalBench
Source: Vals AI
MedCode
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Source: Vals AI
Setting not stated
Show 7 more resultsHide 7 results
MedScribe
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Source: Vals AI
Setting not stated

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · LMArena, CC BY 4.0 (licence) · Data by LLM Stats · Bangla LLM Bench, Md Deluair Hossen. Source tasks: Hendrycks et al. 2021 (MMLU), OpenAI MMMLU, Bandarkar et al. 2024 (Belebele), Shi et al. 2023 (MGSM), Nahin et al. 2025 (TituLLMs). Public numeric community results; results licence not separately stated. · Baromètre de l’écriture IA, Johannes Eva; public numeric ranking data, © 2026 Johannes Eva, no results licence stated · BullshitBench by Peter Gostev, MIT (licence) · Clinical Benchmarks (clinicalbenchmarks.ai), CC BY 4.0; fractions converted to percentages; source documents retain their own terms (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · HalluHard: Fan, Delsad, Flammarion and Andriushchenko (EPFL), arXiv:2602.01031 · Horangi 4, Weights & Biases Korea; public publisher-selected numeric evaluation results · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MineBench, MIT (licence) · Outback Yak Research, NepNewsBench v2 research draft. Public numerical aggregates from a candidate preview that the publisher says is not evidence of publication; no release licence assigned and none asserted here. · Steel.dev Agent Leaderboards, MIT (licence) · PashtoBench v1.0, Jawad Noori. Public results/scores numbers; code MIT and data/ CC BY 4.0 grants do not name results/, so no results licence is asserted. · Phare (Giskard), CC BY 4.0 (licence) · UzLiB, Tahrirchi (Abror Shopulatov). Public LEADERBOARD.md numbers; repository MIT covers software and documentation, no separate results licence stated and none asserted.

Around the web

Also known as: aihubmix/claude-sonnet-5, anthropic-claude-5-sonnet, anthropic.claude-sonnet-5, anthropic.claude-sonnet-5-v1, anthropic/claude-sonnet-5, anthropic/claude-sonnet-5-batch, anthropic/claude-sonnet-5:batch, anthropic/claude-sonnet-5:thinking, apac.anthropic.claude-sonnet-5, au.anthropic.claude-sonnet-5, aws-bedrock/claude-sonnet-5, azure_ai/claude-sonnet-5, bedrock/claude-sonnet-5, bedrock/claude-sonnet-5@ap-southeast-2, bedrock/claude-sonnet-5@eu-central-1, bedrock/claude-sonnet-5@eu-north-1, bedrock/claude-sonnet-5@eu-west-1, bedrock/claude-sonnet-5@eu-west-2, bedrock/claude-sonnet-5@us-east-1, bedrock/claude-sonnet-5@us-east-2, bedrock/claude-sonnet-5@us-west-2, bedrock/us-gov-east-1/anthropic.claude-sonnet-5, bedrock/us-gov-west-1/anthropic.claude-sonnet-5, bedrock_mantle/us-gov-west-1/anthropic.claude-sonnet-5, claude sonnet 5, claude-5-sonnet, claude-sonnet-5-high, claude-sonnet-5-search, claude-sonnet-5-thinking, claude-sonnet-5@default, claude-sonnet-5@eu, databricks/databricks-claude-sonnet-5, deepinfra/anthropic/claude-sonnet-5, eu.anthropic.claude-sonnet-5, eu.anthropic.claude-sonnet-5-v1, github_copilot/claude-sonnet-5, global.anthropic.claude-sonnet-5, global.anthropic.claude-sonnet-5-v1, global.anthropic.claude-sonnet-5-v1:0, jp.anthropic.claude-sonnet-5, perplexity/anthropic/claude-sonnet-5, regional.anthropic.claude-sonnet-5-v1:0, replicate/anthropic/claude-sonnet-5, snowflake/claude-sonnet-5, us-gov.anthropic.claude-sonnet-5, us.anthropic.claude-sonnet-5, us.anthropic.claude-sonnet-5-v1, vertex-anthropic/claude-sonnet-5, vertex/claude-sonnet-5, vertex/claude-sonnet-5@eu, vertex/claude-sonnet-5@us, vertex_ai/claude-sonnet-5, vertex_ai/claude-sonnet-5@default

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works