Skip to content

Anthropic · Chat

Claude Sonnet 3.7

Anthropic 🇺🇸ChatClaude familyOne of its sources says the weights aren't publicly available.The maker lists this model as deprecated (13 Nov 2026).

Newer version: Claude Sonnet 5.5. Our catalogue has no release date for Claude Sonnet 3.7. We compared the version names in our catalogue.

llminfo IQ
124.0
Maker's price
$6.00 blended / 1M
Max context
200K
Listings
26

Evidence and sources

llminfo IQ 124.0, ranked among chat models. From 423 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 93.6, 95% interval 85–103. From 14 benchmark families across 13 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedPoor value (39.2). Costs more per task than its benchmark results predict. From 31 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsTypical (49 ±11). Generates about as many tokens as models with similar coding results. Measured at high effort. Little data behind it, so treat it as a rough estimate. By effort: default 45 · high 49.Median 29,055 output tokens per task at high effort.How the Yap score worksMaker HQ: US (according to Anthropic's own website)
Sources: LMArena data, Models.dev data, LiteLLM dataPrimary data from LMArena from Models.dev: name, weights availability from LiteLLM: deprecation date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

Deprecated by its maker

The maker has already deprecated this model (13 Nov 2026).

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 8 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingPrompt cachingPDF inputComputer use

Listings

 Anthropicclaude-3-7-sonnet-latest · latestSource: GenAI Prices data200K$3.00cache read $0.30$15.00cache write $3.75
 Poeanthropic/claude-sonnet-3.7Source: Models.dev data197K$2.60cache read $0.26$13.00cache write $3.20
 Amazon Web ServicesRegions: regionalregional.anthropic.claude-3-7-sonnet-20250219-v1:0 · 20250219Source: GenAI Prices dataNot published by the provider$3.00cache read $0.30$15.00cache write $3.75
 Googleclaude-3-7-sonnetSource: GenAI Prices data200K$3.00cache read $0.30$15.00cache write $3.75
 302aiclaude-3-7-sonnet-20250219 · 20250219Source: 302.ai data200K$3.00cache read $0.30$15.00cache write $3.75
 Flowdotanthropic/claude-3.7-sonnetSource: FlowDot data200K$3.00$15.00
 OpenRouterclaude-3.7-sonnetSource: GenAI Prices dataNot published by the provider$3.00cache read $0.30$15.00cache write $3.75
 Replicatereplicate/anthropic/claude-3.7-sonnetSource: LiteLLM dataNot published by the provider$3.00$15.00
 Vercelanthropic/claude-3-7-sonnetSource: Helicone Costs dataNot published by the provider$3.00$15.00
 Abacusclaude-3-7-sonnet-20250219 · 20250219Source: Models.dev data200K$3.00$15.00
Show all 24 listings

Showing 10 of 24: the maker's own listing first, then the cheapest per 1M input tokens from each provider.

Also sold by DeepInfra, Gradient AI, Snowflake, Vercel AI Gateway.

2 listings without a price are hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Agentic

GAIA4 results
Source: GAIA Leaderboard data · Feb 2025
Difficulty level
Difficulty not reported
tau2-bench v0.112 related benchmarks · 12 results
retail pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
airline pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
retail pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
Show 6 more resultsHide 6 results
retail pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
retail pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^1
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^2
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^3
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14
telecom pass^4
Source: Sierra tau-bench Leaderboard data docs · Jun 2025
submission-claude-3-7-sonnet_anthropic_2024-06-20, usersim-gpt-4.1-2025-04-14

Human preference

Arena ELO33 related benchmarks · 65 results
Source: LMArena data · Nov 2026
Arena ELO
Chinese
Creative Writing
English
Exclude Ties
Expert
Show 53 more resultsHide 53 results
French
German
Hard Prompts
Hard Prompts English
Industry Business and Management and Financial Operations
Industry Entertainment and Sports and Media
Industry Life and Physical and Social Science
Industry Mathematical
Industry Medicine and Healthcare
Industry Software and It Services
Industry Writing and Literature and Language
Japanese
Korean
Longer Query
Multi Turn
Non English
Polish
Russian
Spanish
Style-Controlled
Vision
Vision - Chinese
Vision - Diagram
Vision - English
Vision - Homework
Vision Style-Controlled
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026

Safety

HELM66 related benchmarks · 66 results
Source: Stanford HELM specialized suites data docs
BenchmarkScore
Safety: BBQ - BBQ accuracy
AIR-Bench: AIRBench 2024 - #1: Confidentiality
AIR-Bench: AIRBench 2024 - #2: Integrity
AIR-Bench: AIRBench 2024 - #3: Availability
Show 62 more benchmarksHide 62 benchmarks
BenchmarkScore
AIR-Bench: AIRBench 2024 - #4: Automated Decision-Making
AIR-Bench: AIRBench 2024 - #5: Autonomous Unsafe Operation of Systems
AIR-Bench: AIRBench 2024 - #6: Advice in Heavily Regulated Industries
AIR-Bench: AIRBench 2024 - #7: Supporting Malicious Organized Groups
AIR-Bench: AIRBench 2024 - #8: Celebrating Suffering
AIR-Bench: AIRBench 2024 - #9: Violent acts
AIR-Bench: AIRBench 2024 - #10: Depicting Violence
AIR-Bench: AIRBench 2024 - #11: Weapon Usage & Development
AIR-Bench: AIRBench 2024 - #12: Military and Warfare
AIR-Bench: AIRBench 2024 - #13: Harassment
AIR-Bench: AIRBench 2024 - #15: Perpetuating Harmful Beliefs
AIR-Bench: AIRBench 2024 - #16: Offensive Language
AIR-Bench: AIRBench 2024 - #17: Adult content
AIR-Bench: AIRBench 2024 - #18: Erotic
AIR-Bench: AIRBench 2024 - #19: Non-Consensual Nudity
AIR-Bench: AIRBench 2024 - #20: Monetized
AIR-Bench: AIRBench 2024 - #21: Endangerment, Harm, or Abuse of Children
AIR-Bench: AIRBench 2024 - #22: Child Sexual Abuse
AIR-Bench: AIRBench 2024 - #23: Suicidal and non-suicidal self Injury
AIR-Bench: AIRBench 2024 - #24: Political Persuasion
AIR-Bench: AIRBench 2024 - #25: Influencing Politics
AIR-Bench: AIRBench 2024 - #26: Deterring Democratic Participation
AIR-Bench: AIRBench 2024 - #27: Disrupting Social Order (China-unique)
AIR-Bench: AIRBench 2024 - #28: High-Risk Financial Activities
AIR-Bench: AIRBench 2024 - #29: Unfair Market Practices
AIR-Bench: AIRBench 2024 - #30: Disempowering Workers
AIR-Bench: AIRBench 2024 - #31: Fraudulent Schemes
AIR-Bench: AIRBench 2024 - #32: Fraud
AIR-Bench: AIRBench 2024 - #33: Academic dishonesty
AIR-Bench: AIRBench 2024 - #34: Mis/disinformation
AIR-Bench: AIRBench 2024 - #35: Sowing Division
AIR-Bench: AIRBench 2024 - #36: Misrepresentation
AIR-Bench: AIRBench 2024 - #37: Types of Defamation
AIR-Bench: AIRBench 2024 - #38: Specific Types of Rights
AIR-Bench: AIRBench 2024 - #39-40: Discrimination/Protected Characteristics Combinations
AIR-Bench: AIRBench 2024 - #41-42: Privacy Violations/Sensitive Data Combinations
AIR-Bench: AIRBench 2024 - #43: Illegal/Regulated substances/goods
AIR-Bench: AIRBench 2024 - #44: Illegal services/exploitation
AIR-Bench: AIRBench 2024 - #45: Other Illegal/Unlawful/Criminal Activities
AIR-Bench: AIRBench 2024 - Child Harm
AIR-Bench: AIRBench 2024 - Criminal Activities
AIR-Bench: AIRBench 2024 - Deception
AIR-Bench: AIRBench 2024 - Defamation
AIR-Bench: AIRBench 2024 - Discrimination/Bias
AIR-Bench: AIRBench 2024 - Economic Harm
AIR-Bench: AIRBench 2024 - Fundamental Rights
AIR-Bench: AIRBench 2024 - Hate/Toxicity
AIR-Bench: AIRBench 2024 - Manipulation
AIR-Bench: AIRBench 2024 - Operational Misuses
AIR-Bench: AIRBench 2024 - Political Usage
AIR-Bench: AIRBench 2024 - Privacy
AIR-Bench: AIRBench 2024 - Refusal Rate
AIR-Bench: AIRBench 2024 - Security Risks
AIR-Bench: AIRBench 2024 - Self-harm
AIR-Bench: AIRBench 2024 - Sexual Content
AIR-Bench: AIRBench 2024 - Violence & Extremism
Safety: Anthropic Red Team - LM Evaluated Safety score
Safety: BBQ - BBQ (ambiguous)
Safety: BBQ - BBQ (unambiguous)
Safety: HarmBench - LM Evaluated Safety score
Safety: SimpleSafetyTests - LM Evaluated Safety score
Safety: XSTest - LM Evaluated Safety score
PhareSource: Phare

Coding

Multi-SWE-bench10 related benchmarks · 28 results
C Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
C++ Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
Flash All Verified
Source: Multi-SWE-bench Experiments data docs · Jul 2025
MopenHands, 20250712_MopenHands_Claude-3.7-Sonnet
Go Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
Java Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
JavaScript Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
Show 12 more resultsHide 12 results
Lite All Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
Python Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_Agentless_Claude-3.7-Sonnet
MopenHands, 20250329_OpenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_SWE-agent_Claude-3.7-Sonnet
Rust Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
TypeScript Verified
Source: Multi-SWE-bench Experiments data docs · Mar 2025
MagentLess, 20250329_MagentLess_Claude-3.7-Sonnet
MopenHands, 20250329_MopenHands_Claude-3.7-Sonnet
MSWE-agent, 20250329_MSWE-agent_Claude-3.7-Sonnet
SWE-bench Verified6 related benchmarks · 9 results
SWE-bench Verified
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
SWE-bench-Live Full
Source: SWE-bench-Live leaderboard data · May 2025
By scaffold · set: full · instances: 1319
SWE-bench-Live Lite
Source: SWE-bench-Live leaderboard data · May 2025
By scaffold · set: lite · instances: 300

Reasoning

Multilingual

MMMLUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
SeaLLMs16 related benchmarks · 16 results
Show 10 more resultsHide 10 results

Math

AIME 2025Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
MATH-500Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
ValsSource: Vals AI

Long context

General

Spatialviz BenchSource: Epoch AI Benchmarking Hub data

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Vision

MMMUSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

OCR

Factuality

FaithJudge Hallucination RateSource: FaithJudge data

Instruction following

IFEvalSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim

Knowledge

Speech

Other

ArmBench-LLM Armenian22 related benchmarks · 22 results
MedHELM33 related benchmarks · 33 results
Nejumi 428 related benchmarks · 56 results
ALT_バイアス
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
ALT_倫理・道徳
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
ALT_制御性
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
ALT_堅牢性
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
ALT_毒性
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
ALT_真実性
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
Show 44 more resultsHide 44 results
AVG_jaster_0shot
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
AVG_jaster_2shots
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_アプリケーション開発
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_コーディング
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_一般的知識
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_基礎的言語性能
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_専門的知識
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_応用的言語性能
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_情報検索
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_意味解析
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_抽象的推論
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_推論能力
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_数学的推論
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_構文解析
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_知識・質問応答
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_翻訳
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_表現
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_論理的推論
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
GLP_関数呼び出し
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
TOTAL_SCORE
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
アラインメント(ALT)_AVG
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
汎用的言語性能(GLP)_AVG
Source: Nejumi Leaderboard 4 data docs
anthropic/claude-3.7-sonnet-20250219: no-thinking
anthropic/claude-3.7-sonnet-20250219: extended-thinking
ValsSource: Vals AI

Data credits: Steel.dev Agent Leaderboards, MIT (licence) · AgentDojo. Copyright (c) 2024 Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. MIT License. Not a leaderboard: attack and defense coverage differs between models. (licence) · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Data by LLM Stats · LMArena, CC BY 4.0 (licence) · ArmBench-LLM by Metric-AI. Public numeric primary task results; no separate results licence asserted. · ArtifactsBench (Tencent Hunyuan), CC BY 4.0 (licence) · BrowserGym Leaderboard (ServiceNow), MIT (licence) · BullshitBench by Peter Gostev, MIT (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · CharXiv (Wang et al., NeurIPS 2024), Princeton NLP. https://charxiv.github.io · CyBench — cite Zhang et al. 2025 · CyberGym leaderboard (Wang, Shi, He, Cai, Zhang, Song; UC Berkeley), ICLR 2026. Results evaluated and submitted by the listed teams. No licence is stated for the result data; the repository's Apache-2.0 licence covers its code only. · DABstep (Adyen), CC BY 4.0 (licence) · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · FaithJudge, Vectara; Tamber et al., EMNLP 2025 Industry. Public numeric README leaderboard; results licence not separately established. · HAL (Princeton) — cite the HAL paper · Stanford HELM (Stanford CRFM); scenario scores from Capabilities, Safety, Long Context, MedHELM, AIR-Bench, MMLU and Finance · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · Multi-SWE-bench experiments (multi-swe-bench/experiments), Apache-2.0; resolved-rate fractions converted to percentages (licence) · Nejumi Leaderboard 4, Weights & Biases Japan; public publisher-selected numeric evaluation results · Online-Mind2Web Leaderboard (OSU NLP), Apache-2.0 (licence) · Orak leaderboard, KRAFTON AI (Park et al., NeurIPS 2025). Public numeric scores; leaderboard licence not stated (code MIT not applied; CC BY-NC trajectories not used). · Phare (Giskard), CC BY 4.0 (licence) · Haq et al., PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language, arXiv:2505.10055v2, CC BY 4.0. Scores extracted from Tables 3-5. (licence) · Trishul Lab, PutnamBench public submitted results. Model identities and scaffold budgets preserved; result licence unstated. · SeaExam and SeaBench leaderboard, SeaLLMs (DAMO-NLP-SG). Published leaderboard scores; results licence not stated. · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · SWE-bench-Live (Microsoft and contributors), swe-bench-live.github.io. Resolve rates computed from the published report counts. · SWE-fficiency (swefficiency.com) leaderboard materials, CC BY 4.0; Human Expert reference row omitted (licence) · Sierra Research tau2-bench leaderboard submissions (github.com/sierra-research/tau2-bench), MIT (licence) · UzLiB, Tahrirchi (Abror Shopulatov). Public LEADERBOARD.md numbers; repository MIT covers software and documentation, no separate results licence stated and none asserted. · VideoGameBench, Alex L. Zhang, Thomas L. Griffiths, Karthik R. Narasimhan, Ofir Press. Public numeric scores; site licence not stated (code MIT not applied; games excluded).

Around the web

Also known as: anthropic.claude-3-7-sonnet-20240620-v1:0, anthropic.claude-3-7-sonnet-20250219-v1:0, anthropic/claude-3-7-sonnet, anthropic/claude-3.7-sonnet, anthropic/claude-3.7-sonnet:thinking, anthropic/claude-sonnet-3.7, bedrock/us-gov-east-1/anthropic.claude-3-7-sonnet-20250219-v1:0, bedrock/us-gov-west-1/anthropic.claude-3-7-sonnet-20250219-v1:0, claude-3-7-sonnet, claude-3-7-sonnet-20250219, claude-3-7-sonnet-latest, claude-3.7-sonnet, claude-3.7-sonnet-20250219, claude-3.7-sonnet-thinking-32k-20250219, deepinfra/anthropic/claude-3-7-sonnet-latest, eu.anthropic.claude-3-7-sonnet-20250219-v1:0, gradient_ai/anthropic-claude-3.7-sonnet, heroku/claude-3-7-sonnet, regional.anthropic.claude-3-7-sonnet-20250219-v1:0, replicate/anthropic/claude-3.7-sonnet, snowflake/claude-3-7-sonnet, us.anthropic.claude-3-7-sonnet-20250219-v1:0, vercel_ai_gateway/anthropic/claude-3-7-sonnet, vercel_ai_gateway/anthropic/claude-3.7-sonnet

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works