Skip to content

OpenAI · Chat

GPT-6 Astra

OpenAI 🇺🇸ChatGPT familyOne of its sources says the weights aren't publicly available.The maker currently lists 11 Jan 2028 as the deprecation date. Plans can change.

Newer version: GPT-6.2 Astra. We compared release dates and version names in our catalogue.

From Neosantara's listing:
GPT-6 Astra is OpenAI's flagship frontier reasoning and autonomous agent model featuring deep analytical planning, advanced coding, and a 1M token context window.
llminfo IQ
147.2
Maker's price
$20.00 blended / 1M
Max context
1.1M
Listings
118

Evidence and sources

llminfo IQ 147.2, ranked among chat models. From 338 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 138.9, 95% interval 133–145. From 16 benchmark families across 10 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedGood value (62.1). Cheaper per task than its benchmark results predict. From 61 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsTerse (37 ±8). Generates fewer tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it. By effort: default 47 · low 26 · medium 30 · high 34 · max 37.Median 30,144 output tokens per task at max effort.How the Yap score worksReleased 3 Sep 2026Maker HQ: US (according to OpenAI's own website)
All rankings: #17 in Hacker News discussions this week #53 on OpenRouter this month #61 on OpenRouter this week #69 on OpenRouter today #181 on NanoGPT recentlyAll rankings: #17 in Hacker News discussions this week #53 on OpenRouter this month #61 on OpenRouter this week #69 on OpenRouter today #181 on NanoGPT recentlySources: OpenAI API data, Writer Pricing, LiteLLM data, Models.dev data, AI/ML API data, Neosantara Inference data, llminfo researchPrimary data from OpenAI API from Writer Pricing: name, variant from LiteLLM: deprecation date from Models.dev: weights availability from AI/ML API: primary mode from Neosantara Inference: description from llminfo research: release date
Tags from its sources:instructreasoningtoolsvisiondocument

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Trade-offs

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 06:07 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 9 maker's prices; 1 market median price.

Input & output

as stated by the model's providers
Text
Images
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputComputer useWeb searchBatch API

Listings

 OpenAIgpt-6-astraSources: LiteLLM data, Models.dev data, OpenAI API data922K$10.00cache read $1.00batch $5.00$50.00cache write $12.50batch $25.00——
 Xxapigpt-6-astraSource: Models.dev data1.1M$0.6154cache read $0.0615$3.077cache write $0.7692——
 Jzstokengpt-6-astraSource: Models.dev data1.1M$1.17cache read $0.1168$7.01cache write $1.75——
 Aigrowgpt-6-astraSource: Models.dev data1.1M$2.50cache read $0.25$12.50cache write $3.125——
 Uplinkswitchgpt-6-astraSource: Models.dev data1.1M$3.00cache read $0.30$15.00——
 Teapot Routergpt-6-astraSource: Models.dev data1.1M$3.50$17.50——
 Koroutergpt-6-astraSource: Models.dev data1.1M$3.70cache read $0.37$18.50cache write $4.63——
 Kunavogpt-6-astraSource: Models.dev data1.1M$4.00cache read $0.40$20.00cache write $5.00——
 Nous Portalopenai/gpt-6-astra:batch · batchSource: Nous Portal Inference Gateway data1.1M$5.00cache read $0.50$25.00cache write $6.25——
 OpenRouterInference by OpenAIopenai/gpt-6-astra · flexSource: OpenRouter data docs922K$5.00cache read $0.50$25.00cache write $6.25573,122ms

15 listings without a price are hidden.

Included in plans

Copilot EnterprisegithubSubscription$39/moextra use billed past the allowancePlan page
Copilot Pro+githubSubscription$39/moextra use billed past the allowancePlan page
Copilot BusinessgithubSubscription$19/moextra use billed past the allowancePlan page
Copilot MaxgithubSubscription$100/moextra use billed past the allowancePlan page
ChatGPT PlusOpenAISubscription$20/moPlan page
ChatGPT ProOpenAISubscription$100/moPlan page

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Agentic

Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort
OpenAI launch table · highest published effort
Arena AgentSource: LMArena data
BrowseComp2 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026
OSWorld3 related benchmarks · 13 results
2.0 · Partial
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort · OSWorld 2.0 offline set · v2026.08.08 · partial reward · OpenAI release chart
Reasoning effort · OSWorld 2.0 offline v2026.08.08
v2026.08.08 · offline set · partial score
OSWorld 2.0
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Source: OpenRouter benchmark exports · Oct 2026
3 Sep 2026 version (gpt-6-astra) · 90-day results
Across 3 providers lowest 67.6% median 67.7% highest 69.7%OpenRouter's automatic routing 68%
Show results from 3 providers and OpenRouter's automatic routingHide results from 3 providers and OpenRouter's automatic routing
  • Azure
  • OpenRouter's automatic routing
  • OpenAI
  • Amazon Bedrock
3 Sep 2026 version (gpt-6-astra-pro) · 90-day results · pro
Across 2 providers lowest 69% median 69.8% highest 70.7%OpenRouter's automatic routing 72.7%
Show results from 2 providers and OpenRouter's automatic routingHide results from 2 providers and OpenRouter's automatic routing
  • OpenRouter's automatic routing
  • OpenAI
  • Azure
Terminal-Bench 4.03 related benchmarks · 24 results
Terminal-Bench 4.0
Reported by Terminal-Bench / Stanford / Harbor / Laude Institute · via BenchBoard docs
Reasoning effort · Terminal-Bench 4.0 official leaderboard · Codex
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · public leaderboard · Codex CLI · max
Opus 5.5 System Card capability section · Codex · high effort · OpenAI-reported
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort · Code
Code · high effort · chart displays 57.9% (raw 57.8788%)
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Terminal-Bench Science 0.1
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort · Terminal-Bench Science 0.1 · OpenAI release chart
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Opus 5.5 System Card capability section · OpenAI-reported · max effort
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

Human preference

Arena ELO61 related benchmarks · 61 results
Source: LMArena data · Nov 2026
BenchmarkMax
Arena ELO
Chinese
Creative Writing
Document
Show 57 more benchmarksHide 57 benchmarks
BenchmarkMax
Document Style-Controlled
English
Exclude Ties
Expert
French
German
Hard Prompts
Hard Prompts English
Industry Business and Management and Financial Operations
Industry Entertainment and Sports and Media
Industry Life and Physical and Social Science
Industry Mathematical
Industry Medicine and Healthcare
Industry Software and It Services
Industry Writing and Literature and Language
Japanese
Korean
Longer Query
Multi Turn
Non English
Polish
Russian
Search Factuality
Search Style-Controlled
Spanish
Style-Controlled
Text Factuality
Text Factuality - Chinese
Text Factuality - Creative Writing
Text Factuality - English
Text Factuality - Exclude Ties
Text Factuality - Expert
Text Factuality - Hard Prompts
Text Factuality - Hard Prompts English
Text Factuality - Industry Business and Management and Financial Operations
Text Factuality - Industry Entertainment and Sports and Media
Text Factuality - Industry Life and Physical and Social Science
Text Factuality - Industry Mathematical
Text Factuality - Industry Medicine and Healthcare
Text Factuality - Industry Software and It Services
Text Factuality - Industry Writing and Literature and Language
Text Factuality - Longer Query
Text Factuality - Multi Turn
Text Factuality - Non English
Text Factuality - Russian
Text Factuality - Spanish
Vision
Vision - Chinese
Vision - Creative Writing Vision
Vision - Diagram
Vision - English
Vision - Homework
Vision - Humor
Vision Style-Controlled
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026

Coding

Arena ELOSource: LMArena data · Nov 2026
BenchCADOpenAI launch table · Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
ExploitBench2 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
FrontierCode 1.13 related benchmarks · 12 results
FrontierCode 1.1
Source: FrontierCode data
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Extended
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Opus 5.5 System Card capability section · best reported effort
Main
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Opus 5.5 System Card capability section · best reported effort
FrontierSWE v2Opus 5.5 System Card capability section · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
SEC-Bench Pro2 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
ValsSource: Vals AI

Reasoning

ARC-AGI5 related benchmarks · 18 results
ARC-AGI
Source: Epoch AI Benchmarking Hub data
Reasoning effort
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
ARC-AGI 2
Source: Epoch AI Benchmarking Hub data
Reasoning effort
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
ARC-AGI-1
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
ARC-AGI-3
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
v2
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
AutomationBench12 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort · AutomationBench v1.0.6 · 47 tools · OpenAI release chart
Reasoning effort
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
GeneBench Pro2 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Opus 5.5 System Card capability section · with tools · provider-reported
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
LifeSciBench2 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

General

Science

GPQASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GPQA Diamond10 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Source: OpenRouter benchmark exports · Oct 2026
3 Sep 2026 version (gpt-6-astra) · 90-day results
Across 3 providers lowest 94.3% median 94.6% highest 94.7%OpenRouter's automatic routing 94.4%
Show results from 3 providers and OpenRouter's automatic routingHide results from 3 providers and OpenRouter's automatic routing
  • OpenAI
  • Amazon Bedrock
  • OpenRouter's automatic routing
  • Azure
3 Sep 2026 version (gpt-6-astra-pro) · 90-day results · pro
Across 2 providers lowest 94.9% median 95% highest 95.1%OpenRouter's automatic routing 95.5%
Show results from 2 providers and OpenRouter's automatic routingHide results from 2 providers and OpenRouter's automatic routing
  • OpenRouter's automatic routing
  • OpenAI
  • Azure
MedChemBenchinternal · weighted score · Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
ValsSource: Vals AI

Math

ArxivMath · With toolsOpus 5.5 System Card capability section · MathArena vendor harness · max · 2 attempts/problem · LLM judge · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Frontiermath Erdos3 related benchmarks · 10 results
FrontierMath Tier 4 (v2)
Source: Epoch AI Benchmarking Hub data
Reasoning effort
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
v2 · GPT-6 Astra launch snapshot · 2026-09-01
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

Multilingual

Benchmark Nusantara7 related benchmarks · 7 results
Show 1 more resultHide 1 result
EKI EstonianSource: Keelemudelite mõõdupuu data docs · Sep 2026

Factuality

Vision

Biomedical image analysisOpus 5.5 System Card · adaptive thinking · max effort unless stated · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

Instruction following

Long context

OCR

Speech

Other

Artificial Analysis8 related benchmarks · 14 results
Intelligence Index
Source: OpenRouter data docs
Setting not stated
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort · v4.3
Artificial Analysis Intelligence Index v4.1.1
Show 2 more resultsHide 2 results
BlenderWorld15 related benchmarks · 15 results
Art & Animation
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 30 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Architecture & Interiors
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 72 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Characters & Animals
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 25 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Fully satisfied rubric
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Image/video-input overall score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 145 image or video reference tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Nature & Landscapes
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 21 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Show 9 more resultsHide 9 results
Overall score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Procedural & Game Assets
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 10 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Products & Manufacturing
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 28 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Rendering & Simulation
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 17 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Science & Visualization
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 9 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Text-only overall score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 78 text-only tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Vehicles & Machinery
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 11 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Visual-quality dimension score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Weighted rubric score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
DeepSWE v1.112 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reasoning effort · DeepSWE v1.1 · OpenAI release chart
Reasoning effort
OpenAI launch table
rounded prose result
Dense200Mistral-reported comparison · Reported by Mistral AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
EEBenchAtopile · provider harnesses · reward · max effort · Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Flagged-conversation factual error rate · Lower Is BetterReasoning effort · de-identified ChatGPT conversations flagged for prior factual errors · share of answers with any factual error · OpenAI release chart · Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
GDP.pdf · OpenAI chart scoreReasoning effort · GDP.pdf professional PDF tasks · OpenAI release chart · Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
HealthBench Hardlength-adjusted, max reasoning effort (37.8 unadjusted, 2,192 mean response chars), GPT-6 Astra system card Table 6, column 'gpt-6 Astra'. · Source: HealthBench Hard (Arcophos) data docs · Reported by the model's developer. The source relaying it did not verify it. · Sep 2026
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
length-adjusted score · rejected requests scored zero · max effort
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Source: Clinical Benchmarks data docs · Reported by the model's developer. The source relaying it did not verify it. claim · Sep 2026
Setting not stated
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
LatchBio Capabilities v1.011-benchmark live-suite snapshot · equally weighted overall · max effort · Reported by SpaceXAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MentalHealthBench17 related benchmarks · 17 results
Overall
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Acuity · Emergent
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Acuity · High acuity
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Acuity · Non-acute
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Actionable guidance and coping
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Alarmism and under-response
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Show 11 more resultsHide 11 results
Behavior · Collaboration and user agency
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Communication and writing
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Context seeking and assessment
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Empathy and emotional support
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Interpretation and cognitive reframing
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Reality-testing calibration
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
Behavior · Refusals and harm avoidance
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
User profile · Caregiver
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
User profile · Clinician
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
User profile · Layperson
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
User profile · Teen
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI evaluation · 95% CI available on source page
MultiLangBench5 related benchmarks · 5 results
COBOL test pass rate
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI publication · SQLite 3.40.1 from scratch · COBOL · maximum reasoning effort · 272-test recommended subset in public harness; exact publication test selection and API snapshot not stated
20-language average test pass rate
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI publication · SQLite 3.40.1 from scratch · 20-language average · maximum reasoning effort · 272-test recommended subset in public harness; exact publication test selection and API snapshot not stated
Fortran test pass rate
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI publication · SQLite 3.40.1 from scratch · Fortran · maximum reasoning effort · 272-test recommended subset in public harness; exact publication test selection and API snapshot not stated
OCaml test pass rate
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI publication · SQLite 3.40.1 from scratch · OCaml · maximum reasoning effort · 272-test recommended subset in public harness; exact publication test selection and API snapshot not stated
Visual Basic test pass rate
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI publication · SQLite 3.40.1 from scratch · Visual Basic · maximum reasoning effort · 272-test recommended subset in public harness; exact publication test selection and API snapshot not stated
OpenAI InternalReported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Protocol TroubleshootingOpus 5.5 System Card · adaptive thinking · max effort unless stated · Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
RecreationBench paper26 related benchmarks · 26 results
Web · Visual assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Web · nominal 50-task split · platform-specific score
Android · Applications with Prog =100%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score
Android · Applications with Prog ≥90%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score
Android · Programmatic assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score
Android · Visual assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Android · nominal 50-task split · platform-specific score
macOS · Applications with Prog =100%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · macOS · nominal 50-task split · platform-specific score
Show 20 more resultsHide 20 results
macOS · Applications with Prog ≥90%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · macOS · nominal 50-task split · platform-specific score
macOS · Programmatic assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · macOS · nominal 50-task split · platform-specific score
macOS · Visual assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · macOS · nominal 50-task split · platform-specific score
Overall · Applications with Prog =100%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Overall · 250 held-out tasks · equal-weight platform macro average
Overall · Applications with Prog ≥90%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Overall · 250 held-out tasks · equal-weight platform macro average
Overall · Estimated API cost per task
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · estimated mean API cost per task · 90% cache reads assumed
Overall · Programmatic + visual mean
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Overall · 250 held-out tasks · equal-weight platform macro average
Overall · Programmatic assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Overall · 250 held-out tasks · equal-weight platform macro average
Overall · Visual assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Overall · 250 held-out tasks · equal-weight platform macro average
Ubuntu · Applications with Prog =100%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Ubuntu · nominal 50-task split · platform-specific score
Ubuntu · Applications with Prog ≥90%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Ubuntu · nominal 50-task split · platform-specific score
Ubuntu · Programmatic assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Ubuntu · nominal 50-task split · platform-specific score
Ubuntu · Visual assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Ubuntu · nominal 50-task split · platform-specific score
Web · Applications with Prog =100%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Web · nominal 50-task split · platform-specific score
Web · Applications with Prog ≥90%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Web · nominal 50-task split · platform-specific score
Web · Programmatic assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Web · nominal 50-task split · platform-specific score
Windows · Applications with Prog =100%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score
Windows · Applications with Prog ≥90%
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score
Windows · Programmatic assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score
Windows · Visual assertion score
Reported by QwenLM / RecreationWorld authors · via BenchBoard docs
RecreationWorld benchmark-owner paper run · 250 held-out tasks · GUI exploration + coding tools + visual verification · max reasoning effort per site data · 272k context · 128k max output tokens · Windows · nominal 50-task split · platform-specific score
Vals15 related benchmarks · 17 results
Show 11 more resultsHide 11 results
Immigration
Source: Vals AI
MedCode
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Source: Vals AI
Setting not stated
MedScribe
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Source: Vals AI
Setting not stated
SRE Bench
Source: Vals AI

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · Data by LLM Stats · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Clinical Benchmarks (clinicalbenchmarks.ai), CC BY 4.0; fractions converted to percentages; source documents retain their own terms (licence) · LMArena, CC BY 4.0 (licence) · Baromètre de l’écriture IA, Johannes Eva; public numeric ranking data, © 2026 Johannes Eva, no results licence stated · Benchmark Nusantara, ibahasa (M. Khoirul Huda), doi:10.5281/zenodo.21970463. Test results CC BY 4.0, attribution to ibahasa; aggregate results CSV only. (licence) · BullshitBench by Peter Gostev, MIT (licence) · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · Deep20Bench edition 1.1, Patrick Heusser. Results CC BY 4.0; native question scores and fraction-to-percent success rates. (licence) · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · ExploitGym leaderboard (Wang et al., UC Berkeley), arXiv:2605.11086. No licence is stated for the result data; the repository's Apache-2.0 licence covers its code only, and task data keeps its upstream licences. Literal exploit counts; hidden rows omitted. · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · HalluHard: Fan, Delsad, Flammarion and Andriushchenko (EPFL), arXiv:2602.01031 · Arcophos. HealthBench Hard Leaderboard. https://healthbenchhard.ai. CC BY 4.0. Source document linked on each result. (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MineBench, MIT (licence) · Steel.dev Agent Leaderboards, MIT (licence) · SnakeBench (Greg Kamradt / ARC Prize Foundation), MIT (licence) · Vectara Hallucination Leaderboard, Apache-2.0 (licence) · WeirdML v3 by Håvard Tveit Ihle (Norwegian Defence Research Establishment). API costs supported by Epoch AI, METR and NDRE.

Around the web

Also known as: aws-mantle/gpt-6-astra, azure/eu/gpt-6-astra, azure/gpt-6-astra, azure/gpt-6-astra-2026-09-03, azure/us/gpt-6-astra, azure_ai/gpt-6-astra, bedrock_mantle/openai.gpt-6-astra, chatgpt/gpt-6-astra, databricks/databricks-gpt-6-astra, eu.openai.gpt-6-astra, github_copilot/gpt-6-astra, global.openai.gpt-6-astra, gmi/openai/gpt-6-astra, gpt-6 astra, gpt-6 astra pro, gpt-6-astra-2026-09-03, gpt-6-astra-max, gpt-6-astra-pro, openai-gpt-6-astra, openai-gpt-6-astra-pro, openai.gpt-6-astra, openai/gpt-6-astra, openai/gpt-6-astra-batch, openai/gpt-6-astra-fast, openai/gpt-6-astra-flex, openai/gpt-6-astra-pro, openai/gpt-6-astra-pro-fast, openai/gpt-6-astra-pro-flex, openai/gpt-6-astra-pro:batch, openai/gpt-6-astra:batch, perplexity/openai/gpt-6-astra, us.openai.gpt-6-astra

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works