Skip to content

Google · Chat

Gemini 3.8 Flash

Google 🇺🇸ChatGemini familyOne of its sources says the weights aren't publicly available.The maker currently plans to deprecate it within the next 180 days (14 Dec 2026). Plans can change.
From Neosantara's listing:
The latest iteration in the Gemini 3 model family, featuring advanced multimodal capabilities and dynamic thinking budget control for coding, analysis, and conversational tasks.
llminfo IQ
139.6
Maker's price
$1.50 blended / 1M
Max context
1M
Listings
76

Evidence and sources

llminfo IQ 139.6, ranked among chat models. From 325 benchmarks. Plenty of data behind it.How llminfo IQ is computedCoding IQ 121.0, 95% interval 113–129. From 22 benchmark families across 10 sources. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.How Coding IQ is computedGood value (55.0). Cheaper per task than its benchmark results predict. From 70 benchmarks with measured task costs. Plenty of data behind it.How Value for money worksYap score: tokens used per coding task vs. models with the same resultsChatty (64 ±10). Generates more tokens than models with similar coding results. Measured at high effort. A fair amount of data behind it. By effort: default 52 · medium 63 · high 64.Median 143,243 output tokens per task at high effort.How the Yap score worksReleased 2 Sep 2026Maker HQ: US (according to Google's own website)
All rankings: #19 on OpenRouter this month #21 on OpenRouter today #25 on OpenRouter this week #60 on NanoGPT recentlySources: Google Generative AI API data docs, Writer Pricing, LiteLLM data, Models.dev data, AI/ML API data, Neosantara Inference data, llminfo researchPrimary data from Google Generative AI API from Writer Pricing: variant from LiteLLM: deprecation date from Models.dev: weights availability from AI/ML API: primary mode from Neosantara Inference: description from llminfo research: release date
Tags from its sources:instructtoolsvisionreasoningaudiodocument

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Advantages

Trade-offs

Deprecation scheduled

The maker plans to deprecate it on 14 Dec 2026, within the next 180 days.

No open weights

The weights aren't public, so you can't run it yourself.

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.

Input & output

as stated by the model's providers
Text
Images
Audio
Video
Files
Text

Capabilities

Supported operations and provider-stated features

VisionReasoningFunction callingStructured outputPrompt cachingPDF inputComputer useWeb searchAudio inputBatch API

Listings

 Googlemodels/gemini-3.8-flashSources: Google Generative AI API data docs, Google Vertex AI Pricing, LiteLLM data, Models.dev data1M$0.75>200k $0.75cache read $0.075batch $0.375$3.75>200k $3.75batch $1.875———
 Kenarigemini-3-8-flashSource: Models.dev data1M$0.3429cache read $0.0343$1.71———
 Nous Portalgoogle/gemini-3.8-flash:batch · batchSource: Nous Portal Inference Gateway data1M$0.375cache read $0.0375$1.875$0.375—$0.00000038
 OpenRouterInference by Googlegoogle/gemini-3.8-flash:batch · batch, globalSource: OpenRouter data docs1M$0.375cache read $0.0375$1.875$0.375$0.0375$0.00000038
 Uplinkswitchgemini-3.8-flashSource: Models.dev data1M$0.4925cache read $0.0493$2.25———
 Iteracomputegemini/gemini-3.8-flashSource: Models.dev data1M$0.60cache read $0.06$3.00———
 Tokenmixgemini-3.8-flashSources: TokenMix data, TokenMix PricingNot published by the provider$0.7275$3.6375———
 Databricksdatabricks/databricks-gemini-3-8-flashSource: LiteLLM data1M$0.75cache read $0.075$3.75cache write $0.75———
 302aigemini-3.8-flashSource: Models.dev data1M$0.75cache read $0.075$3.75———
 Aihubmixgemini-3.8-flashSource: AIHubMix data docs1M$0.75cache read $0.075$3.75———

12 listings without a price are hidden.

Included in plans

Copilot EnterprisegithubSubscription$39/moextra use billed past the allowancePlan page
Copilot ProgithubSubscription$10/moextra use billed past the allowancePlan page
Copilot Pro+githubSubscription$39/moextra use billed past the allowancePlan page
Copilot BusinessgithubSubscription$19/moextra use billed past the allowancePlan page
Copilot MaxgithubSubscription$100/moextra use billed past the allowancePlan page

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Human preference

Arena ELO62 related benchmarks · 62 results
Source: LMArena data · Nov 2026
BenchmarkHigh
Arena ELO
Chinese
Creative Writing
Document
Show 58 more benchmarksHide 58 benchmarks
BenchmarkHigh
Document Style-Controlled
English
Exclude Ties
Expert
French
German
Hard Prompts
Hard Prompts English
Industry Business and Management and Financial Operations
Industry Entertainment and Sports and Media
Industry Life and Physical and Social Science
Industry Mathematical
Industry Medicine and Healthcare
Industry Software and It Services
Industry Writing and Literature and Language
Japanese
Korean
Longer Query
Multi Turn
Non English
Polish
Russian
Spanish
Style-Controlled
Text Factuality
Text Factuality - Chinese
Text Factuality - Creative Writing
Text Factuality - English
Text Factuality - Exclude Ties
Text Factuality - Expert
Text Factuality - French
Text Factuality - Hard Prompts
Text Factuality - Hard Prompts English
Text Factuality - Industry Business and Management and Financial Operations
Text Factuality - Industry Entertainment and Sports and Media
Text Factuality - Industry Life and Physical and Social Science
Text Factuality - Industry Mathematical
Text Factuality - Industry Medicine and Healthcare
Text Factuality - Industry Software and It Services
Text Factuality - Industry Writing and Literature and Language
Text Factuality - Japanese
Text Factuality - Korean
Text Factuality - Longer Query
Text Factuality - Multi Turn
Text Factuality - Non English
Text Factuality - Polish
Text Factuality - Russian
Text Factuality - Spanish
Vision
Vision - Chinese
Vision - Creative Writing Vision
Vision - Diagram
Vision - English
Vision - Homework
Vision - Humor
Vision Style-Controlled
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026

Multilingual

Bangla LLM BenchSource: Bangla LLM Bench data docs
EKI EstonianSource: Keelemudelite mõõdupuu data docs · Sep 2026
NepNewsBench v2 draft40 related benchmarks · 40 results
entity F1 (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
core fact recall (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
core fact recall (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
core fact recall (mixed English and Nepali source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
core fact recall (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
coverage precision proxy (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
Show 34 more resultsHide 34 results
coverage precision proxy (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
coverage precision proxy (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
effective score (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
effective score (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
effective score (mixed English and Nepali source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
effective score (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
English prose quality (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
English prose quality (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
English prose quality (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity F1 (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity F1 (mixed English and Nepali source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity F1 (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity precision (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity precision (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity precision (mixed English and Nepali source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity precision (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity recall (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity recall (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity recall (mixed English and Nepali source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
entity recall (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
Nepali prose quality (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
Nepali prose quality (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
Nepali prose quality (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
supporting fact recall (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
supporting fact recall (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
supporting fact recall (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
valid-answer quality (all questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
valid-answer quality (English-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low
valid-answer quality (Nepali-source questions)
Source: NepNewsBench v2 (draft candidate release) data · Sep 2026
Google AI Studio via openrouter, reasoning low

Agentic

AgenticVBench多模态工具使用 · Claude Code · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Arena AgentSource: LMArena data
Design Arena EloSource: Design Arena Leaderboards data · Nov 2026
GDPval-AASource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
GDPval-AA v22 results
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · Artificial Analysis · Haiku 5.5 card snapshot · highest thinking
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Source: OpenRouter benchmark exports · Oct 2026
2 Sep 2026 version · 90-day results
Across 2 providers lowest 73.5% median 75.1% highest 76.7%OpenRouter's automatic routing 71.3%
Show results from 2 providers and OpenRouter's automatic routingHide results from 2 providers and OpenRouter's automatic routing
  • Google
  • Google AI Studio
  • OpenRouter's automatic routing
Terminal-Bench 2.13 related benchmarks · 7 results
Terminal-Bench 2.1
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Terminal-Bench 4.0
Reported by Terminal-Bench / Stanford / Harbor / Laude Institute · via BenchBoard docs
Terminal-Bench 4.0 official leaderboard · mini-SWE-agent · high effort
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

General

Coding

Arena ELOSource: LMArena data · Nov 2026

Reasoning

Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Human Difficult subset
Human Solvable subset
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated

Science

GPQA Diamond5 results
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
Source: OpenRouter benchmark exports · Oct 2026
2 Sep 2026 version · 90-day results
Across 2 providers lowest 94.8% median 95.1% highest 95.3%OpenRouter's automatic routing 95.6%
Show results from 2 providers and OpenRouter's automatic routingHide results from 2 providers and OpenRouter's automatic routing
  • OpenRouter's automatic routing
  • Google AI Studio
  • Google
LABBench22 results
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
macro-average across 11 subtasks
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
ValsSource: Vals AI

Speech

Audio MultiChallengeQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
FLEURS-60 · ASR WERQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MMARQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MMAUQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MMSUQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
VoiceBenchQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.

Vision

CharXiv-RSource: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
LVBench2 results
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Gemini为agentic;跨模型设置见原卡
Source: LLM Stats data · Reported by the model's developer. The source relaying it did not verify it. claim
Setting not stated
Video-MME-v22 results
Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Agent mode · Qwen Code

Math

Instruction following

Factuality

Knowledge

OCR

Other

AISHELL-4 · cpWERQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
AISHELL-4 · DERQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
AliMeeting TestReported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Artificial Analysis9 related benchmarks · 11 results
Briefcase
Reported by Anthropic · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
adaptive thinking · max effort · default sampling · 5-trial mean · context ≤1M unless noted · v1.1 · Artificial Analysis · Haiku 5.5 card snapshot · highest thinking
Show 5 more resultsHide 5 results
Intelligence Index
Source: OpenRouter data docs
Setting not stated
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Artificial Analysis Intelligence Index v4.1.1
AVUTQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
BlenderWorld15 related benchmarks · 15 results
Art & Animation
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 30 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Architecture & Interiors
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 72 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Characters & Animals
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 25 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Fully satisfied rubric
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Image/video-input overall score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 145 image or video reference tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Nature & Landscapes
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 21 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Show 9 more resultsHide 9 results
Overall score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Procedural & Game Assets
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 10 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Products & Manufacturing
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 28 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Rendering & Simulation
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 17 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Science & Visualization
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 9 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Text-only overall score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 78 text-only tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Vehicles & Machinery
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 11 category tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Visual-quality dimension score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
Weighted rubric score
Reported by BlenderWorld authors / Alibaba Token Hub · via BenchBoard docs
benchmark-owner paper run · 223 tasks · Blender 4.2.10 / Blender MCP paper setup · GPT-5.6 Terra main judge · generation-agent harness and reasoning effort not stated on public leaderboard
DailyOmniQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
DeepSWE v1.12 results
Reported by Google DeepMind · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by OpenAI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OpenAI launch table
ExplorationBench22 related benchmarks · 22 results
AlienCode · M4 · fixed-probe control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienCode · A4+O · complete rules after exploration
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · complete-rule reference or auxiliary diagnostic
AlienCode · M0 · baseline of Best@3 trajectory
Reported by Fudan University / Tencent Hy / Tsinghua University, Tencent Hy / ExplorationBench authors · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienCode · M4 · Best@3 held-out accuracy
Reported by Fudan University / Tencent Hy / Tsinghua University, Tencent Hy / ExplorationBench authors · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienCode · M4 · direct answering control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienCode · M4 · hindsight-replay control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
Show 16 more resultsHide 16 results
AlienCode · M4 · Mean@3 held-out accuracy
Reported by Fudan University / Tencent Hy / Tsinghua University, Tencent Hy / ExplorationBench authors · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienCode · M4 · without-tool control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienCode · M4 · Worst@3 held-out accuracy
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienCode · O@M0 · complete rules before exploration
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · complete-rule reference or auxiliary diagnostic
AlienCode · Rules correctly reported
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · complete-rule reference or auxiliary diagnostic
AlienLogic · A4+O · complete rules after exploration
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · complete-rule reference or auxiliary diagnostic
AlienLogic · Correct refusal on unprovable tasks
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · complete-rule reference or auxiliary diagnostic
AlienLogic · M0 · baseline of Best@3 trajectory
Reported by Fudan University / Tencent Hy / Tsinghua University, Tencent Hy / ExplorationBench authors · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienLogic · M4 · Best@3 held-out accuracy
Reported by Fudan University / Tencent Hy / Tsinghua University, Tencent Hy / ExplorationBench authors · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienLogic · M4 · direct answering control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienLogic · M4 · fixed-probe control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienLogic · M4 · hindsight-replay control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienLogic · M4 · Mean@3 held-out accuracy
Reported by Fudan University / Tencent Hy / Tsinghua University, Tencent Hy / ExplorationBench authors · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienLogic · M4 · without-tool control
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · one matched control trajectory
AlienLogic · M4 · Worst@3 held-out accuracy
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · 3 independent autonomous trajectories
AlienLogic · O@M0 · complete rules before exploration
Reported by Fudan University / Tencent Hy / Tsinghua University · via BenchBoard docs
official 2026-10-13 leaderboard snapshot · 70 held-out tasks in this world · 4 exploration rounds · 3 answers/task · high reasoning · complete-rule reference or auxiliary diagnostic
HumMusQAQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
JoinAVBenchQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
LongAudioSpanReported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
LVOmniBench2 results
Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Agent mode · Qwen Code
MagicData-RAMC · DERQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MentalHealthBench17 related benchmarks · 17 results
Overall
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Acuity · Emergent
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Acuity · High acuity
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Acuity · Non-acute
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Actionable guidance and coping
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Alarmism and under-response
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Show 11 more resultsHide 11 results
Behavior · Collaboration and user agency
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Communication and writing
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Context seeking and assessment
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Empathy and emotional support
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Interpretation and cognitive reframing
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Reality-testing calibration
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
Behavior · Refusals and harm avoidance
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Caregiver
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Clinician
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Layperson
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
User profile · Teen
Reported by OpenAI · via BenchBoard docs
OpenAI evaluation · 95% CI available on source page
MLC-SLM (en) · cpWERQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MLC-SLM (en) · DERQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MuchoMusic-RULQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
MusTBenchQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OmniCap-IF · CSRQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OmniCap-IF · ISRQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OmniClozeQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
OmniGAIAWeb Search · 无 Harness · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Agent mode · Qwen Code
QIVDQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
SkillsBench · Vals6 related benchmarks · 6 results
With Skills · Accuracy
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536
With Skills · Mean cost / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536
With Skills · Mean duration / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · With Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536
Without Skills · Accuracy
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · Without Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536
Without Skills · Mean cost / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · Without Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536
Without Skills · Mean duration / test
Reported by Vals AI · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals AI · updated 2026-09-27 · metadata version 1 · 87 tasks in trace charts · 3 trials/task/condition · per-task mean then task average · OpenHands-CLI@ · Without Skills · system=google/gemini-3.8-flash · provider=Google · reasoning_effort=high · temperature=1 · max_output_tokens=65536
SpotSoundBenchQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
StreamingBenchQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
UniClawBenchReported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
Vals21 related benchmarks · 23 results
Show 17 more resultsHide 17 results
Immigration
Source: Vals AI
MedCode
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Source: Vals AI
Setting not stated
MedScribe
Source: Clinical Benchmarks data docs · Sep 2026
Setting not stated
Source: Vals AI
Setting not stated
WildSpeechQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.
WorldSenseQwen3.8 Omni Flash 官方发布表 · Reported by Qwen · via BenchBoard docs · Reported by the model's developer. The source relaying it did not verify it.

Data credits: BenchBoard by SYuan03 (github.com/SYuan03/benchboard). MIT covers its code and data organization; no results licence is inferred. Numeric relays retain the original stating-source links. · Epoch AI Benchmarking Hub, CC BY 4.0 (licence) · Clinical Benchmarks (clinicalbenchmarks.ai), CC BY 4.0; fractions converted to percentages; source documents retain their own terms (licence) · LMArena, CC BY 4.0 (licence) · Bangla LLM Bench, Md Deluair Hossen. Source tasks: Hendrycks et al. 2021 (MMLU), OpenAI MMMLU, Bandarkar et al. 2024 (Belebele), Shi et al. 2023 (MGSM), Nahin et al. 2025 (TituLLMs). Public numeric community results; results licence not separately stated. · Baromètre de l’écriture IA, Johannes Eva; public numeric ranking data, © 2026 Johannes Eva, no results licence stated · Data by LLM Stats · EQ-Bench (Samuel J. Paech) — cite paech2023eqbench · Deep20Bench edition 1.1, Patrick Heusser. Results CC BY 4.0; native question scores and fraction-to-percent success rates. (licence) · Keelemudelite mõõdupuu: Independent LLM leaderboard for Estonian. Eesti Keele Instituut. https://moodupuu.eki.ee, CC BY 4.0. Latest per-benchmark results selected with partial-run flags retained. (licence) · OpenRouter public benchmark leaderboard and search-lane exports, CC BY 4.0. Fractional source scores converted to percentages; immutable dated snapshots. (licence) · LLM Chess by Maxim Saplin, Apache-2.0 (Copyright [2024] [Maxim Saplin]) (licence) · MineBench, MIT (licence) · Outback Yak Research, NepNewsBench v2 research draft. Public numerical aggregates from a candidate preview that the publisher says is not evidence of publication; no release licence assigned and none asserted here. · Hugging Face official benchmark leaderboards; licence varies by benchmark · WeirdML v3 by Håvard Tveit Ihle (Norwegian Defence Research Establishment). API costs supported by Epoch AI, METR and NDRE.

Around the web

Also known as: databricks/databricks-gemini-3-8-flash, gemini 3.8 flash, gemini-3-8-flash, gemini-3.8-flash-high, gemini-3.8-flash-thinking, gemini-3.8-flash@eu, gemini/gemini-3.8-flash, github_copilot/gemini-3.8-flash, gmi/google/gemini-3.8-flash, google-ai-studio/gemini-3.8-flash, google-gemini-3.8-flash, google-vertex/gemini-3.8-flash, google/gemini-3-8-flash, google/gemini-3.8-flash, google/gemini-3.8-flash:batch, perplexity/google/gemini-3.8-flash, vertex/gemini-3.8-flash, vertex/gemini-3.8-flash@eu, vertex/gemini-3.8-flash@us, vertex_ai/gemini-3.8-flash

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works