Benchmark
E-Commerce Bench · Controllable return
Lower scores are better.
Benchmark sourceScores from BenchBoard docs.
- Models and systems measured
- 20
- Scores recorded
- 21
- Sources
- 1
- IQ weight
- No weight published
Score distribution
- 1.6
- Mean
- 0.9
- Median
- 1.5
- Std dev
- 0.2
- 10th percentile
- 3
- 90th percentile
- -0.05
- Min
Results
The source marks these results as descriptive, not capability scores, so we list them by name instead of ranking them.
| Model or system | Score |
|---|---|
| Claude Fable 5benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.22 |
| Claude Opus 4.6benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.76 |
| Claude Opus 4.7benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 1.8 |
| Claude Opus 4.8benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.2 |
| DeepSeek V4 Pro Preview (E-Commerce Bench)benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 1.5 |
| Gemini 3.1 Pro Previewbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 2 |
| Gemini 3.5 Flashbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.38 |
| GLM 5.1benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.09 |
| GLM 5.2benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · high reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.59 |
| GLM 5.2benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 2.2 |
| GLM 5.3benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.34 |
| GLM 5.3 Flashbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 2.8 |
| GPT 5.5benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.9 |
| GPT-5.6 Solbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · max reasoning · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 4.5 |
| Kimi K2.6benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 0.42 |
| Kimi K3benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs | 2 |
| Qwen3.5 Plusbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 5.9 |
| Qwen3.6 Plusbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 3 |
| Qwen3.7 Maxbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | -0.05 |
| Qwen3.8 Maxbenchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 2.9 |
| Qwen3.8 Max Preview (E-Commerce Bench)benchmark-owner 365-day merchant simulation · five independent episodes · up to four stores · initial balance ¥100,000 · thinking enabled where supported; effort not specified · exact API snapshot not stated for unversioned labels· Reported by E-Commerce Bench authors / Alibaba Qwen· via BenchBoard docs· Reported by the model's developer. The source relaying it did not verify it. | 0.38 |