Skip to content

Listings

All listings: Cometapi

Every listing for the models on page 4 of 17 of Cometapi, including each model's other versions and routes. Back to Cometapi

Sold by Cometapi

35 listings on this page sold by Cometapi.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
GPT 5.1
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
131.0
From 352 benchmarks. Plenty of data behind it.
107Β Β±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$10.00Not published by the provider
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
130.8
From 224 benchmarks. Plenty of data behind it.
110Β Β±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40$4.41Not published by the provider
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 Β±8
Typical (51 Β±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.7
From 303 benchmarks. Plenty of data behind it.
105Β Β±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 Β±10
Terse (43 Β±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
130.6
From 367 benchmarks. Plenty of data behind it.
105Β Β±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 Β±9
Typical (46 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O3 Pro
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
130.0
From 28 benchmarks. Plenty of data behind it.
Not enough data yetβ€”β€”Not published by the provider
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
147.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
O3 Pro
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-pro-2025-06-10 Β· 2025-06-10
130.0
From 28 benchmarks. Plenty of data behind it.
Not enough data yet$20.00$80.00Not published by the provider
36.5
Poor value (36.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
147.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
129.7
From 442 benchmarks. Plenty of data behind it.
107Β Β±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00$15.00Not published by the provider
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 Β±8
Terse (41 Β±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
claude-sonnet-4-5-20250929 Β· 20250929
129.7
From 442 benchmarks. Plenty of data behind it.
107Β Β±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 Β±8
Terse (41 Β±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
claude-sonnet-4-5-20250929-thinking Β· thinking+20250929
129.7
From 442 benchmarks. Plenty of data behind it.
107Β Β±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 Β±8
Terse (41 Β±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
129.7
From 306 benchmarks. Plenty of data behind it.
107Β Β±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00$3.20Not published by the provider
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 Β±9
Typical (55 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20 Multi-Agent
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
grok-4.20-multi-agent-0309 Β· 0309
β‰ˆ 130
From 73 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measuredNot measured
Doubao Seed 2.1 Prodoubao-seed-2-1-pro-260628 Β· 260628
129.6
From 64 benchmarks. Plenty of data behind it.
104Β Β±11
Coding IQ 104.2, 95% interval 94–115. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.8334$4.167Not published by the providerNot enough data yetNot measuredNot measured
Qwen3.7 Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
129.5
From 260 benchmarks. Plenty of data behind it.
109Β Β±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$1.60Not published by the provider
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 Β±9
Chatty (59 Β±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen3.7 PlusWe compared release dates and version names in our catalogue.
129.4
From 256 benchmarks. Plenty of data behind it.
106Β Β±5
Coding IQ 105.7, 95% interval 101–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50$3.00Not published by the provider
38.6
Poor value (38.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
44 Β±12
Terse (44 Β±12). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
grok-4.20-beta-0309-non-reasoning Β· beta+non-reasoning+0309
129.3
From 281 benchmarks. Plenty of data behind it.
108Β Β±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 Β±9
Typical (45 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
grok-4.20-beta-0309-reasoning Β· beta+reasoning+0309
129.3
From 281 benchmarks. Plenty of data behind it.
108Β Β±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 Β±9
Typical (45 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
grok-4.20-0309-non-reasoning Β· non-reasoning+0309
129.3
From 281 benchmarks. Plenty of data behind it.
108Β Β±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 Β±9
Typical (45 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4.20
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
grok-4.20-0309-reasoning Β· reasoning+0309
129.3
From 281 benchmarks. Plenty of data behind it.
108Β Β±8
Coding IQ 108.2, 95% interval 101–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25$2.50Not published by the provider
40.6
Poor value (40.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
45 Β±9
Typical (45 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
152.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
129.1
From 229 benchmarks. Plenty of data behind it.
108Β Β±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 Β±9
Terse (44 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Doubao Seed 2.0 Pro
Newer version
Newer versionDoubao Seed 2.1 ProWe compared release dates and version names in our catalogue.
doubao-seed-2-0-pro-260215 Β· 260215
129.0
From 86 benchmarks. Plenty of data behind it.
β‰ˆ 102Β Β±10
Coding IQ 101.6, 95% interval 92–112. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the providerNot enough data yetNot measuredNot measured
Gemini 2.5 Pro
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
128.8
From 374 benchmarks. Plenty of data behind it.
101Β Β±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 Β±9
Typical (54 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gemini-2.5-pro-all Β· all
128.8
From 374 benchmarks. Plenty of data behind it.
101Β Β±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 Β±9
Typical (54 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gemini-2.5-pro-thinking Β· thinking
128.8
From 374 benchmarks. Plenty of data behind it.
101Β Β±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 Β±9
Typical (54 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Doubao Seed 2.0 Litedoubao-seed-2-0-lite-260215 Β· 260215
β‰ˆ 129
From 4 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yetβ€”β€”Not published by the providerNot enough data yetNot measuredNot measured
Grok Build 0.1
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
128.7
From 32 benchmarks. A fair amount of data behind it.
β‰ˆ 110Β Β±23
Coding IQ 109.5, 95% interval 87–133. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
57.8
Good value (57.8). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Doubao Seed 2.1 Turbodola-seed-2-1-turbo-260628 Β· 260628
128.5
From 60 benchmarks. Plenty of data behind it.
Not enough data yet$0.4166$2.083Not published by the providerNot enough data yetNot measuredNot measured
Kimi K2.5
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
128.5
From 401 benchmarks. Plenty of data behind it.
103Β Β±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.00Not published by the provider
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 Β±9
Terse (42 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3
128.3
From 343 benchmarks. Plenty of data behind it.
100Β Β±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 Β±9
Chatty (58 Β±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
o3-2025-04-16 Β· 2025-04-16
128.3
From 343 benchmarks. Plenty of data behind it.
100Β Β±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00$8.00Not published by the provider
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 Β±9
Chatty (58 Β±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
128.1
From 307 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 Β±18
Typical (46 Β±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gpt-5.4-mini-2026-03-17 Β· 2026-03-17
128.1
From 307 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 Β±18
Typical (46 Β±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiMo V2.5 Pro
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionMiMo V2.6 ProWe compared release dates and version names in our catalogue.
128.0
From 172 benchmarks. Plenty of data behind it.
107Β Β±6
Coding IQ 106.5, 95% interval 101–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.435$0.87Not published by the provider
59.5
Good value (59.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 Β±9
Typical (55 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Gemini 3.5 Flash Lite
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
127.5
From 169 benchmarks. Plenty of data behind it.
105Β Β±6
Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.5 Flash Lite
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
gemini-3.5-flash-lite-thinking Β· thinking
127.5
From 169 benchmarks. Plenty of data behind it.
105Β Β±6
Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek Reasoner
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
127.1
From 94 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.4, 95% interval 94–109. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
β€”β€”Not published by the provider
59.4
Good value (59.4). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works