Skip to content

Listings

All listings: Llmgateway

Every listing for the models on page 3 of 13 of Llmgateway, including each model's other versions and routes. Back to Llmgateway

Sold by Llmgateway

86 listings on this page sold by Llmgateway.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Gemini 3.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
135.9
From 393 benchmarks. Plenty of data behind it.
113 ±5
Coding IQ 113.3, 95% interval 109–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50cache read $0.15$9.001M
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
77 ±6
Chatty (77 ±6). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
155.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.5 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
Inference by Google
135.9
From 393 benchmarks. Plenty of data behind it.
113 ±5
Coding IQ 113.3, 95% interval 109–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50cache read $0.15$9.00Not published by the provider
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
77 ±6
Chatty (77 ±6). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
155.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.8 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
135.9
From 44 benchmarks. Plenty of data behind it.
Not enough data yet$0.15cache read $0.016$0.47cache write $0.201M
65.8
Good value (65.8). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3.8 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
135.9
From 44 benchmarks. Plenty of data behind it.
Not enough data yet$0.15cache read $0.016$0.47cache write $0.20Not published by the provider
65.8
Good value (65.8). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3.8 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Novita AI
135.9
From 44 benchmarks. Plenty of data behind it.
Not enough data yet$0.15cache read $0.016$0.47Not published by the provider
65.8
Good value (65.8). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-5.6 Terra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-6.1 TerraWe compared release dates and version names in our catalogue.
135.7
From 329 benchmarks. Plenty of data behind it.
121 ±5
Coding IQ 120.9, 95% interval 116–126. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$12.00cache write $2.501.1M
60.4
Good value (60.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 ±10
Typical (48 ±10). Generates about as many tokens as models with similar coding results. Measured at max effort. A fair amount of data behind it.
160.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.6 Terra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-6.1 TerraWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
135.7
From 329 benchmarks. Plenty of data behind it.
121 ±5
Coding IQ 120.9, 95% interval 116–126. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$12.00cache write $2.50Not published by the provider
60.4
Good value (60.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 ±10
Typical (48 ±10). Generates about as many tokens as models with similar coding results. Measured at max effort. A fair amount of data behind it.
160.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.6 Terra
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-6.1 TerraWe compared release dates and version names in our catalogue.
Inference by OpenAI
135.7
From 329 benchmarks. Plenty of data behind it.
121 ±5
Coding IQ 120.9, 95% interval 116–126. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.20$12.00cache write $2.50Not published by the provider
60.4
Good value (60.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 ±10
Typical (48 ±10). Generates about as many tokens as models with similar coding results. Measured at max effort. A fair amount of data behind it.
160.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-6 Luna
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
135.6
From 227 benchmarks. Plenty of data behind it.
117 ±6
Coding IQ 116.9, 95% interval 111–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.1251.1M
63.4
Good value (63.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
51 ±11
Typical (51 ±11). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
156.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-6 Luna
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
135.6
From 227 benchmarks. Plenty of data behind it.
117 ±6
Coding IQ 116.9, 95% interval 111–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.125Not published by the provider
63.4
Good value (63.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
51 ±11
Typical (51 ±11). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
156.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-6 Luna
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
135.6
From 227 benchmarks. Plenty of data behind it.
117 ±6
Coding IQ 116.9, 95% interval 111–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.125Not published by the provider
63.4
Good value (63.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
51 ±11
Typical (51 ±11). Generates about as many tokens as models with similar coding results. Measured at max effort. Little data behind it, so treat it as a rough estimate.
156.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.6 Luna
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-6 LunaWe compared release dates and version names in our catalogue.
135.2
From 344 benchmarks. Plenty of data behind it.
112 ±10
Coding IQ 112.4, 95% interval 102–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.02$1.20cache write $0.251.1M
66.2
Good value (66.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
52 ±8
Typical (52 ±8). Generates about as many tokens as models with similar coding results. Measured at max effort. A fair amount of data behind it.
156.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.6 Luna
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-6 LunaWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
135.2
From 344 benchmarks. Plenty of data behind it.
112 ±10
Coding IQ 112.4, 95% interval 102–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.02$1.20cache write $0.25Not published by the provider
66.2
Good value (66.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
52 ±8
Typical (52 ±8). Generates about as many tokens as models with similar coding results. Measured at max effort. A fair amount of data behind it.
156.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.6 Luna
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-6 LunaWe compared release dates and version names in our catalogue.
Inference by OpenAI
135.2
From 344 benchmarks. Plenty of data behind it.
112 ±10
Coding IQ 112.4, 95% interval 102–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20cache read $0.02$1.20cache write $0.25Not published by the provider
66.2
Good value (66.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
52 ±8
Typical (52 ±8). Generates about as many tokens as models with similar coding results. Measured at max effort. A fair amount of data behind it.
156.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Ling 3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLing 3.2 FlashWe compared the version names in our catalogue.
135.2
From 16 benchmarks. A fair amount of data behind it.
Not enough data yet$0.30cache read $0.06$0.901M
69.6
Good value (69.6). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Ling 3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLing 3.2 FlashWe compared the version names in our catalogue.
Inference by Novita AI
135.2
From 16 benchmarks. A fair amount of data behind it.
Not enough data yet$0.30cache read $0.06$0.90Not published by the provider
69.6
Good value (69.6). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3.7 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
134.9
From 225 benchmarks. Plenty of data behind it.
112 ±5
Coding IQ 112.2, 95% interval 107–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.25$3.751M
44.2
Poor value (44.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
134.9
From 225 benchmarks. Plenty of data behind it.
112 ±5
Coding IQ 112.2, 95% interval 107–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $0.50$7.50cache write $3.125Not published by the provider
44.2
Poor value (44.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Max
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen4 MaxWe compared release dates and version names in our catalogue.
Inference by Novita AI
134.9
From 225 benchmarks. Plenty of data behind it.
112 ±5
Coding IQ 112.2, 95% interval 107–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.25$3.75Not published by the provider
44.2
Poor value (44.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.2 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.5 ProWe compared the version names in our catalogue.
134.7
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$21.00$168.00400K
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
157.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.2 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.5 ProWe compared the version names in our catalogue.
Inference by Microsoft Azure
134.7
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$21.00$168.00Not published by the provider
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
157.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.2 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.5 ProWe compared the version names in our catalogue.
Inference by OpenAI
134.7
From 42 benchmarks. Plenty of data behind it.
Not enough data yet$21.00$168.00Not published by the provider
49.6
Fair value (49.6). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
157.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 5.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
134.6
From 230 benchmarks. Plenty of data behind it.
124 ±6
Coding IQ 123.6, 95% interval 118–129. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.1251M
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±9
Typical (49 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
160.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 5.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
anthropic.claude-haiku-5-5
Inference by Amazon Web Services
134.6
From 230 benchmarks. Plenty of data behind it.
124 ±6
Coding IQ 123.6, 95% interval 118–129. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.125Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±9
Typical (49 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
160.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 5.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Anthropic
134.6
From 230 benchmarks. Plenty of data behind it.
124 ±6
Coding IQ 123.6, 95% interval 118–129. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.125Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±9
Typical (49 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
160.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Haiku 5.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
134.6
From 230 benchmarks. Plenty of data behind it.
124 ±6
Coding IQ 123.6, 95% interval 118–129. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.01$0.50cache write $0.125Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±9
Typical (49 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
160.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.005$0.501M
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
accounts/fireworks/models/minimax-m3p1-flash
Inference by Fireworks AI
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Inference Net
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.005$0.50Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by MiniMax
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Nebius AI Studio
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Novita AI
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
MiniMax M3.1 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Together AI
134.5
From 60 benchmarks. Plenty of data behind it.
119 ±9
Coding IQ 118.7, 95% interval 109–128. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.015$0.60Not published by the provider
60.2
Good value (60.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Gemini 3.6 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
134.4
From 267 benchmarks. Plenty of data behind it.
112 ±8
Coding IQ 111.8, 95% interval 103–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50cache read $0.15$7.501M
50.6
Fair value (50.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
155.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.6 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
Inference by Google
134.4
From 267 benchmarks. Plenty of data behind it.
112 ±8
Coding IQ 111.8, 95% interval 103–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.50cache read $0.15$7.50Not published by the provider
50.6
Fair value (50.6). Costs per task about what its benchmark results predict. Plenty of data behind it.
59 ±10
Chatty (59 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
155.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiMo V2.6 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
134.3
From 154 benchmarks. Plenty of data behind it.
116 ±7
Coding IQ 115.7, 95% interval 109–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.0037$0.281M
78.3
Good value (78.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiMo V2.6 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
134.3
From 154 benchmarks. Plenty of data behind it.
116 ±7
Coding IQ 115.7, 95% interval 109–123. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.0028$0.28Not published by the provider
78.3
Good value (78.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
62 ±9
Chatty (62 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Fugu Ultra
🇯🇵
Maker headquartered in JP, according to the company's own website. The citation is on the model page.
134.2
From 9 benchmarks. A fair amount of data behind it.
113 ±8
Coding IQ 113.4, 95% interval 106–121. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00cache read $0.50$30.001MNot enough data yetNot measuredNot measured
Fugu Ultra
🇯🇵
Maker headquartered in JP, according to the company's own website. The citation is on the model page.
Inference by Sakana AI
134.2
From 9 benchmarks. A fair amount of data behind it.
113 ±8
Coding IQ 113.4, 95% interval 106–121. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00cache read $0.50$30.00Not published by the providerNot enough data yetNot measuredNot measured
Claude Opus 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Opus 5.5We compared release dates and version names in our catalogue.
claude-opus-4-5-20251101 · 20251101
134.0
From 384 benchmarks. Plenty of data behind it.
113 ±5
Coding IQ 112.8, 95% interval 108–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00cache read $0.50$25.00cache write $6.25200K
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Opus 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Opus 5.5We compared release dates and version names in our catalogue.
anthropic.claude-opus-4-5-20251101-v1:0 · 20251101
Inference by Amazon Web Services
134.0
From 384 benchmarks. Plenty of data behind it.
113 ±5
Coding IQ 112.8, 95% interval 108–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00cache read $0.50$25.00cache write $6.25Not published by the provider
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Opus 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Opus 5.5We compared release dates and version names in our catalogue.
claude-opus-4-5-20251101 · 20251101
Inference by Anthropic
134.0
From 384 benchmarks. Plenty of data behind it.
113 ±5
Coding IQ 112.8, 95% interval 108–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00cache read $0.50$25.00cache write $6.25Not published by the provider
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Opus 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Opus 5.5We compared release dates and version names in our catalogue.
20251101
Inference by Google
134.0
From 384 benchmarks. Plenty of data behind it.
113 ±5
Coding IQ 112.8, 95% interval 108–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$5.00cache read $0.50$25.00cache write $6.25Not published by the provider
46.0
Poor value (46.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.09$2.001M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
glm-5.2-fast · fast
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.1256cache read $0.429$6.7761M
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.28$4.40Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Nebius AI Studio
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40$4.40Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Novita AI
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.40Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.2
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
133.9
From 361 benchmarks. Plenty of data behind it.
113 ±9
Coding IQ 113.3, 95% interval 105–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.40Not published by the provider
45.9
Poor value (45.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
58 ±10
Chatty (58 ±10). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
153.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
anthropic.claude-sonnet-4-6
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.75Not published by the provider
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Anthropic
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.75Not published by the provider
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Google
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.75Not published by the provider
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.028$0.491M
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Cloudflare Workers AI
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
accounts/fireworks/models/glm-5p3-flash
Inference by Fireworks AI
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Inference Net
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.09cache read $0.02$0.28Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
zai-glm-5-3-flash
Inference by Mistral AI
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Reka AI
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.11cache read $0.02$0.30Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Together AI
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.3 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Z.ai
133.6
From 266 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.03$0.50Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Plenty of data behind it.
68 ±11
Chatty (68 ±11). Generates more tokens than models with similar coding results. Measured at max effort. A fair amount of data behind it.
153.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.3 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
133.6
From 51 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.7, 95% interval 106–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00Not published by the provider
59.7
Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.3 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
133.6
From 51 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.7, 95% interval 106–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00Not published by the provider
59.7
Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT 5.2
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
133.4
From 440 benchmarks. Plenty of data behind it.
112 ±7
Coding IQ 111.5, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00400K
56.6
Good value (56.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±14
Typical (49 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.2
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
133.4
From 440 benchmarks. Plenty of data behind it.
112 ±7
Coding IQ 111.5, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00Not published by the provider
56.6
Good value (56.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±14
Typical (49 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.2
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by OpenAI
133.4
From 440 benchmarks. Plenty of data behind it.
112 ±7
Coding IQ 111.5, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00Not published by the provider
56.6
Good value (56.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±14
Typical (49 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.5 ProWe compared release dates and version names in our catalogue.
132.8
From 14 benchmarks. Plenty of data behind it.
Not enough data yet$15.00$120.00400K
29.6
Poor value (29.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
151.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.5 ProWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
132.8
From 14 benchmarks. Plenty of data behind it.
Not enough data yet$15.00$120.00Not published by the provider
29.6
Poor value (29.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
151.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.5 ProWe compared release dates and version names in our catalogue.
Inference by OpenAI
132.8
From 14 benchmarks. Plenty of data behind it.
Not enough data yet$15.00$120.00Not published by the provider
29.6
Poor value (29.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
151.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Step 5 Preview
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
132.7
From 119 benchmarks. Plenty of data behind it.
115 ±7
Coding IQ 115.2, 95% interval 108–123. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$2.701M
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80cache read $0.16$3.40262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Moonshot AI
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.16$4.00Not published by the provider
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Nebius AI Studio
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95$4.00Not published by the provider
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Novita AI
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80cache read $0.16$3.40Not published by the provider
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Together AI
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.20cache read $0.20$4.50Not published by the provider
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08cache read $0.016$0.181.1M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.044$1.32Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Cloudflare Workers AI
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.44cache read $0.014$1.32Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by DeepInfra
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.08cache read $0.016$0.18Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Novita AI
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.028$0.28Not published by the provider
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
gemini-3-flash-preview
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.001M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
gemini-3-flash-preview
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.00Not published by the provider
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.2 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
Inference by Microsoft Azure
131.9
From 52 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 109.8, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00Not published by the provider
52.6
Good value (52.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
59 ±11
Chatty (59 ±11). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.2 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
Inference by OpenAI
131.9
From 52 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 109.8, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00Not published by the provider
52.6
Good value (52.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
59 ±11
Chatty (59 ±11). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works