Skip to content

Listings

All listings: Requesty

Every listing for the models on page 2 of 7 of Requesty, including each model's other versions and routes. Back to Requesty

Sold by Requesty

101 listings on this page sold by Requesty.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@ap-northeast-1 · 🇯🇵 ap-northeast-1
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@eu-central-1 · 🇩🇪 eu-central-1
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@eu-north-1 · 🇸🇪 eu-north-1
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@eu-west-1 · 🇮🇪 eu-west-1
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@eu-west-3 · 🇫🇷 eu-west-3
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@us-east-1 · 🇺🇸 us-east-1
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@us-east-2 · 🇺🇸 us-east-2
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-6@us-west-2 · 🇺🇸 us-west-2
Inference by Amazon Web Services
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.30$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Anthropic
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Google
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.30$15.00cache write $3.751M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
vertex/claude-sonnet-4-6@europe-west1 · 🇧🇪 europe-west1
Inference by Google
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.33$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.6
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
vertex/claude-sonnet-4-6@us-east5 · 🇺🇸 us-east5
Inference by Google
133.8
From 469 benchmarks. Plenty of data behind it.
108 ±6
Coding IQ 108.4, 95% interval 103–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30cache read $0.33$16.50cache write $4.1251M
35.4
Poor value (35.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
71 ±8
Chatty (71 ±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.3 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-5.3-codex@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
133.6
From 51 benchmarks. Plenty of data behind it.
114 ±8
Coding IQ 113.7, 95% interval 106–122. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00400K
59.7
Good value (59.7). Cheaper per task than its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT 5.2
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5.2@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
133.4
From 440 benchmarks. Plenty of data behind it.
112 ±7
Coding IQ 111.5, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00400K
56.6
Good value (56.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±14
Typical (49 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.2
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by OpenAI
133.4
From 440 benchmarks. Plenty of data behind it.
112 ±7
Coding IQ 111.5, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00400K
56.6
Good value (56.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
49 ±14
Typical (49 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by DeepInfra
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.15$3.50262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Inceptron
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80cache read $0.20$3.50262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.6
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by Moonshot AI
132.6
From 305 benchmarks. Plenty of data behind it.
113 ±7
Coding IQ 112.9, 95% interval 106–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.16$4.00262K
50.4
Fair value (50.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
48 ±14
Typical (48 ±14). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
151.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by DeepInfra
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.09cache read $0.018$0.181M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Novita AI
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.028$0.281M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Sference
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.28cache read $0.07$0.561M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash 0731
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
Inference by Tensorx
132.2
From 149 benchmarks. Plenty of data behind it.
113 ±8
Coding IQ 112.8, 95% interval 105–121. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.06$0.301M
64.8
Good value (64.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
57 ±9
Chatty (57 ±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
154.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
vertex/gemini-3-flash-preview
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.00cache write $1.001M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3 Flash
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.8 FlashWe compared release dates and version names in our catalogue.
vertex/gemini-3-flash-preview:flex · flex
Inference by Google
132.0
From 439 benchmarks. Plenty of data behind it.
106 ±6
Coding IQ 106.1, 95% interval 100–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$1.50cache write $0.501M
62.2
Good value (62.2). Cheaper per task than its benchmark results predict. Plenty of data behind it.
53 ±15
Typical (53 ±15). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
152.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.2 Codex
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.3 CodexWe compared the version names in our catalogue.
azure/gpt-5.2-codex@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
131.9
From 52 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 109.8, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.175$14.00400K
52.6
Good value (52.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
59 ±11
Chatty (59 ±11). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.375cache read $0.1375$11.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.375cache read $0.1375$11.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by OpenAI
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
openai/gpt-5:flex · flex
Inference by OpenAI
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.625cache read $0.0625$5.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
openai/gpt-5:priority · priority
Inference by OpenAI
131.7
From 584 benchmarks. Plenty of data behind it.
111 ±5
Coding IQ 110.8, 95% interval 106–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.50cache read $0.25$20.00400K
52.5
Fair value (52.5). Costs per task about what its benchmark results predict. Plenty of data behind it.
65 ±8
Chatty (65 ±8). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
150
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by Microsoft Azure
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5.1@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5.1@francecentral · 🇫🇷 francecentral
Inference by Microsoft Azure
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.375cache read $0.1375$11.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
azure/gpt-5.1@swedencentral · 🇸🇪 swedencentral
Inference by Microsoft Azure
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.375cache read $0.1375$11.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT 5.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT 6We compared the version names in our catalogue.
Inference by OpenAI
131.0
From 352 benchmarks. Plenty of data behind it.
107 ±8
Coding IQ 106.6, 95% interval 99–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.125$10.00400K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
50 ±9
Typical (50 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
150.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by DeepInfra
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.05cache read $0.205$3.50203K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Novita AI
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.38$4.40205K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5.1
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
130.8
From 224 benchmarks. Plenty of data behind it.
110 ±6
Coding IQ 110.0, 95% interval 104–116. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.40cache read $0.26$4.40200K
43.2
Poor value (43.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
51 ±8
Typical (51 ±8). Generates about as many tokens as models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
deepinfra/deepseek-v4-pro-0424 · 0424
Inference by DeepInfra
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.30cache read $0.10$2.601M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
tensorx/deepseek-v4-pro-0424 · 0424
Inference by Tensorx
130.7
From 303 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.6, 95% interval 98–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.75cache read $0.44$3.501M
46.9
Poor value (46.9). Costs more per task than its benchmark results predict. Plenty of data behind it.
43 ±10
Terse (43 ±10). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
150.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.49cache read $0.30$3.60262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 397B A17B
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
130.6
From 367 benchmarks. Plenty of data behind it.
105 ±7
Coding IQ 104.8, 95% interval 98–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.60262K
48.4
Fair value (48.4). Costs per task about what its benchmark results predict. Plenty of data behind it.
46 ±9
Typical (46 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00>200k $6.00cache read $0.30$15.00>200k $22.50cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@eu-central-1 · 🇩🇪 eu-central-1
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@eu-north-1 · 🇸🇪 eu-north-1
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@eu-west-1 · 🇮🇪 eu-west-1
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@eu-west-3 · 🇫🇷 eu-west-3
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@us-east-1 · 🇺🇸 us-east-1
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@us-east-2 · 🇺🇸 us-east-2
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
bedrock/claude-sonnet-4-5@us-west-2 · 🇺🇸 us-west-2
Inference by Amazon Web Services
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.30$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
Inference by Google
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00>200k $6.00cache read $0.30$15.00>200k $22.50cache write $3.751M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
vertex/claude-sonnet-4-5@europe-west1 · 🇧🇪 europe-west1
Inference by Google
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.33$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Claude Sonnet 4.5
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionClaude Sonnet 5.5We compared release dates and version names in our catalogue.
vertex/claude-sonnet-4-5@us-east5 · 🇺🇸 us-east5
Inference by Google
129.7
From 442 benchmarks. Plenty of data behind it.
107 ±7
Coding IQ 107.2, 95% interval 101–114. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.30>200k $6.60cache read $0.33$16.50>200k $24.75cache write $4.1251M
40.2
Poor value (40.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
41 ±8
Terse (41 ±8). Generates fewer tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Novita AI
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.20$3.20203K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
129.7
From 306 benchmarks. Plenty of data behind it.
107 ±5
Coding IQ 106.7, 95% interval 102–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.20$3.20200K
49.7
Fair value (49.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.5
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.7 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
129.5
From 260 benchmarks. Plenty of data behind it.
109 ±6
Coding IQ 108.7, 95% interval 103–115. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.32cache read $0.032$1.28cache write $0.401M
47.1
Poor value (47.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
59 ±9
Chatty (59 ±9). Generates more tokens than models with similar coding results. Measured with reasoning off. Little data behind it, so treat it as a rough estimate.
147.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 Plus
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Newer version
Newer versionQwen3.7 PlusWe compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
129.4
From 256 benchmarks. Plenty of data behind it.
106 ±5
Coding IQ 105.7, 95% interval 101–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.05$3.00cache write $0.6251M
38.6
Poor value (38.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
44 ±12
Terse (44 ±12). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
deepinfra/deepseek-v4-flash-0424 · 0424
Inference by DeepInfra
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10cache read $0.02$0.201M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
novita/deepseek/deepseek-v4-flash-0424 · 0424
Inference by Novita AI
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14$0.281M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V4 Flash
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4.1 Flash 1017We compared release dates and version names in our catalogue.
parasail/deepseek-v4-flash-0424 · 0424
Inference by Parasail
129.1
From 229 benchmarks. Plenty of data behind it.
108 ±12
Coding IQ 107.8, 95% interval 95–120. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.07$0.281M
74.6
Good value (74.6). Cheaper per task than its benchmark results predict. Plenty of data behind it.
44 ±9
Terse (44 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Doubao Seed 2.0 Pro
Newer version
Newer versionDoubao Seed 2.1 ProWe compared release dates and version names in our catalogue.
deepinfra/ByteDance/Seed-2.0-pro
Inference by DeepInfra
129.0
From 86 benchmarks. Plenty of data behind it.
≈ 102 ±10
Coding IQ 101.6, 95% interval 92–112. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.50cache read $0.10$3.00256KNot enough data yetNot measuredNot measured
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@europe-central2 · 🇵🇱 europe-central2
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@europe-north1 · 🇫🇮 europe-north1
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@europe-west1 · 🇧🇪 europe-west1
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@europe-west4 · 🇳🇱 europe-west4
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@europe-west8 · 🇮🇹 europe-west8
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@us-central1 · 🇺🇸 us-central1
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@us-east1 · 🇺🇸 us-east1
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@us-east5 · 🇺🇸 us-east5
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@us-south1 · 🇺🇸 us-south1
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
coding/gemini-2.5-pro@us-west1 · 🇺🇸 us-west1
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@europe-central2 · 🇵🇱 europe-central2
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@europe-north1 · 🇫🇮 europe-north1
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@europe-west1 · 🇧🇪 europe-west1
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@europe-west4 · 🇳🇱 europe-west4
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@europe-west8 · 🇮🇹 europe-west8
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@us-central1 · 🇺🇸 us-central1
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@us-east1 · 🇺🇸 us-east1
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@us-east5 · 🇺🇸 us-east5
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@us-south1 · 🇺🇸 us-south1
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 2.5 Pro
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
vertex/gemini-2.5-pro@us-west1 · 🇺🇸 us-west1
Inference by Google
128.8
From 374 benchmarks. Plenty of data behind it.
101 ±18
Coding IQ 100.6, 95% interval 83–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25>200k $2.50cache read $0.31$10.00>200k $15.00cache write $2.3751M
36.3
Poor value (36.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
54 ±9
Typical (54 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok Build 0.1
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
128.7
From 32 benchmarks. A fair amount of data behind it.
≈ 110 ±23
Coding IQ 109.5, 95% interval 87–133. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.10$2.00256K
57.8
Good value (57.8). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
bedrock/kimi-k2.5@eu-north-1 · 🇸🇪 eu-north-1
Inference by Amazon Web Services
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.72$3.60cache write $0.72128K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
bedrock/kimi-k2.5@eu-west-2 · 🇬🇧 eu-west-2
Inference by Amazon Web Services
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.72$3.60cache write $0.72128K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
bedrock/kimi-k2.5@us-east-1 · 🇺🇸 us-east-1
Inference by Amazon Web Services
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.00128K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
bedrock/kimi-k2.5@us-east-2 · 🇺🇸 us-east-2
Inference by Amazon Web Services
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.00128K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
bedrock/kimi-k2.5@us-west-2 · 🇺🇸 us-west-2
Inference by Amazon Web Services
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$3.00128K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.5
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
Inference by DeepInfra
128.5
From 401 benchmarks. Plenty of data behind it.
103 ±5
Coding IQ 102.9, 95% interval 98–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45cache read $0.07$2.25262K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
42 ±9
Terse (42 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
148.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 31B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
128.3
From 333 benchmarks. Plenty of data behind it.
102 ±7
Coding IQ 101.7, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.38262K
61.9
Good value (61.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 31B IT
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Google
128.3
From 333 benchmarks. Plenty of data behind it.
102 ±7
Coding IQ 101.7, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
——262K
61.9
Good value (61.9). Cheaper per task than its benchmark results predict. Plenty of data behind it.
43 ±9
Terse (43 ±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
144.1
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/o3
Inference by OpenAI
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.00cache read $0.50$8.00200K
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
OpenAI o3
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
openai/o3:flex · flex
Inference by OpenAI
128.3
From 343 benchmarks. Plenty of data behind it.
100 ±6
Coding IQ 99.6, 95% interval 93–106. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.25$4.00200K
54.5
Good value (54.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
58 ±9
Chatty (58 ±9). Generates more tokens than models with similar coding results. Measured at medium effort. A fair amount of data behind it.
147
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50400K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
azure/gpt-5.4-mini@eastus2 · 🇺🇸 eastus2
Inference by Microsoft Azure
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50400K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5.4 mini
🇺🇸
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
128.1
From 307 benchmarks. Plenty of data behind it.
104 ±5
Coding IQ 104.3, 95% interval 99–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.75cache read $0.075$4.50400K
39.8
Poor value (39.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
46 ±18
Typical (46 ±18). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
149.4
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiMo V2.5 Pro
🇨🇳
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionMiMo V2.6 ProWe compared release dates and version names in our catalogue.
Inference by DeepInfra
128.0
From 172 benchmarks. Plenty of data behind it.
107 ±6
Coding IQ 106.5, 95% interval 101–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.20$3.001M
59.5
Good value (59.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
55 ±9
Typical (55 ±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works