Skip to content

Listings

All listings: Llmgateway

Every listing for the models on page 5 of 13 of Llmgateway, including each model's other versions and routes. Back to Llmgateway

Sold by Llmgateway

78 listings on this page sold by Llmgateway.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Gemini 3.5 Flash Lite
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
127.5
From 169 benchmarks. Plenty of data behind it.
105Β Β±6
Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.03$2.501M
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.5 Flash Lite
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
127.5
From 169 benchmarks. Plenty of data behind it.
105Β Β±6
Coding IQ 105.2, 95% interval 99–111. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.03$2.50Not published by the provider
46.2
Poor value (46.2). Costs more per task than its benchmark results predict. Plenty of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Hy3 (Deep Infra)
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
hy3
127.2
From 119 benchmarks. Plenty of data behind it.
111Β Β±6
Coding IQ 111.3, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.132cache read $0.033$0.528262K
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Hy3 (Deep Infra)
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
tencent/Hy3
Inference by DeepInfra
127.2
From 119 benchmarks. Plenty of data behind it.
111Β Β±6
Coding IQ 111.3, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.035$0.58Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Hy3 (Deep Infra)
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
tencent/hy3
Inference by Novita AI
127.2
From 119 benchmarks. Plenty of data behind it.
111Β Β±6
Coding IQ 111.3, 95% interval 105–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.14cache read $0.035$0.58Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GLM 4.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
127.0
From 234 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45$2.00205K
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
127.0
From 234 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.431$2.007Not published by the provider
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
zai-glm-4.7
Inference by Cerebras
127.0
From 234 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.25$2.75Not published by the provider
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Novita AI
127.0
From 234 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.11$2.20Not published by the provider
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Together AI
127.0
From 234 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.45$2.00Not published by the provider
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
127.0
From 234 benchmarks. Plenty of data behind it.
104Β Β±5
Coding IQ 103.5, 95% interval 98–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.11$2.20Not published by the provider
41.0
Poor value (41.0). Costs more per task than its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
143.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.737cache read $0.143$3.08262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
kimi-k2.7-code-highspeed Β· highspeed
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.90cache read $0.38$8.00262K
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Alibaba Cloud
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.19$4.00Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Moonshot AI
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.19$4.00Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
kimi-k2.7-code-highspeed Β· highspeed
Inference by Moonshot AI
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.90cache read $0.38$8.00Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Nebius AI Studio
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95$4.00Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2.7 Code
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
126.9
From 102 benchmarks. Plenty of data behind it.
105Β Β±9
Coding IQ 104.5, 95% interval 96–113. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.95cache read $0.19$4.00Not published by the provider
43.6
Poor value (43.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
62 Β±9
Chatty (62 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
151.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 5 Turbo
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
126.8
From 54 benchmarks. A fair amount of data behind it.
β‰ˆ 104Β Β±11
Coding IQ 103.5, 95% interval 93–114. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.20cache read $0.24$4.00200K
48.2
Fair value (48.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GLM 5V Turbo
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
126.8
From 68 benchmarks. Plenty of data behind it.
102Β Β±22
Coding IQ 101.9, 95% interval 80–124. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.20cache read $0.24$4.00200K
52.2
Fair value (52.2). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
MiniMax M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
126.8
From 332 benchmarks. Plenty of data behind it.
107Β Β±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.28cache read $0.056$1.101M
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 Β±8
Chatty (71 Β±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by DeepInfra
126.8
From 332 benchmarks. Plenty of data behind it.
107Β Β±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.28cache read $0.056$1.10Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 Β±8
Chatty (71 Β±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by MiniMax
126.8
From 332 benchmarks. Plenty of data behind it.
107Β Β±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.12$2.40Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 Β±8
Chatty (71 Β±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Nebius AI Studio
126.8
From 332 benchmarks. Plenty of data behind it.
107Β Β±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$1.20Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 Β±8
Chatty (71 Β±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Novita AI
126.8
From 332 benchmarks. Plenty of data behind it.
107Β Β±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 Β±8
Chatty (71 Β±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
MiniMax M3
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Together AI
126.8
From 332 benchmarks. Plenty of data behind it.
107Β Β±9
Coding IQ 107.2, 95% interval 98–117. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30cache read $0.06$1.20Not published by the provider
50.9
Fair value (50.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
71 Β±8
Chatty (71 Β±8). Generates more tokens than models with similar coding results. Measured at default effort. A fair amount of data behind it.
147.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.5 122B-A10B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
126.7
From 287 benchmarks. Plenty of data behind it.
99Β Β±7
Coding IQ 99.3, 95% interval 92–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$3.20262K
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen3.5 122B-A10B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Alibaba Cloud
126.7
From 287 benchmarks. Plenty of data behind it.
99Β Β±7
Coding IQ 99.3, 95% interval 92–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$3.20Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Qwen3.5 122B-A10B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by Novita AI
126.7
From 287 benchmarks. Plenty of data behind it.
99Β Β±7
Coding IQ 99.3, 95% interval 92–107. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.40$3.20Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Ling 3.0 Flash
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLing 3.2 FlashWe compared the version names in our catalogue.
125.6
From 52 benchmarks. Plenty of data behind it.
Not enough data yet$0.06cache read $0.012$0.18262K
64.2
Good value (64.2). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Ling 3.0 Flash
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLing 3.2 FlashWe compared the version names in our catalogue.
Inference by DeepInfra
125.6
From 52 benchmarks. Plenty of data behind it.
Not enough data yet$0.06cache read $0.012$0.18Not published by the provider
64.2
Good value (64.2). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Ling 3.0 Flash
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLing 3.2 FlashWe compared the version names in our catalogue.
Inference by Novita AI
125.6
From 52 benchmarks. Plenty of data behind it.
Not enough data yet$0.06cache read $0.012$0.18Not published by the provider
64.2
Good value (64.2). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3.5 27B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionQwen 3.8 27BWe compared release dates and version names in our catalogue.
125.6
From 331 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 100.7, 95% interval 94–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$2.40262K
42.4
Poor value (42.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
56 Β±9
Chatty (56 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Qwen3.5 27B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionQwen 3.8 27BWe compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
125.6
From 331 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 100.7, 95% interval 94–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$2.40Not published by the provider
42.4
Poor value (42.4). Costs more per task than its benchmark results predict. Plenty of data behind it.
56 Β±9
Chatty (56 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Qwen3 VL Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
β‰ˆ 125
From 21 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.20cache read $0.04$1.60cache write $0.25262K
43.5
Poor value (43.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Qwen3 VL Plus
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Inference by Alibaba Cloud
β‰ˆ 125
From 21 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.20cache read $0.04$1.60cache write $0.25Not published by the provider
43.5
Poor value (43.5). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Gemini 3.1 Flash Lite
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared release dates and version names in our catalogue.
125.3
From 275 benchmarks. Plenty of data behind it.
97Β Β±10
Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$1.501M
55.5
Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini 3.1 Flash Lite
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini 3.5 Flash LiteWe compared release dates and version names in our catalogue.
Inference by Google
125.3
From 275 benchmarks. Plenty of data behind it.
97Β Β±10
Coding IQ 97.2, 95% interval 88–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$1.50Not published by the provider
55.5
Good value (55.5). Cheaper per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
145
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-1080p
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00131KNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-360p
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00131KNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-4k
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00131KNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-720p
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00131KNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-1080p
Inference by Google
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00Not published by the providerNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-360p
Inference by Google
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00Not published by the providerNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-4k
Inference by Google
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00Not published by the providerNot enough data yetNot measuredNot measured
Gemini Omni 1.1 Flash
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGemini Omni 1.2 FlashWe compared the version names in our catalogue.
video-720p
Inference by Google
β‰ˆ 125
From 8 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$1.50$9.00Not published by the providerNot enough data yetNot measuredNot measured
Grok 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
125.2
From 296 benchmarks. Plenty of data behind it.
98Β Β±13
Coding IQ 98.0, 95% interval 85–111. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.75$15.00256K
32.7
Poor value (32.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Grok 4
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
125.2
From 296 benchmarks. Plenty of data behind it.
98Β Β±13
Coding IQ 98.0, 95% interval 85–111. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$3.00cache read $0.75$15.00Not published by the provider
32.7
Poor value (32.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
125.0
From 247 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.26cache read $0.13$0.38164K
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by Alibaba Cloud
125.0
From 247 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.57cache read $0.114$1.71Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by DeepInfra
125.0
From 247 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.26cache read $0.13$0.38Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
deepseek-chat
Inference by DeepSeek
125.0
From 247 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.28cache read $0.028$0.42Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by Nebius AI Studio
125.0
From 247 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.30$0.45Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek V3.2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionDeepSeek V4We compared the version names in our catalogue.
Inference by Novita AI
125.0
From 247 benchmarks. Plenty of data behind it.
101Β Β±7
Coding IQ 101.2, 95% interval 94–108. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.269cache read $0.1345$0.40Not published by the provider
63.8
Good value (63.8). Cheaper per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
gemma-4-26b-a4b-it
124.9
From 216 benchmarks. Plenty of data behind it.
102Β Β±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.067cache read $0.01$0.29262K
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-26b-a4b-it
Inference by DeepInfra
124.9
From 216 benchmarks. Plenty of data behind it.
102Β Β±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.34Not published by the provider
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 4 26B A4B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
google/gemma-4-26b-a4b-it
Inference by Novita AI
124.9
From 216 benchmarks. Plenty of data behind it.
102Β Β±8
Coding IQ 101.7, 95% interval 94–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.13$0.40Not published by the provider
56.4
Good value (56.4). Cheaper per task than its benchmark results predict. A fair amount of data behind it.
50 Β±9
Typical (50 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
141.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
Inference by Microsoft Azure
124.6
From 388 benchmarks. Plenty of data behind it.
98Β Β±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00Not published by the provider
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT-5 mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Newer version
Newer versionGPT-5.4 miniWe compared release dates and version names in our catalogue.
Inference by OpenAI
124.6
From 388 benchmarks. Plenty of data behind it.
98Β Β±14
Coding IQ 98.3, 95% interval 85–112. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.025$2.00Not published by the provider
55.1
Good value (55.1). Cheaper per task than its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
146
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Ling 3.0 Flash VL
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
β‰ˆ 125
From 3 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.06cache read $0.012$0.18131K
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Ling 3.0 Flash VL
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Inference by DeepInfra
β‰ˆ 125
From 3 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.06cache read $0.012$0.18Not published by the provider
65.3
Good value (65.3). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Grok 4.3
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
124.2
From 205 benchmarks. Plenty of data behind it.
101Β Β±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.501M
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Grok 4.3
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
xai.grok-4.3
Inference by Amazon Web Services
124.2
From 205 benchmarks. Plenty of data behind it.
101Β Β±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.50Not published by the provider
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Grok 4.3
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
124.2
From 205 benchmarks. Plenty of data behind it.
101Β Β±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.50Not published by the provider
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Grok 4.3
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by xAI
124.2
From 205 benchmarks. Plenty of data behind it.
101Β Β±8
Coding IQ 101.2, 95% interval 94–109. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.25cache read $0.20$2.50Not published by the provider
39.3
Poor value (39.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT-5.1 Codex Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Microsoft Azure
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.025$2.00Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT-5.1 Codex Mini
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by OpenAI
123.8
From 24 benchmarks. Plenty of data behind it.
Not enough data yet$0.25cache read $0.025$2.00Not published by the provider
62.1
Good value (62.1). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Sakana Namazu
πŸ‡―πŸ‡΅
Maker headquartered in JP, according to the company's own website. The citation is on the model page.
β‰ˆ 124
From 3 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.95cache read $0.15$4.00262KNot enough data yetNot measuredNot measured
Sakana Namazu
πŸ‡―πŸ‡΅
Maker headquartered in JP, according to the company's own website. The citation is on the model page.
sakana-namazu-v1.0
Inference by Sakana AI
β‰ˆ 124
From 3 benchmarks. Little data behind it, so treat it as a rough estimate.
Not enough data yet$0.95cache read $0.15$4.00Not published by the providerNot enough data yetNot measuredNot measured
Gemini Embedding 001
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
123.5
From 68 benchmarks. Plenty of data behind it.
Not enough data yet$0.15β€”2KNot enough data yetNot measuredNot measured
Gemini Embedding 001
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Inference by Google
123.5
From 68 benchmarks. Plenty of data behind it.
Not enough data yet$0.15β€”Not published by the providerNot enough data yetNot measuredNot measured
Qwen3.6 27B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionQwen 3.8 27BWe compared release dates and version names in our catalogue.
123.4
From 160 benchmarks. Plenty of data behind it.
101Β Β±6
Coding IQ 100.9, 95% interval 95–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$1.3516K
39.6
Poor value (39.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GLM 4.6
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
123.1
From 174 benchmarks. Plenty of data behind it.
96Β Β±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55cache read $0.11$2.20205K
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 4.6
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Alibaba Cloud
123.1
From 174 benchmarks. Plenty of data behind it.
96Β Β±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.431$2.007Not published by the provider
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 4.6
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
zai-glm-4.6
Inference by Cerebras
123.1
From 174 benchmarks. Plenty of data behind it.
96Β Β±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$2.25$2.75Not published by the provider
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 4.6
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Novita AI
123.1
From 174 benchmarks. Plenty of data behind it.
96Β Β±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.55cache read $0.11$2.20Not published by the provider
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GLM 4.6
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionGLM 5.3We compared release dates and version names in our catalogue.
Inference by Z.ai
123.1
From 174 benchmarks. Plenty of data behind it.
96Β Β±22
Coding IQ 96.0, 95% interval 74–118. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.11$2.20Not published by the provider
46.8
Poor value (46.8). Costs more per task than its benchmark results predict. Plenty of data behind it.
48 Β±9
Typical (48 Β±9). Generates about as many tokens as models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
Seed 2.0 Liteseed-2-0-lite-260428 Β· 260428
123.0
From 7 benchmarks. A fair amount of data behind it.
β‰ˆ 106Β Β±10
Coding IQ 105.8, 95% interval 96–116. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.25cache read $0.05$2.00262K
56.0
Good value (56.0). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works