Skip to content

Listings

All listings: Groq

Every listing for the models on page 1 of 2 of Groq, including each model's other versions and routes. Back to Groq

Sold by Groq

22 listings on this page sold by Groq.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
Modelllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
Qwen 3.8 27B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
129.4
From 251 benchmarks. Plenty of data behind it.
111Β Β±7
Coding IQ 111.4, 95% interval 104–119. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.80$4.00131K
39.7
Poor value (39.7). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
152.6
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3.6 27B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionQwen 3.8 27BWe compared release dates and version names in our catalogue.
123.4
From 160 benchmarks. Plenty of data behind it.
101Β Β±6
Coding IQ 100.9, 95% interval 95–107. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60cache read $0.30$3.00131K
39.6
Poor value (39.6). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
146.7
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2 Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
121.0
From 184 benchmarks. Plenty of data behind it.
93Β Β±6
Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00cache read $0.50$3.00131K
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
Kimi K2 Instruct
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
moonshotai/kimi-k2-instruct-0905 Β· 0905
121.0
From 184 benchmarks. Plenty of data behind it.
93Β Β±6
Coding IQ 93.0, 95% interval 87–99. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$1.00$3.00Not published by the provider
50.2
Fair value (50.2). Costs per task about what its benchmark results predict. Plenty of data behind it.
Not measuredNot measured
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 32B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
115.6
From 234 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.8, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.29$0.59Not published by the provider
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
DeepSeek R1 Distill Llama 70b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
113.4
From 20 benchmarks. Plenty of data behind it.
β‰ˆ 79Β Β±12stale
Coding IQ 79.4, 95% interval 67–91. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$0.75$0.99131K
44.2
Poor value (44.2). Costs more per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
Llama 4 Maverick
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/llama-4-maverick-17b-128e-instruct
111.8
From 350 benchmarks. Plenty of data behind it.
78Β Β±9
Coding IQ 78.1, 95% interval 69–87. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.60131K
42.1
Poor value (42.1). Costs more per task than its benchmark results predict. Plenty of data behind it.
38 Β±9
Terse (38 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
132.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075cache read $0.0375$0.30131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.1 405B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
llama-3.1-405b-reasoning Β· reasoning
109.7
From 26 benchmarks. Plenty of data behind it.
Not enough data yet$0.59$0.79Not published by the providerNot enough data yetNot measured
127.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/llama-4-scout-17b-16e-instruct
106.2
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.11$0.34Not published by the provider
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Gemma 2 9B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
102.3
From 133 benchmarks. Plenty of data behind it.
β‰ˆ 76Β Β±10
Coding IQ 75.7, 95% interval 65–86. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.20$0.20Not published by the providerNot enough data yetNot measuredNot measured
Gemma 7B IT
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
84.5
From 75 benchmarks. Plenty of data behind it.
β‰ˆ 76Β Β±12
Coding IQ 75.7, 95% interval 64–88. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.07$0.07Not published by the providerNot enough data yetNot measuredNot measured
Llama Prompt Guard 2 22M
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Not enough data yetNot enough data yet$0.03$0.03512Not enough data yetNot measuredNot measured
Llama 3.2 1B Preview
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Not enough data yetNot enough data yet$0.04$0.04Not published by the providerNot enough data yetNot measuredNot measured
Llama Prompt Guard 2 86m
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Not enough data yetNot enough data yet$0.04$0.04512Not enough data yetNot measuredNot measured
Llama 3.1 8B Instant
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Not enough data yetNot enough data yet$0.05$0.08131KNot enough data yetNot measuredNot measured
Llama3 8B 8192
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Not enough data yetNot enough data yet$0.05$0.08Not published by the providerNot enough data yetNot measuredNot measured
Llama 3.2 3B Preview
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Not enough data yetNot enough data yet$0.06$0.06Not published by the providerNot enough data yetNot measuredNot measured
GPT OSS Safeguard 20B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Not enough data yetNot enough data yet$0.075cache read $0.0375$0.30131K
61.7
Good value (61.7). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
llama-3.2-11b-text-preview
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Not enough data yetNot enough data yet$0.18$0.18Not published by the providerNot enough data yetNot measuredNot measured
Llama 3.2 11B Vision Preview
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Not enough data yetNot enough data yet$0.18$0.18Not published by the providerNot enough data yetNot measuredNot measured

Run by Groq

28 listings on this page where Groq runs the model. Another provider sells these listings.

Select a score for details.

About these columns
llminfo IQ
llminfo IQ (capability index). How llminfo IQ is computed
Coding IQ
llminfo Coding IQ (coding capability, its own scale). How Coding IQ is computed
Value
Value for money. 50 means as expected for its results. Above 50, cheaper per task. How Value for money works
Yap
Tokens used per coding task vs. models with the same results. Includes agents that write code. Chattiness on maths doesn't predict it. How the Yap score works
ModelProviderllminfo IQCoding IQInput $/1MOutput $/1MMax Input TokensValueYapEpoch Capabilities Index
MiniMax M2.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
119.8
From 207 benchmarks. Plenty of data behind it.
98Β Β±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.60$1.80197K
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
MiniMax M2.7
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
πŸ‡ΊπŸ‡Έ US
Β NanoGPT
119.8
From 207 benchmarks. Plenty of data behind it.
98Β Β±12
Coding IQ 98.4, 95% interval 87–110. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.63$1.89Not published by the provider
50.7
Fair value (50.7). Costs per task about what its benchmark results predict. Plenty of data behind it.
61 Β±9
Chatty (61 Β±9). Generates more tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
Not measured
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Llmgateway
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.75Not published by the provider
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
πŸ‡ΊπŸ‡Έ US
Β NanoGPT
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.1575cache read $0.0788$0.63Not published by the provider
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β OpenRouter
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15cache read $0.075$0.60131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 120B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
118.2
From 424 benchmarks. Plenty of data behind it.
86Β Β±5
Coding IQ 85.5, 95% interval 80–91. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.15$0.75131K
58.4
Good value (58.4). Cheaper per task than its benchmark results predict. Plenty of data behind it.
37 Β±11
Terse (37 Β±11). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
140.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Kimi K2
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionKimi K3.1We compared the version names in our catalogue.
moonshotai/kimi-k2-instruct
Β Llmgateway
117.4
From 30 benchmarks. Plenty of data behind it.
β‰ˆ 95Β Β±16stale
Coding IQ 95.1, 95% interval 80–111. Little data behind it, so treat it as a rough estimate. Uses the model's best published results. It has its own scale, separate from llminfo IQ. Its newest result is over a year old.
$1.00cache read $0.50$3.00Not published by the provider
52.3
Fair value (52.3). Costs per task about what its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measured
141.3
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Qwen3 32B
πŸ‡¨πŸ‡³
Maker headquartered in CN, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
115.6
From 234 benchmarks. Plenty of data behind it.
85Β Β±9
Coding IQ 84.8, 95% interval 76–93. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.29$0.59131K
35.8
Poor value (35.8). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
136.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AI
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075cache read $0.0375$0.30131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075$0.30131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Llmgateway
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.50Not published by the provider
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
πŸ‡ΊπŸ‡Έ US
Β NanoGPT
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0788cache read $0.0394$0.315Not published by the provider
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β OpenRouter
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.075cache read $0.0375$0.30131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
GPT OSS 20b
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Requesty
111.3
From 251 benchmarks. Plenty of data behind it.
88Β Β±12
Coding IQ 88.2, 95% interval 76–101. Plenty of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.10$0.50131K
48.9
Fair value (48.9). Costs per task about what its benchmark results predict. Plenty of data behind it.
40 Β±9
Terse (40 Β±9). Generates fewer tokens than models with similar coding results. Measured at default effort. Little data behind it, so treat it as a rough estimate.
134.9
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging Face
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.59$0.79131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
πŸ‡ΊπŸ‡Έ US
Β NanoGPT
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.6195cache read $0.3098$0.8295Not published by the provider
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.3 70B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β OpenRouter
108.1
From 278 benchmarks. Plenty of data behind it.
77Β Β±9
Coding IQ 77.1, 95% interval 68–86. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.59cache read $0.295$0.79131K
31.6
Poor value (31.6). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measured
126.2
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 4 Scout
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
meta-llama/Llama-4-Scout-17B-16E-Instruct
Β Hugging Face
106.2
From 347 benchmarks. Plenty of data behind it.
69Β Β±8
Coding IQ 69.3, 95% interval 61–78. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.11$0.34131K
30.3
Poor value (30.3). Costs more per task than its benchmark results predict. Plenty of data behind it.
Not measured
127.8
Epoch Capabilities IndexSource: Epoch AI Benchmarking Hub API
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
Β Hugging Face
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05$0.08131K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
πŸ‡ΊπŸ‡Έ US
Β NanoGPT
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.0525cache read $0.0263$0.084Not published by the provider
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Llama 3.1 8B Instruct
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Newer version
Newer versionLlama-3.3-8B-InstructWe compared the version names in our catalogue.
Β OpenRouter
95.6
From 343 benchmarks. Plenty of data behind it.
70Β Β±9
Coding IQ 69.9, 95% interval 61–79. A fair amount of data behind it. Uses the model's best published results. It has its own scale, separate from llminfo IQ.
$0.05cache read $0.025$0.08131K
39.5
Poor value (39.5). Costs more per task than its benchmark results predict. A fair amount of data behind it.
Not measuredNot measured
Llama Prompt Guard 2 22M
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AINot enough data yetNot enough data yet$0.03cache read $0.015$0.03512Not enough data yetNot measuredNot measured
Llama Prompt Guard 2 86m
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AINot enough data yetNot enough data yet$0.04cache read $0.02$0.04512Not enough data yetNot measuredNot measured
GPT OSS Safeguard 20B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Eden AINot enough data yetNot enough data yet$0.075cache read $0.0375$0.30131K
61.7
Good value (61.7). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT OSS Safeguard 20B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
Β Hugging FaceNot enough data yetNot enough data yetβ€”β€”131K
61.7
Good value (61.7). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured
GPT OSS Safeguard 20B
πŸ‡ΊπŸ‡Έ
Maker headquartered in US, according to the company's own website. The citation is on the model page.
Open weights. The weights are publicly available, according to the provider's model list or a public Hugging Face repo.
πŸ‡ΊπŸ‡Έ US
Β NanoGPTNot enough data yetNot enough data yet$0.0788cache read $0.0394$0.315Not published by the provider
61.7
Good value (61.7). Cheaper per task than its benchmark results predict. Little data behind it, so treat it as a rough estimate.
Not measuredNot measured

Data credits: Epoch AI Benchmarking Hub, CC BY 4.0 (licence)

How this data works