Evidence and sources
🤗 nvidia/Nemotron-4-340B-Instructllminfo IQ ≈ 107, ranked among chat models. From 75 benchmarks. Little data behind it, so treat it as a rough estimate.How llminfo IQ is computedReleased 13 Jun 2024Maker HQ: US (source)
Sources: LMArena data, Hugging FacePrimary data from LMArena
from Hugging Face: release date
Advantages and trade-offs
Compared with 10 chat models, picked mainly by popularity and IQ
Trade-offs
Input & output
from the model's typeText
Text
Listings
We don't have any priced listings for this model yet.
1 listing without a price is hidden.
Benchmarks
Named effort levels run from lowest to highest. Select a result to see its source details.
Human preference
Arena ELO26 related benchmarks · 26 results
Source: LMArena data · Nov 2026
| Benchmark | Score |
|---|---|
| Arena ELO | |
| Chinese | |
| Creative Writing | |
| English |
Show 22 more benchmarksHide 22 benchmarks
WildBench26 related benchmarks · 26 results
WB_Elo
Source: WildBench direct data
allenai/WildBench, WB_Elo
gpt4t_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.K: -1, gpt-4-turbo-2024-04-09
gpt4t_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09
gpt4t_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.task_macro.K: -1, gpt-4-turbo-2024-04-09
Show 20 more resultsHide 20 results
haiku_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Creative Tasks.K: -1, claude-3-haiku-20240307
haiku_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Information/Advice seeking.K=-1, claude-3-haiku-20240307
haiku_reward.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.K: -1, claude-3-haiku-20240307
haiku_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Planning & Reasoning.K=-1, claude-3-haiku-20240307
haiku_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.task_macro.K: -1, claude-3-haiku-20240307
llama_reward.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Creative Tasks.K: -1, Llama-2-70b-chat-hf
llama_reward.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Information/Advice seeking.K=-1, Llama-2-70b-chat-hf
llama_reward.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.K: -1, Llama-2-70b-chat-hf
llama_reward.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Planning & Reasoning.K=-1, Llama-2-70b-chat-hf
llama_reward.task_macro.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.task_macro.K: -1, Llama-2-70b-chat-hf
mixture_of_rewards.Creative Tasks.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Creative Tasks.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Information/Advice seeking.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Information/Advice seeking.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
mixture_of_rewards.Planning & Reasoning.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Planning & Reasoning.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
task_macro_reward.K=-1
Source: WildBench direct data
allenai/WildBench, task_macro_reward.K: -1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
WB_score
Source: WildBench direct data
allenai/WildBench, WB_score
WB_score.Creative Tasks
Source: WildBench direct data
allenai/WildBench, WB_score.Creative Tasks
WB_score.Information/Advice seeking
Source: WildBench direct data
allenai/WildBench, WB_score.Information/Advice seeking
WB_score.Planning & Reasoning
Source: WildBench direct data
allenai/WildBench, WB_score.Planning & Reasoning
WB_score.task_macro
Source: WildBench direct data
allenai/WildBench, WB_score.task_macro
Coding
Arena ELO - CodingSource: LMArena data · Nov 2026
WildBench5 related benchmarks · 5 results
WB_score.Coding & Debugging
Source: WildBench direct data
allenai/WildBench, WB_score.Coding & Debugging
gpt4t_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Coding & Debugging.K=-1, claude-3-haiku-20240307
llama_reward.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Coding & Debugging.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Coding & Debugging.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Coding & Debugging.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
Math
Arena ELO - MathSource: LMArena data · Nov 2026
WildBench5 related benchmarks · 5 results
WB_score.Math & Data Analysis
Source: WildBench direct data
allenai/WildBench, WB_score.Math & Data Analysis
gpt4t_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, gpt4t_reward.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09
haiku_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, haiku_reward.Math & Data Analysis.K=-1, claude-3-haiku-20240307
llama_reward.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, llama_reward.Math & Data Analysis.K=-1, Llama-2-70b-chat-hf
mixture_of_rewards.Math & Data Analysis.K=-1
Source: WildBench direct data
allenai/WildBench, mixture_of_rewards.Math & Data Analysis.K=-1, gpt-4-turbo-2024-04-09, claude-3-haiku-20240307, Llama-2-70b-chat-hf
Instruction following
Arena ELO - Instruction FollowingSource: LMArena data · Nov 2026
Other
DubesorSource: Dubesor LLM Benchmark
pfgen-bench Japanese generation4 related benchmarks · 8 results
Source: pfgen-bench (Preferred Networks) data docs
| Benchmark | completion/e99a1d3 | qa/chat/0d4b478 |
|---|---|---|
| Score | ||
| Fluency | ||
| Helpfulness | ||
| Truthfulness |
Data credits: LMArena, CC BY 4.0 (licence) · pfgen-bench, Preferred Networks. Apache-2.0 except LLM-generated outputs; aggregate scores only. (licence) · WildBench, Allen Institute for AI
Also known as: nvidia_nim/nvidia/nemotron-4-340b-instruct
Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works