Skip to content

Meta · Chat

code-llama-7b-instruct

Meta 🇺🇸ChatLlama family
llminfo IQ
81.9
Market median price
$0.20 blended / 1M
Max context
16K
Listings
1

Evidence and sources

llminfo IQ 81.9, ranked among chat models. From 58 benchmarks. A fair amount of data behind it.How llminfo IQ is computedReleased 24 Aug 2023Maker HQ: US (according to Meta's own website)
All rankings: #9 in Bluesky discussions this weekSources: LiteLLM data, llminfo researchPrimary data from LiteLLM from llminfo research: release date

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 4 market median prices.

Input & output

as stated by the model's providers
Text
Text

Listings

 Fireworks AIfireworks_ai/accounts/fireworks/models/code-llama-7b-instructSource: LiteLLM data16K$0.20$0.20

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Coding

Reasoning

Other

FinBen66 related benchmarks · 66 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, F1
Australian Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, Acc
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 60 more resultsHide 60 results
BigData22 F1
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, F1
ccf Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, Acc
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccfraud Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, Acc
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, F1
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, Acc
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFP Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, Macro F1
EFP MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, MCC
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, Acc
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
EFPA Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, Macro F1
EFPA MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, MCC
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, Acc
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinanceES Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, Macro F1
FinanceES MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, MCC
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, German, Acc
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, Acc
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, Acc
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
MultiFin-ES Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, Macro F1
MultiFin-ES MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, MCC
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, Acc
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
portoseguro Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, Acc
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
SC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, Acc
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, Acc
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, Acc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, Acc
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1
TSA-Spanish Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, Macro F1
TSA-Spanish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, MCC

Data credits: The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages.

Around the web

Also known as: fireworks_ai/accounts/fireworks/models/code-llama-7b-instruct

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works