Skip to content

Meta · Chat

codellama-7b

Meta 🇺🇸Chat
llminfo IQ
87.1
Market median price
$0.075 blended / 1M
Max context
16K
Listings
3

Evidence and sources

llminfo IQ 87.1, ranked among chat models. From 71 benchmarks. A fair amount of data behind it.How llminfo IQ is computedMaker HQ: US (according to Meta's own website)
Source: LiteLLM dataPrimary data from LiteLLM

Advantages and trade-offs

Compared with 10 chat models, picked mainly by popularity and IQ

Trade-offs

We only make a claim when there's enough data on models of the same type. Updated 22 Nov, 04:34 UTC.Prices come from the model's maker where they sell it, otherwise their official partner, otherwise the market median. This comparison uses 6 maker's prices; 4 market median prices.

Input & output

as stated by the model's providers
Text
Text

Capabilities

Supported operations and provider-stated features

Function calling

Listings

 Fireworks AIfireworks_ai/accounts/fireworks/models/code-llama-7bSource: LiteLLM data16K$0.20$0.20
 Llamagatellamagate/codellama-7bSource: LiteLLM data16K$0.06$0.12

1 listing without a price is hidden.

Benchmarks

Named effort levels run from lowest to highest. Select a result to see its source details.

Coding

Reasoning

Other

FinBen66 related benchmarks · 66 results
CD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, CD, F1
ACL18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, Acc
ACL18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ACL18, MCC
Australian F1
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, F1
Australian MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, Australian, MCC
BigData22 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, Acc
Show 60 more resultsHide 60 results
BigData22 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, BigData22, MCC
ccf F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, F1
ccf MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccf, MCC
ccfraud F1
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, F1
ccfraud MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, ccfraud, MCC
CIKM18 Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, Acc
CIKM18 MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, CIKM18, MCC
ConvFinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, ConvFinQA, EmAcc
EFP ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, Acc
EFP F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, F1
EFP Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, Macro F1
EFP MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFP, MCC
EFPA ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, Acc
EFPA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, F1
EFPA Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, Macro F1
EFPA MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, EFPA, MCC
FinanceES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, Acc
FinanceES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, F1
FinanceES Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, Macro F1
FinanceES MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, FinanceES, MCC
FinArg-ACC MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinArg-ACC, MicroF1
FINER-ORD EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, EntityF1
FINER-ORD F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FINER-ORD, F1
FinQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, FinQA, EmAcc
FinRED F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FinRED, F1
FiQA-SA F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FiQA-SA, F1
FNXL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FNXL, EntityF1
FOMC Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, Acc
FOMC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FOMC, F1
FPB Acc
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, Acc
FPB F1
Source: TheFinAI public numeric results
published-demo-leaderboard, FPB, F1
FSRL EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, FSRL, EntityF1
German F1
Source: TheFinAI public numeric results
published-demo-leaderboard, German, F1
German MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, German, MCC
Headlines AvgF1
Source: TheFinAI public numeric results
published-demo-leaderboard, Headlines, AvgF1
LendingClub F1
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, F1
LendingClub MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, LendingClub, MCC
MA MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MA, MicroF1
MLESG MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MLESG, MicroF1
MultiFin MicroF1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin, MicroF1
MultiFin-ES ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, Acc
MultiFin-ES F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, F1
MultiFin-ES Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, Macro F1
MultiFin-ES MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, MultiFin-ES, MCC
NER EntityF1
Source: TheFinAI public numeric results
published-demo-leaderboard, NER, EntityF1
polish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, F1
polish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, polish, MCC
portoseguro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, F1
portoseguro MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, portoseguro, MCC
SC F1
Source: TheFinAI public numeric results
published-demo-leaderboard, SC, F1
taiwan F1
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, F1
taiwan MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, taiwan, MCC
TATQA EmAcc
Source: TheFinAI public numeric results
published-demo-leaderboard, TATQA, EmAcc
travelinsurance F1
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, F1
travelinsurance MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, travelinsurance, MCC
TSA RMSE
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA, RMSE
TSA-Spanish ACC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, Acc
TSA-Spanish F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, F1
TSA-Spanish Macro F1
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, Macro F1
TSA-Spanish MCC
Source: TheFinAI public numeric results
published-demo-leaderboard, TSA-Spanish, MCC

Data credits: Codefuse DevOps-Eval. Copyright 2023 Ant Group. Licensed under the Apache License, Version 2.0. Historical 2023 snapshot. (Apache-2.0 licence) · The Fin AI. Published FinBen result summaries and Open Greek Financial LLM Leaderboard aggregates. Results licence not separately stated; fractional FinBen success metrics converted to percentages. · EvalPlus Leaderboard and EvalPerf (evalplus.github.io), Apache-2.0; EvalPerf win-rate fractions converted to percentages (licence)

Also known as: codellama:7b, fireworks_ai/accounts/fireworks/models/code-llama-7b, llamagate/codellama-7b

Like this one. Tap or hover any dotted value, label or icon to see where it comes from and how it is measured. open details when tapped or hovered. How this data works