Llama 3.1
LatestMeta
•
Open Source•
8B# 65
Released
Jul 23, 2024
# 11
Knowledge Cutoff
Dec 23
# 9
Context Length
128K
Benchmarks
# 101
Code RankedAGI
19.7%
# 56
Code LMArena
1174
# 64
Code LiveBench (old)
19.7%
# 78
GPQA Diamond
27.0%
# 53
Reason LiveBench (old)
15.3%
# 59
ELO LMArena
1171
# 51
Math LiveBench (old)
16.6%
# 34
MATH
64.0%
# 33
Human Eval
72.6%
# 21
Human Eval+
62.8%
# 53
MMLU Pro
44.3%
# 42
MMLU
71.0%
# 30
Halluc. Hughes
5.4%
Pricing
# 16
Input Cost /M
$0.3
# 17
Output Cost /M
$0.6