Claude 3.5 Sonnet
OldAnthropic
•
Proprietary# 114
Released
Jun 20, 2024
# 16
Knowledge Cutoff
Apr 24
# 9
Context Length
200K
Benchmarks
# 146
Code RankedAGI
34.5%
# 60
SWEBench Verified
33.4%
# 136
Agentic RankedAGI
29.0%
# 33
LiveCodeBench v5
36.0%
# 28
Code LMArena
1282
# 18
Code LiveBench (old)
60.9%
# 123
Reason RankedAGI
38.1%
# 85
GPQA Diamond
59.4%
# 69
Text Arena
1268
# 5
Human Eval
92.0%
# 12
Human Eval+
81.7%
# 30
MMLU Pro
76.1%
# 13
MMLU
88.7%
# 28
MMMU
68.3%
# 8
Aidan Bench
1439
# 22
Avg LiveBench (old)
59.7%
# 25
Data LiveBench
56.7%
# 10
Language LiveBench
53.2%
# 7
Quality Artificial Analysis
76
# 131
Math RankedAGI
45.0%
# 138
RAGI RankedAGI
39.5%
Pricing
# 38
Input Cost /M
$3
# 44
Output Cost /M
$15