Claude 3.5 Sonnet
OldAnthropic
•
Proprietary# 124
Released
Jun 20, 2024
# 16
Knowledge Cutoff
Apr 24
# 9
Context Length
200K
Benchmarks
# 164
Code RankedAGI
35.2%
# 62
SWEBench Verified
33.4%
# 182
Agentic RankedAGI
29.9%
# 33
LiveCodeBench v5
36.0%
# 28
Code LMArena
1282
# 18
Code LiveBench (old)
60.9%
# 140
Reason RankedAGI
40.8%
# 87
GPQA Diamond
59.4%
# 78
Text Arena
1268
# 5
Human Eval
92.0%
# 12
Human Eval+
81.7%
# 31
MMLU Pro
76.1%
# 13
MMLU
88.7%
# 28
MMMU
68.3%
# 8
Aidan Bench
1439
# 22
Avg LiveBench (old)
59.7%
# 25
Data LiveBench
56.7%
# 10
Language LiveBench
53.2%
# 7
Quality Artificial Analysis
76
# 169
Math RankedAGI
45.9%
# 164
RAGI RankedAGI
40.5%
Pricing
# 39
Input Cost /M
$3
# 46
Output Cost /M
$15