Claude 3.5 Sonnet
LatestAnthropic
•
Proprietary# 100
Released
Oct 22, 2024
# 16
Knowledge Cutoff
Apr 24
# 9
Context Length
200K
Benchmarks
# 120
Code RankedAGI
41.6%
# 50
SWEBench Verified
49.0%
# 123
Agentic RankedAGI
31.5%
# 40
LiveCodeBench v6
36.4%
# 30
LiveCodeBench v5
39.8%
# 18
Code LMArena
1313
# 31
Codeforces ELO
717
# 27
Aider Polyglot
51.6%
# 10
Code LiveBench (old)
67.1%
# 151
Reason RankedAGI
34.2%
# 70
HLE
4.8%
# 77
GPQA Diamond
65.0%
# 50
Text Arena
1355
# 65
AIME 2025 I & II
3.0%
# 44
AIME 2024
16.0%
# 1
Human Eval
93.7%
# 6
Human Eval+
86.2%
# 28
NYT Connections
17.7%
# 26
MMLU Pro
78.0%
# 16
MMLU
88.0%
# 26
MMMU
70.4%
# 28
Halluc. Hughes
4.6%
# 3
Aidan Bench
2691
# 20
Avg LiveBench (old)
60.7%
# 7
IF Evaluation
89.3%
# 35
Coding LiveBench 25.4
32.3%
# 31
Data LiveBench
52.8%
# 9
Language LiveBench
53.8%
# 5
Quality Artificial Analysis
80
# 175
Math RankedAGI
36.3%
# 134
RAGI RankedAGI
40.4%
Pricing
# 38
Input Cost /M
$3
# 44
Output Cost /M
$15
# 24
Cached Cost /M
$0.3