Claude 3.7 Sonnet
LatestAnthropic
•
Proprietary# 88
Released
Feb 24, 2025
# 9
Knowledge Cutoff
Oct 24
# 10
Context Length
200K
Benchmarks
# 81
Code RankedAGI
52.1%
# 32
SWEBench Verified
70.3%
# 94
Agentic RankedAGI
45.5%
# 11
Code LMArena
1326
# 15
Cyber Gym
14.5%
# 14
Aider Polyglot
60.4%
# 7
Code LiveBench (old)
67.5%
# 135
Reason RankedAGI
40.6%
# 60
HLE
8.0%
# 63
GPQA Diamond
68.0%
# 49
Text Arena
1365
# 36
AIME 2024
23.3%
# 21
NYT Connections
19.2%
# 19
MMMU
71.8%
# 11
Avg LiveBench (old)
65.6%
# 3
IF Evaluation
90.8%
# 27
Coding LiveBench 25.4
32.4%
# 14
Data LiveBench
63.4%
# 6
Language LiveBench
56.8%
# 151
Math RankedAGI
47.9%
# 107
RAGI RankedAGI
47.6%
# 39
GDPval AA
1047
# 13
Svelte Bench v1
56.7%
# 30
Code DesignArena
1226
Pricing
# 39
Input Cost /M
$3
# 46
Output Cost /M
$15