Claude 3.7 Sonnet
LatestAnthropic
•
Proprietary# 75
Released
Feb 24, 2025
# 9
Knowledge Cutoff
Oct 24
# 9
Context Length
200K
Benchmarks
# 71
Code RankedAGI
56.4%
# 31
SWEBench Verified
70.3%
# 71
Agentic RankedAGI
44.7%
# 17
Code LMArena
1326
# 17
Cyber Gym
14.5%
# 18
Aider Polyglot
60.4%
# 8
Code LiveBench (old)
67.5%
# 120
Reason RankedAGI
38.7%
# 60
HLE
8.0%
# 71
GPQA Diamond
68.0%
# 43
Text Arena
1365
# 43
AIME 2024
23.3%
# 23
NYT Connections
19.2%
# 24
MMMU
71.8%
# 13
Avg LiveBench (old)
65.6%
# 4
IF Evaluation
90.8%
# 34
Coding LiveBench 25.4
32.4%
# 16
Data LiveBench
63.4%
# 7
Language LiveBench
56.8%
# 122
Math RankedAGI
48.2%
# 90
RAGI RankedAGI
48.0%
# 37
GDPval AA
1047
# 14
Svelte Bench v1
56.7%
# 21
Code DesignArena
1241
Pricing
# 38
Input Cost /M
$3
# 44
Output Cost /M
$15