Claude 3 Opus
LatestAnthropic
•
Proprietary# 126
Released
Mar 4, 2024
# 20
Knowledge Cutoff
Aug 23
# 9
Context Length
200K
Benchmarks
# 204
Code RankedAGI
25.5%
# 68
SWEBench Verified
22.0%
# 207
Agentic RankedAGI
22.4%
# 42
Code LMArena
1236
# 46
Code LiveBench (old)
38.6%
# 177
Reason RankedAGI
35.2%
# 102
GPQA Diamond
50.4%
# 87
Text Arena
1248
# 22
Human Eval
84.9%
# 17
Human Eval+
77.4%
# 52
MMLU Pro
68.5%
# 31
MMLU
84.0%
# 42
Halluc. Hughes
10.1%
# 14
Aidan Bench
908
# 29
Avg LiveBench (old)
56.2%
# 28
Data LiveBench
54.3%
# 14
Language LiveBench
50.4%
# 13
Quality Artificial Analysis
70
# 174
Math RankedAGI
44.7%
# 202
RAGI RankedAGI
35.6%
Pricing
# 44
Input Cost /M
$15
# 51
Output Cost /M
$75
# 32
Cached Cost /M
$1.5
Additional Details
Model ID
claude-3-opus-20240229
Last Updated
about 1 year ago