Claude 3.5 Haiku
LatestAnthropic
•
Proprietary# 113
Released
Oct 22, 2024
# 13
Knowledge Cutoff
Jul 24
# 10
Context Length
200K
Benchmarks
# 167
Code RankedAGI
33.0%
# 52
SWEBench Verified
40.6%
# 168
Agentic RankedAGI
31.0%
# 25
Code LMArena
1263
# 28
Aider Polyglot
28.0%
# 26
Code LiveBench (old)
51.4%
# 183
Reason RankedAGI
32.3%
# 107
GPQA Diamond
41.6%
# 84
Text Arena
1239
# 15
Human Eval
88.1%
# 36
NYT Connections
10.3%
# 58
MMLU Pro
65.0%
# 31
MMLU
81.0%
# 29
Halluc. Hughes
4.9%
# 15
Aidan Bench
904
# 43
Avg LiveBench (old)
47.8%
# 47
Data LiveBench
42.4%
# 36
Language LiveBench
35.4%
# 14
Quality Artificial Analysis
69
# 175
Math RankedAGI
43.9%
# 174
RAGI RankedAGI
38.3%
# 7
Svelte Bench v1
73.3%
Pricing
# 30
Input Cost /M
$1
# 38
Output Cost /M
$5
# 12
Cached Cost /M
$0.1
Additional Details
Model ID
claude-3-5-haiku-20241022
Last Updated
about 3 months ago