o1 Preview
OldOpenAI
•
Proprietary# 114
Released
Sep 12, 2024
# 19
Knowledge Cutoff
Oct 23
# 13
Context Length
128K
Benchmarks
# 101
Code RankedAGI
47.9%
# 57
SWEBench Verified
41.0%
# 108
Agentic RankedAGI
41.6%
# 20
LiveCodeBench v5
55.6%
# 19
Code LMArena
1312
# 26
Codeforces ELO
1258
# 31
Code LiveBench (old)
50.8%
# 91
Reason RankedAGI
49.2%
# 63
GPQA Diamond
73.3%
# 47
Text Arena
1388
# 31
AIME 2024
56.7%
# 3
Human Eval
92.4%
# 1
Human Eval+
89.0%
# 4
MMLU
91.0%
# 21
Halluc. Hughes
3.3%
# 5
Aidan Bench
1892
# 9
Avg LiveBench (old)
69.1%
# 15
Data LiveBench
64.0%
# 2
Language LiveBench
68.7%
# 3
Quality Artificial Analysis
85
# 119
Math RankedAGI
56.3%
# 103
RAGI RankedAGI
48.3%
Pricing
# 44
Input Cost /M
$15
# 50
Output Cost /M
$60
Additional Details
Model ID
o1-preview
Last Updated
about 1 month ago