o1 Preview
OldOpenAI
•
Proprietary# 117
Released
Sep 12, 2024
# 19
Knowledge Cutoff
Oct 23
# 14
Context Length
128K
Benchmarks
# 100
Code RankedAGI
47.5%
# 51
SWEBench Verified
41.0%
# 116
Agentic RankedAGI
41.3%
# 17
LiveCodeBench v5
55.6%
# 13
Code LMArena
1312
# 22
Codeforces ELO
1258
# 28
Code LiveBench (old)
50.8%
# 97
Reason RankedAGI
48.3%
# 55
GPQA Diamond
73.3%
# 44
Text Arena
1388
# 25
AIME 2024
56.7%
# 3
Human Eval
92.4%
# 1
Human Eval+
89.0%
# 3
MMLU
91.0%
# 20
Halluc. Hughes
3.3%
# 5
Aidan Bench
1892
# 7
Avg LiveBench (old)
69.1%
# 13
Data LiveBench
64.0%
# 2
Language LiveBench
68.7%
# 3
Quality Artificial Analysis
85
# 115
Math RankedAGI
56.3%
# 102
RAGI RankedAGI
48.0%
Pricing
# 44
Input Cost /M
$15
# 50
Output Cost /M
$60
Additional Details
Model ID
o1-preview
Last Updated
about 3 months ago