o1 mini

Latest

OpenAI

•

Proprietary

# 59

Released

Sep 12, 2024

# 13

Knowledge Cutoff

Oct 23

# 9

Context Length

128K

Benchmarks

# 55

Code RankedAGI

44.9%

# 29

Aider Polyglot

32.9%

# 26

SWEBench Verified

35.0%

# 20

WebDev Arena

1053.69

# 9

LiveCodeBench v5

68.4%

# 14

Codeforces ELO

1650

# 23

Code LMArena

1292

# 34

Code LiveBench (old)

48.0%

# 40

GPQA Diamond

60.0%

# 10

Reason LiveBench (old)

77.3%

# 30

ELO LMArena

1308

# 20

Math LiveBench (old)

59.2%

# 7

MATH

90.0%

# 17

MATH 500

90.0%

# 3

Human Eval

92.4%

# 1

Human Eval+

89.0%

# 10

NYT Connections

26.4%

# 7

MMLU Pro

80.3%

# 21

MMLU

85.0%

# 6

Halluc. Hughes

1.4%

# 6

Aidan Bench

1577

# 25

AIME 2024

63.6%

# 39

IF LiveBench (old)

65.4%

# 34

Avg LiveBench (old)

53.4%

Pricing

# 28

Input Cost /M

$3

# 32

Output Cost /M

$12

Additional Details

Model ID

o1-mini

Last Updated

3 months ago