GPT 4o

Old

OpenAI

•

Proprietary

# 50

Released

Nov 20, 2024

# 12

Knowledge Cutoff

Nov 23

# 9

Context Length

128K

Benchmarks

# 83

Code RankedAGI

32.6%

# 36

Aider Polyglot

18.2%

# 28

SWEBench Verified

31.0%

# 29

WebDev Arena

964

# 21

Code LMArena

1306

# 37

Code LiveBench (old)

46.1%

# 73

GPQA Diamond

39.0%

# 27

Reason LiveBench (old)

53.3%

# 21

ELO LMArena

1361

# 42

AIME 2025 I & II

13.0%

# 36

Math LiveBench (old)

42.5%

# 31

MATH

69.0%

# 10

Human Eval

90.0%

# 16

NYT Connections

18.7%

# 20

MMLU Pro

74.7%

# 18

MMLU

86.0%

# 7

Halluc. Hughes

1.5%

# 10

Aidan Bench

1269

# 41

IF LiveBench (old)

64.9%

# 36

Avg LiveBench (old)

53.2%

# 11

IF Evaluation

84.6%

Pricing

# 27

Input Cost /M

$2.5

# 31

Output Cost /M

$10

Additional Details

Model ID

gpt-4o-2024-11-20

Last Updated

3 months ago