xAI logo

Grok 2

Latest

xAI

Proprietary
# 119

Released

Aug 13, 2024

# 12

Knowledge Cutoff

Aug 24

# 14

Context Length

128K

chart

Benchmarks

# 181

Code RankedAGI

29.8%

# 191

Agentic RankedAGI

25.6%

# 29

Code LMArena

1253

# 35

Code LiveBench (old)

45.1%

# 171

Reason RankedAGI

34.8%

# 70

HLE

3.9%

# 82

GPQA Diamond

56.0%

# 60

Text Arena

1335

# 14

Human Eval

88.4%

# 13

Human Eval+

80.5%

# 32

MMLU Pro

75.5%

# 15

MMLU

87.5%

# 27

Halluc. Hughes

4.6%

# 17

Aidan Bench

826

# 30

Avg LiveBench (old)

54.4%

# 31

Data LiveBench

50.3%

# 24

Language LiveBench

43.2%

# 13

Quality Artificial Analysis

70

# 163

Math RankedAGI

45.6%

# 182

RAGI RankedAGI

37.3%

coins

Pricing

# 41

Input Cost /M

$5

# 46

Output Cost /M

$15