RankedAGI Logo
RankedAGI
Beta
Meta logo

Llama 3.1

Old

Meta

•

Open Source

•

70B
# 110

Released

Jul 23, 2024

# 17

Knowledge Cutoff

Dec 23

# 13

Context Length

128K

chart

Benchmarks

# 184

Code RankedAGI

26.4%

# 164

Agentic RankedAGI

24.4%

# 49

Code LMArena

1209

# 54

Code LiveBench (old)

32.7%

# 153

Reason RankedAGI

34.1%

# 113

GPQA Diamond

43.0%

# 80

Text Arena

1242

# 30

Human Eval

80.5%

# 55

MMLU Pro

66.4%

# 22

MMLU

86.0%

# 31

Halluc. Hughes

5.0%

# 39

Avg LiveBench (old)

50.9%

# 12

IF Evaluation

87.5%

# 35

Data LiveBench

49.1%

# 41

Language LiveBench

34.6%

# 17

Quality Artificial Analysis

65

# 149

Math RankedAGI

41.4%

# 168

RAGI RankedAGI

35.8%

coins

Pricing

# 28

Input Cost /M

$1

# 29

Output Cost /M

$3