Google logo

Gemma 2

Latest

Google

Open Source

27B
# 123

Released

Jun 27, 2024

# 14

Knowledge Cutoff

Jun 24

# 15

Context Length

8K

chart

Benchmarks

# 192

Code RankedAGI

29.8%

# 153

Agentic RankedAGI

33.5%

# 51

Code LMArena

1203

# 52

Code LiveBench (old)

35.9%

# 201

Reason RankedAGI

30.4%

# 93

Text Arena

1220

# 36

Human Eval

51.8%

# 34

NYT Connections

12.2%

# 67

MMLU Pro

56.5%

# 43

MMLU

75.2%

# 12

Aidan Bench

1028

# 53

Avg LiveBench (old)

37.4%

# 48

Data LiveBench

43.6%

# 45

Language LiveBench

32.6%

# 137

Math RankedAGI

51.8%

# 184

RAGI RankedAGI

38.2%

sparkle-2

Additional Details

Model ID

gemma-2-27b-it

Last Updated

about 1 year ago