Gemma 2
Latest•
Open Source•
27B# 113
Released
Jun 27, 2024
# 14
Knowledge Cutoff
Jun 24
# 15
Context Length
8K
Benchmarks
# 190
Code RankedAGI
23.9%
# 197
Agentic RankedAGI
18.2%
# 51
Code LMArena
1203
# 52
Code LiveBench (old)
35.9%
# 188
Reason RankedAGI
26.3%
# 84
Text Arena
1220
# 36
Human Eval
51.8%
# 34
NYT Connections
12.2%
# 66
MMLU Pro
56.5%
# 43
MMLU
75.2%
# 12
Aidan Bench
1028
# 53
Avg LiveBench (old)
37.4%
# 48
Data LiveBench
43.6%
# 45
Language LiveBench
32.6%
# 168
Math RankedAGI
37.1%
# 190
RAGI RankedAGI
32.0%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 year ago