Gemma 2
Latest•
Open Source•
27B# 126
Released
Jun 27, 2024
# 14
Knowledge Cutoff
Jun 24
# 16
Context Length
8K
Benchmarks
# 182
Code RankedAGI
29.6%
# 144
Agentic RankedAGI
34.3%
# 44
Code LMArena
1203
# 49
Code LiveBench (old)
35.9%
# 192
Reason RankedAGI
31.1%
# 87
Text Arena
1220
# 36
Human Eval
51.8%
# 32
NYT Connections
12.2%
# 64
MMLU Pro
56.5%
# 38
MMLU
75.2%
# 12
Aidan Bench
1028
# 50
Avg LiveBench (old)
37.4%
# 45
Data LiveBench
43.6%
# 42
Language LiveBench
32.6%
# 127
Math RankedAGI
52.2%
# 171
RAGI RankedAGI
38.5%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 year ago