Gemma 2
Latest•
Open Source•
27B# 123
Released
Jun 27, 2024
# 14
Knowledge Cutoff
Jun 24
# 15
Context Length
8K
Benchmarks
# 192
Code RankedAGI
29.8%
# 153
Agentic RankedAGI
33.5%
# 51
Code LMArena
1203
# 52
Code LiveBench (old)
35.9%
# 201
Reason RankedAGI
30.4%
# 93
Text Arena
1220
# 36
Human Eval
51.8%
# 34
NYT Connections
12.2%
# 67
MMLU Pro
56.5%
# 43
MMLU
75.2%
# 12
Aidan Bench
1028
# 53
Avg LiveBench (old)
37.4%
# 48
Data LiveBench
43.6%
# 45
Language LiveBench
32.6%
# 137
Math RankedAGI
51.8%
# 184
RAGI RankedAGI
38.2%
Additional Details
Model ID
gemma-2-27b-it
Last Updated
about 1 year ago