Question
What MMLU benchmark score will Google DeepMind's Gemini model have on release?
Resolved:71.8Total Forecasters19
Community Prediction
74.4
(71.9 - 84.2)
Make a Prediction
CDF
| Quartiles | community | My Prediction |
| lower 25% | 71.85 | — |
| median | 74.45 | — |
| upper 75% | 84.21 | — |
What was the final result?71.8
Community Baseline Score
-18.2
Community Peer Score
0.8
Authors:
Opened:Oct 27, 2023
Closes:Dec 31, 2024
Resolves:Dec 31, 2024
Spot Scoring Time:Oct 30, 2023
Authors:
Opened:Oct 27, 2023
Closes:Dec 31, 2024
Resolves:Dec 31, 2024
Spot Scoring Time:Oct 30, 2023
