Question

What will the state-of-the-art language modelling performance on One Billion Word be on 2022-01-14, in perplexity?

Resolved:20.25
Total Forecasters41
Community Prediction
21.4
(20.8 - 21.6)

Make a Prediction

PDF

CDF

Lower boundcommunityMy Prediction
<140.5%
Quartiles
lower 25%20.78
median21.39
upper 75%21.59

What was the final result?20.25

Community Baseline Score
12.7
Community Peer Score
36.5
Opened:Jan 14, 2021
Closes:Mar 14, 2021
Resolves:Mar 22, 2022
Spot Scoring Time:Jan 15, 2021