Question
When will a language model meet or exceed the human baseline on SuperGLUE?
Resolved:30 Dec 2020 01:30Total Forecasters37
Community Prediction
11 Mar 2021
(26 Dec 2020 09:39 - 28 Jun 2021)
Make a Prediction
CDF
| Quartiles | community | My Prediction |
| lower 25% | 26 Dec 2020 09:39 | — |
| median | 11 Mar 2021 | — |
| upper 75% | 28 Jun 2021 | — |
| Upper bound | ||
| >21 Jul 2024 | 0.4% | — |
What was the final result?30 Dec 2020 01:30
Community Baseline Score
90.9
Community Peer Score
46.6
Authors:
Opened:Aug 6, 2020
Closes:Nov 1, 2020
Resolves:Dec 30, 2020
Spot Scoring Time:Aug 8, 2020
Authors:
Opened:Aug 6, 2020
Closes:Nov 1, 2020
Resolves:Dec 30, 2020
Spot Scoring Time:Aug 8, 2020