Questions
Tournaments
Services
News
Questions
Tournaments
Questions
Questions
More
Log in
Sign Up
a
/
文
Log in
Sign Up
1
comment
60
forecasters
What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2021-06-14?
community
90.8
result
90.939
Share
Forecast Timeline
1d
1w
2m
all
Comments
Timeline
Question Info
Resolution Criteria
Background Info
Follow
embed
Authors:
MetaculusOutlooks
Opened:
Dec 14, 2020
Closes:
Feb 13, 2021
Resolved:
Jun 15, 2021
Spot Scoring Time:
Dec 15, 2020
Forecasting AI Progress
Forecasting AI Progress: Maximum Likelihood Round
Artificial Intelligence
2020-2021 Leaderboard
Similar Questions
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
61%
(51.8 - 72.5)
61%
(51.8 - 72.5)
47
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.7%
(92.3 - 98.7)
96.7%
(92.3 - 98.7)
11
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?
99.1%
(96.3 - 99.7)
99.1%
(96.3 - 99.7)
22
forecasters
Show More Questions