Questions
Tournaments
Services
News
Questions
Tournaments
Questions
Questions
More
Log in
Sign Up
a
/
文
Log in
Sign Up
4
comments
39
forecasters
What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2022-01-14?
community
91.1
result
90.939
Share
Forecast Timeline
1d
1w
2m
all
Comments
Timeline
Question Info
Resolution Criteria
Background Info
Follow
embed
Authors:
MetaculusOutlooks
Opened:
Jan 15, 2021
Closes:
Mar 13, 2021
Resolved:
Feb 3, 2022
Spot Scoring Time:
Jan 16, 2021
Forecasting AI Progress
Forecasting AI Progress: Hill Climbing Round
Artificial Intelligence
2021 Leaderboard
Similar Questions
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
60.8%
(51.6 - 72.1)
60.8%
(51.6 - 72.1)
47
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.7%
(92.3 - 98.7)
96.7%
(92.3 - 98.7)
11
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?
99.1%
(96.3 - 99.7)
99.1%
(96.3 - 99.7)
22
forecasters
Show More Questions