Questions
Tournaments
Services
News
Questions
Tournaments
Questions
Questions
More
Log in
Sign Up
a
/
文
Log in
Sign Up
4
comments
30
forecasters
What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2023-02-14?
community
92
result
90.939
Share
Forecast Timeline
1d
1w
2m
all
Comments
Timeline
Question Info
Resolution Criteria
Background Info
Follow
embed
Authors:
MetaculusOutlooks
Opened:
Feb 13, 2021
Closes:
Apr 13, 2021
Resolved:
Feb 15, 2023
Spot Scoring Time:
Feb 15, 2021
Forecasting AI Progress
AI Technical Benchmarks
Forecasting AI Progress: Deep Learning Round
Artificial Intelligence
2021-2025 Leaderboard
Similar Questions
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?
99.1%
(96.3 - 99.7)
99.1%
(96.3 - 99.7)
22
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.7%
(92.3 - 98.7)
96.7%
(92.3 - 98.7)
11
forecasters
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
60.5%
(51.7 - 71.7)
60.5%
(51.7 - 71.7)
47
forecasters
Show More Questions