Questions
Tournaments
Services
News
Questions
Tournaments
Questions
Questions
More
Log in
Sign Up
a
/
文
Log in
Sign Up
1
comment
26
forecasters
What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be, at the end of 2022?
community
91.9
result
90.939
Share
Forecast Timeline
1d
1w
2m
all
Comments
Timeline
Question Info
Resolution Criteria
Background Info
Follow
embed
Authors:
Tamay
Opened:
Nov 1, 2020
Closes:
Dec 31, 2021
Resolved:
Jan 1, 2023
Spot Scoring Time:
Nov 3, 2020
AI Technical Benchmarks
Artificial Intelligence
2016-2025 Leaderboard
Similar Questions
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.7%
(92.3 - 98.7)
96.7%
(92.3 - 98.7)
11
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?
99.1%
(96.3 - 99.7)
99.1%
(96.3 - 99.7)
22
forecasters
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
60.5%
(51.7 - 71.7)
60.5%
(51.7 - 71.7)
47
forecasters
Show More Questions