18 comments
76 forecasters
What will be the best accuracy score on the MATH dataset by 2025?
Forecast Timeline
Authors:
Opened:Dec 13, 2021
Closes:Jan 1, 2025
Resolved:Jan 1, 2025
Spot Scoring Time:Dec 15, 2021
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.7%
(92.3 - 98.7)
96.7%
(92.3 - 98.7)
11 forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?
99.1%
(96.3 - 99.7)
99.1%
(96.3 - 99.7)
22 forecasters
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
60.8%
(51.6 - 72.1)
60.8%
(51.6 - 72.1)
47 forecasters