34 comments
60 forecasters
What will be state-of-the-art performance on the MATH dataset on the following dates?
This question is closed for predictions, and is waiting to be resolved
Authors:
Opened:Jul 4, 2022
Closed:Jun 29, 2025
Scheduled resolution:Aug 29, 2025
What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?
78 forecasters
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
51.9%
(40.1 - 62.5)
51.9%
(40.1 - 62.5)
54 forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.7%
(92.3 - 98.7)
96.7%
(92.3 - 98.7)
11 forecasters