7 comments
31 forecasters
What will be the best score on the GPQA benchmark before 2025?
Forecast Timeline
Authors:
Opened:Mar 24, 2024
Closes:Dec 31, 2024
Resolved:Jan 1, 2025
Spot Scoring Time:Mar 27, 2024
In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?
21 forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.9%
(92.6 - 98.8)
96.9%
(92.6 - 98.8)
11 forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?
99.1%
(96.3 - 99.7)
99.1%
(96.3 - 99.7)
22 forecasters