34 comments
103 forecasters
What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?
This question is closed for predictions, and is waiting to be resolved
Authors:
Opened:Dec 14, 2020
Closed:Feb 13, 2025
Scheduled resolution:Dec 13, 2026
What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?
23 forecasters
In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?
20 forecasters
What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?
78 forecasters