Question
When will an AI be able to solve over 80% of competition-level coding problems on its first try?
Total Forecasters140
Community Prediction
05 Apr 2027
(21 Jul 2025 00:50 - 12 Nov 2029)
Make a Prediction
CDF
| Quartiles | community | My Prediction |
| lower 25% | 21 Jul 2025 00:50 | — |
| median | 05 Apr 2027 | — |
| upper 75% | 12 Nov 2029 | — |
| Upper bound | ||
| >2081 | 0.4% | — |
No key factors yetAdd some that might influence this forecast.
Add key factor
Authors:
Opened:Jun 18, 2021
Closes:Jun 20, 2081
Scheduled resolution:Jun 20, 2081
Spot Scoring Time:Jun 20, 2021
What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?
91.5
When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?
27 Nov 2025
When will an AI program be better than humans at making Metaculus forecasts?
Dec 2030
Authors:
Opened:Jun 18, 2021
Closes:Jun 20, 2081
Scheduled resolution:Jun 20, 2081
Spot Scoring Time:Jun 20, 2021
What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?
91.5
When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?
27 Nov 2025
When will an AI program be better than humans at making Metaculus forecasts?
Dec 2030