Contributed by the David Mathers' Community community.
1 comment
15 forecasters
When will models hit 90% on SWE-Bench (Verified Version)
Current estimate
07 Jan 2026
Key Factors
No key factors yetAdd some that might influence this forecast.
Add key factor
Forecast Timeline
No key factors yetAdd some that might influence this forecast.
Add key factor
Authors:
Opened:Sep 27, 2024
Closes:Dec 31, 2061
Scheduled resolution:Dec 31, 2062
Spot Scoring Time:Sep 30, 2024
When will an AI achieve an score of 1.5 or higher in the RE-bench at any time budget between 8h and 32h?
08 Dec 2027
(30 Apr 2027 - 10 Feb 2029)
08 Dec 2027
(30 Apr 2027 - 10 Feb 2029)
40 forecasters
When will an AI be able to solve over 80% of competition-level coding problems on its first try?
12 May 2027
(10 Sep 2025 - 02 Mar 2030)
12 May 2027
(10 Sep 2025 - 02 Mar 2030)
141 forecasters
When will an AI system achieve a score of at least 85% on the Abstraction and Reasoning Corpus (ARC) benchmark?
22 Feb 2026
(13 Oct 2025 - 30 Dec 2026)
22 Feb 2026
(13 Oct 2025 - 30 Dec 2026)
16 forecasters