Contributed by the David Mathers' Community community.
Question
When will models hit 75% on SWE-Bench [Edit: Verified version]
Resolved:12 Jun 2025Total Forecasters11
Community Prediction
02 Aug 2025
(19 Mar 2025 - 24 May 2026)
Make a Prediction
CDF
| Lower bound | community | My Prediction |
| <14 Aug 2024 | 5.1% | — |
| Quartiles | ||
| lower 25% | 19 Mar 2025 | — |
| median | 02 Aug 2025 | — |
| upper 75% | 24 May 2026 | — |
| Upper bound | ||
| >Dec 2060 | 0.1% | — |
What was the final result?12 Jun 2025
Community Peer Score
0.6
Authors:
Opened:Aug 16, 2024
Closes:Dec 31, 2060
Resolves:Jan 15, 2061
Spot Scoring Time:Aug 19, 2024
Authors:
Opened:Aug 16, 2024
Closes:Dec 31, 2060
Resolves:Jan 15, 2061
Spot Scoring Time:Aug 19, 2024