Question

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

Resolved:29.38
Total Forecasters25
Community Prediction
30.9
(29.4 - 34.8)

Make a Prediction

PDF

CDF

QuartilescommunityMy Prediction
lower 25%29.44
median30.87
upper 75%34.77

What was the final result?29.38

Community Peer Score
19.6
Authors:
Opened:Mar 24, 2024
Closes:Dec 31, 2024
Resolves:Jan 1, 2025
Spot Scoring Time:Mar 27, 2024