Contributed by the AI 2025 Forecasting Survey community.

Question

What will be the best performance on SWE-bench Verified by December 31st 2025?

Total Forecasters14
Community Prediction
90.3 score
(84.2 score - 94.3 score)

Make a Prediction

PDF

CDF

QuartilescommunityMy Prediction
lower 25%84.21
median90.32
upper 75%94.3
No key factors yetAdd some that might influence this forecast.
Add key factor
Authors:
Opened:Dec 4, 2024
Closes:Dec 31, 2025
Scheduled resolution:Jan 1, 2026
Spot Scoring Time:Dec 9, 2024