Contributed by the AI 2025 Forecasting Survey community.

Question

What will be the best performance on SWE-bench Verified by December 31st 2025?

Total Forecasters15
Community Prediction
88.5 score
(83.7 score - 93.1 score)

Make a Prediction

PDF

CDF

QuartilescommunityMy Prediction
lower 25%83.75
median88.5
upper 75%93.09
No key factors yetAdd some that might influence this forecast.
Add key factor
Authors:
Opened:Dec 4, 2024
Closes:Dec 31, 2025
Scheduled resolution:Jan 1, 2026
Spot Scoring Time:Dec 9, 2024