Questions
Tournaments
Services
News
Questions
Tournaments
Questions
Questions
More
Log in
Sign Up
a
/
文
Log in
Sign Up
19
comments
25
forecasters
What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?
community
30.9
result
29.38
Share
Comments
Timeline
Key Factors
Question Info
Timeline
1d
1w
2m
all
Resolution Criteria
Background Info
Follow
embed
Authors:
romeodean
Opened:
Mar 24, 2024
Closes:
Dec 31, 2024
Resolved:
Jan 28, 2025
Spot Scoring Time:
Mar 27, 2024
AI Benchmarks
AI Technical Benchmarks
Artificial Intelligence
🏆 2024 Leaderboard
Similar Questions
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
61.8%
(50.4 - 69.9)
61.8%
(50.4 - 69.9)
23
forecasters
When will an AI achieve an score of 1.5 or higher in the RE-bench at any time budget between 8h and 32h?
12 Aug 2027
(15 Nov 2026 - 13 Jul 2028)
12 Aug 2027
(15 Nov 2026 - 13 Jul 2028)
52
forecasters
What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?
96.9%
(92.6 - 98.8)
96.9%
(92.6 - 98.8)
11
forecasters
Show More Questions