Questions
Tournaments
Services
News
Questions
Tournaments
Questions
Questions
More
Log in
Sign Up
a
/
文
Log in
Sign Up
6
comments
37
forecasters
When will a language model meet or exceed the human baseline on SuperGLUE?
community
11 Mar 2021
result
30 Dec 2020 01:30
Share
Forecast Timeline
1d
1w
2m
all
Comments
Timeline
Question Info
Resolution Criteria
Background Info
Follow
embed
Authors:
Matthew_Barnett
Opened:
Aug 6, 2020
Closes:
Nov 1, 2020
Resolved:
Dec 30, 2020
Spot Scoring Time:
Aug 8, 2020
AI Technical Benchmarks
Artificial Intelligence
2020 Leaderboard
Similar Questions
When will a language model be developed that, when tested, yields approximately human-level output?
05 Jun 2024
(05 May 2023 - 10 Feb 2027)
05 Jun 2024
(05 May 2023 - 10 Feb 2027)
36
forecasters
What will be the best score by an AI on the full Humanity's Last Exam (HLE) before 2026?
60.6%
(49.5 - 72.8)
60.6%
(49.5 - 72.8)
47
forecasters
When will an AI achieve an score of 1.5 or higher in the RE-bench at any time budget between 8h and 32h?
25 Dec 2027
(26 Mar 2027 - 15 Dec 2028)
25 Dec 2027
(26 Mar 2027 - 15 Dec 2028)
38
forecasters
Show More Questions