• Questions
  • Tournaments
  • Services
  • News
  • Questions
  • Tournaments
  • Questions
  • Questions
Feed Home
๐Ÿ’ฌ
Top Comments
๐Ÿ’ก
Comments Feed
๐Ÿ“ˆ
Indexes
๐Ÿ†
Leaderboards
โš™๏ธ
Labor Hub
๐Ÿฆพ
FutureEval
๐Ÿ‡บ๐Ÿ‡ธ
US Midterms
โš”๏ธ
Metaculus Cup
๐Ÿ’ฅ
Iran War
โ“
Top Questions
๐Ÿ—ž๏ธ
Current Events
๐Ÿ’ผ
Economy & Business
๐Ÿ›๏ธ
Politics
๐ŸŒ
Geopolitics
โš™๏ธ
Technology
๐Ÿค–
Artificial Intelligence
๐Ÿฆ 
Health & Pandemics
๐Ÿ’ป
Computing and Math
๐Ÿ—ณ๏ธ
Elections
๐Ÿ”ฌ
Natural Sciences
๐ŸŒฑ
Environment & Climate
๐Ÿ€
Sports & Entertainment
โš–๏ธ
Law
๐Ÿš€
Space
๐Ÿง‘โ€๐Ÿคโ€๐Ÿง‘
Social Sciences
๐Ÿ”ฎ
Metaculus
โ˜ข๏ธ
Nuclear Technology & Risks
๐Ÿ’ฐ
Cryptoยญcurrencies

Public Benefit Corporation

Metaculus is an online forecasting platform focusing on topics of global importance.

ExploreQuestionsTournamentsTournaments for AI botsFutureEval
ServicesLaunch a TournamentPrivate InstancesPro Forecasters
CompanyAboutCareersFAQ
ResourcesForecasting ResourcesFor JournalistsAPI
GuidelinesPrivacy PolicyTerms of Use

Which of the listed LLMs will integrate a version of output watermarking before January 1, 2025?

6
22 comments
31
31 forecasters

Will an LLM by Apple be ranked in the top-5 on the Chatbot Arena Leaderboard on May 31, 2024?

result: no

9
2020 comments
93
93 forecasters
ResolvedNo

Will a major cyberattack, virus, worm, etc. that uses LLMs in some important way occur before January 1st, 2025?

result: no

16
2121 comments
132
132 forecasters
ResolvedNo

What percentage of developers in 2026 will believe that AI will eventually fully replace human developers?

18% (14 - 22)

-3
1010 comments
143
143 forecasters
18%
(14 - 22)

What percentage of the US workforce will be in computer specialist roles in 2050?

1.1% (0.377 - 3.29)

13
66 comments
22
22 forecasters
1.1%
(0.377 - 3.29)

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

50% chance

9
66 comments
34
34 forecasters
50%chance

When will large language models exceed superforecastersโ€™ accuracy in ForecastBench?

09 Feb 2028 (12 Apr 2027 - Aug 2031)

55 comments
11
11 forecasters
09 Feb 2028
(12 Apr 2027 - Aug 2031)

Will an LLM pass an ARA evaluation before 2025?

result: no

14
1616 comments
39
39 forecasters
ResolvedNo

LLM passes ARA before 2025? โ†’ LLM training paused for dangerous capability? (OpenAI)

5
11 comment
28
28 forecasters

What is the top MMLU score on the following dates?

0 comments

Will a member of the United States Congress introduce legislation limiting the use of LLMs in 2024?

result: yes

9
2626 comments
479
479 forecasters
ResolvedYes

When will LLaMA-3 be released?

23 Apr 2024 01:22 (10 Apr 2024 - 07 May 2024)

5
77 comments
19
19 forecasters
23 Apr 2024 01:22
(10 Apr 2024 - 07 May 2024)

Will a non-proprietary LLM be in the top 5 of the chat.lmsys.org leaderboard on September 30, 2023?

result: no

15
1414 comments
103
103 forecasters
ResolvedNo

Agentized LLM Improves self by July 1, 2023? โ†’ When will agentized-LLMs first cause harm?

4
0 comments
15
15 forecasters

The Role of Special Tokens in LLMs

1
0 comments

Streamlined, LLM-Enhanced Question Discovery

20
99 comments