44 forecasters

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

OpenAIresult: Yes

Anthropic26.7%

Google DeepMind16%

Forecast Timeline

OpenAI

Anthropic

Google DeepMind

Others (3)

Authors:

Opened:

Mar 28, 2024

Closes:

Jan 1, 2025

Resolved:

Jan 1, 2025

Spot Scoring Time:

Mar 31, 2024

Understanding AI With Timothy B. Lee

Artificial Intelligence

2024 Leaderboard

Microsoft favors Anthropic over OpenAI for Visual Studio Code

Verge•Sep 16, 2025

‘Selling coffee beans to Starbucks’ – how the AI boom could leave AI’s biggest companies behind

TechCrunch•Sep 14, 2025

Thinking Machines Lab wants to make AI models more consistent

TechCrunch•Sep 11, 2025

Learn more about Metaculus NewsMatch