Question

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

6 comments6

Total Forecasters32

Community Prediction

60%

(50% - 67%)

Make a Prediction

50%

community: 60%

No key factors yetAdd some that might influence this forecast.

Add key factor

Authors:

Lawrence

Opened:

Jan 7, 2023

Closes:

Dec 31, 2025

Scheduled resolution:

Jan 1, 2027

Spot Scoring Time:

Jan 9, 2023

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

2021-2025 Leaderboard

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

23 Sep 2025

How many billions of parameters will the largest machine learning model trained before 2030 have?

1.44M

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

28%