Question

When will an AI be able to solve over 80% of competition-level coding problems on its first try?

18 comments18

Total Forecasters138

Community Prediction2027-04-27

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>2081-06-20

...

2025-05-26 14:43

2027-04-27 12:44

2030-05-25 12:00

0.5%

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Demonstrations

Artificial Intelligence

Association for Computing Machinery

Computer science

United States of America Computing Olympiad

Data analysis

Software engineering

IOI

What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?

By what year will an AI achieve at least 85% on Francois Chollet's Abstraction and Reasoning Corpus?

2027-06-19

When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?

2025-06-27

Comments

? comments