Question

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

8 comments8

Total Forecasters34

Community Prediction80.3

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

73.26

80.33

87.24

Authors:

elifland

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

Computing and Math

Artificial Intelligence

Artificial intelligence

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.6

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?

Comments

? comments

Authors:

elifland

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

Computing and Math

Artificial Intelligence

Artificial intelligence

Researchers question AI’s ‘reasoning’ ability as models stumble on math problems with trivial changes

TechCrunch•Oct 12, 2024

Here's how Anthropic CEO Dario Amodei defines artificial general intelligence

Business Insider•Oct 13, 2024

The promise and perils of synthetic data

TechCrunch•Oct 13, 2024

Learn more about Metaculus NewsMatch

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.6

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2