Question

What will the state-of-the-art performance on one-shot image classification on miniImageNet be, at 2022-01-14 in accuracy?

Resolved:84.81

8 comments8

Total Forecasters34

Community Prediction

84.7

(83.7 - 85.9)

Make a Prediction

PDF

CDF

	lower 25%	median	upper 75%	>89
community	83.68	84.71	85.92	3.0%
My Prediction	—	—	—	—

Quartiles	community	My Prediction
lower 25%	83.68	—
median	84.71	—
upper 75%	85.92	—
Upper bound
>89	3.0%	—

What was the final result?84.81

Community Baseline Score

11.1

Community Peer Score

35.4

Authors:

MetaculusOutlooks

Opened:

Jan 14, 2021

Closes:

Mar 13, 2021

Resolves:

Mar 22, 2022

Spot Scoring Time:

Jan 16, 2021

Forecasting AI Progress

Forecasting AI Progress: Hill Climbing Round

Artificial Intelligence

2021 Leaderboard

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will be state-of-the-art performance on the MATH dataset on the following dates?

91.1

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

94.2