Question

What will the state-of-the-art performance on semantic segmentation of PASCAL-Context be on 2023-02-14 in mean IoU in percent (MIoU%), amongst models not trained on extra data?

Resolved:68.87

4 comments4

Total Forecasters28

Community Prediction

63.7

(61.9 - 65.8)

Make a Prediction

PDF

CDF

	lower 25%	median	upper 75%	>70
community	61.89	63.66	65.76	5.5%
My Prediction	—	—	—	—

Quartiles	community	My Prediction
lower 25%	61.89	—
median	63.66	—
upper 75%	65.76	—
Upper bound
>70	5.5%	—

What was the final result?68.87

Community Baseline Score

-71.4

Community Peer Score

34.9

Authors:

MetaculusOutlooks

Opened:

Feb 16, 2021

Closes:

Apr 14, 2021

Resolves:

Feb 14, 2023

Spot Scoring Time:

Feb 18, 2021

Forecasting AI Progress

AI Technical Benchmarks

Forecasting AI Progress: Deep Learning Round

Artificial Intelligence

2021-2025 Leaderboard

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

94.2

What will be state-of-the-art performance on the MATH dataset on the following dates?

91.1