Your submission is now in Draft mode.

Once it's ready, please submit your draft for review by our team of Community Moderators. Thank you!

Submit Essay

Once you submit your essay, you can no longer edit it.

Pending

This content now needs to be approved by community moderators.

Submitted

This essay was submitted and is waiting for review.

SOTA on ImageNet on 2021-06-14

Question

This question is part of the Maximum Likelihood Round of the Forecasting AI Progress Tournament. You can view all other questions in this round here.


Image Classification is the task of identifying an image by assigning to it a specific label. Typically, Image Classification refers to images in which only one object appears and is analysed. In contrast, object detection involves both classification and localisation tasks, and is used to analyse more realistic cases in which multiple objects may exist in an image.

ImageNet (Deng et al., 2009) is a large scale dataset images built upon the backbone of the WordNet structure. ImageNet is one of the largest visual recognition datasets which contains high-resolution images. It has tens of millions of annotated images organized by the semantic hierarchy of WordNet.

As of writing this question, the state-of-the-art model for is EfficientNet-B8 (Wei et al., 2020), which achieves a top-1 accuracy of 85.8% on ImageNet.

A good reference for tracking state-of-the-art models is PapersWithCode, which tracks performance data of ML models.

What will the state-of-the-art performance on image classification on ImageNet be at 2021-06-14 in top-1 accuracy?

This question resolves as the highest level of performance, in top-1 accuracy, achieved on ImageNet up until 2021-06-14, 11:59PM GMT amongst models trained on only the ImageNet's validation set (ImageNet does not clearly demarcate its validation and training sets). No extra training data may be used besides the original ImageNet dataset.

For the purpose of this question, augmented versions of the ImageNet dataset, such as ImageNet-V2 (Recht, 2019), are considered different from Deng et al., 2009's dataset.

Performance figures may be taken from e-prints, conference papers, peer-reviewed articles, and blog articles by reputable AI labs (including the associated code repositories). Published performance figures must be available before 2021-06-14, 11:59PM GMT to qualify.

Make a Prediction

Prediction

Note: this question resolved before its original close time. All of your predictions came after the resolution, so you did not gain (or lose) any points for it.

Note: this question resolved before its original close time. You earned points up until the question resolution, but not afterwards.

Current points depend on your prediction, the community's prediction, and the result. Your total earned points are averaged over the lifetime of the question, so predict early to get as many points as possible! See the FAQ.