M

Your Notebook is now a Draft.

Once it's ready, please submit it for review by our team of Community Moderators. Thank you!

Pending

This content now needs to be approved by community moderators.

Submitted

This essay was submitted and is waiting for review.

News» {{qctrl.question.primaryProject.name}}

Now You Can Create Multiple Choice Questions

by Tom_Metaculus {{qctrl.question.publish_time | dateStr}} Edited on {{qctrl.question.edited_time | dateStr}} {{"estimatedReadingTime" | translate:({minutes: qctrl.question.estimateReadingTime()})}}
  • Facebook
  • Twitter

  • Create multiple choice questions and bring greater clarity to topics with multiple potential outcomes where one and only one will occur.

    To get started, simply Create a Question and set the Question Type to 'multiple choice'.

    Give the Group Variable a clear label, e.g., 'Option', 'Team', 'Country'.

    Fill in the Multiple Choice Options, adding more fields as needed.

    After you share additional details including background information on your topic, we'll be excited to review and publish your multiple choice question!


    Introducing Multiple Choice Questions! (Dec 20, 2023)

    gif

    Today we're excited to launch a new question type on Metaculus: Multiple choice questions. Multiple choice questions are designed for topics where exactly one option out of many will occur, like the winner of a presidential election.

    For this question type, the sum of the probabilities across all options must equal 100% to be a valid forecast. This will enhance the accuracy of both individual and aggregate forecasts. A convenient 'Auto-sum' button streamlines forecasting by ensuring probabilities add up to 100%.

    Start predicting now or read on to learn how multiple choice questions improve the forecasting experience.

    Forecasting on multiple choice questions

    For multiple choice questions like:

    republican question

    —exactly one outcome will occur, so the probabilities over all options must sum to 100%.

    To get started, predict the likelihood of each option. Select ‘Auto-sum’ to ensure your probabilities add up to 100%.

    The current sum of probabilities appears below the options so you can see how much of the probability is left to distribute. If your options add up 98.5%, for example, then Auto-sum will proportionally distribute the 1.5% of remaining probability across the options.

    autosum

    The Forecast Timeline functions the same as for question groups: Hover over the plot to see your forecasts alongside the Community Predictions at that time. Use the tick boxes to hide or reveal forecast options. When there are more than six options, use the Others dropdown to select them.

    How do multiple choice questions differ from question groups?

    Previously, Metaculus has used question groups to shed light on topics like:

    In the future, we plan to use multiple choice questions for these kinds of questions. Multiple choice questions ensure logically coherent predictions that sum to 100%, so forecasts will be more accurate.

    And unlike question groups, multiple choice questions only score your forecast on the option that resolves Yes. Learn more about multiple choice question scoring here.

    Get started

    olympics question

    olympics question

    republican question

    Find multiple choice questions in the question feed by selecting Filter and then Multiple Choice.


    For now, only Metaculus admins can create multiple choice questions, but we want to hear from you: Are there multiple choice questions you want to see on Metaculus? Share them and any other thoughts or feedback below!

    Categories:
    Metaculus
    Submit Essay

    Once you submit your essay, you can no longer edit it.