What questions should we launch in the Quarterly Cup? Your ideas can help make the Cup a useful and topical source of information as well as an engaging competition for forecasters.
Please use the comments here to suggest ideas! At the end of this post we've shared some considerations to keep in mind for what makes a good Quarterly Cup question.
If you think you have a solid idea you're also encouraged to submit it to the Cup for moderators to consider (use the "+" button shown in the image below on the Quarterly Cup tournament page). Submitting a fully formed question to the Quarterly Cup provides a great opportunity to increase your score in the question writing leaderboard and potentially earn a medal!
Here are some things we look for in a Quarterly Cup question:
- The questions must resolve by the end of the quarter. We typically allow for resolutions up to a week after the end of the quarter. We also like to have some of the questions be very short term (resolving within several weeks) so that at least one question resolves every week during the Cup.
- Questions should be a good mix of topical, important, and interesting or fun. We aim for most of our questions to be a useful source of information for someone trying to better understand the world and anticipate the future, though there's certainly room for some of the questions to just be fun for forecasters or covering an interesting topic that forecasters might enjoy learning about. A great question is one that can quantify a key uncertainty in the news while also being fun or interesting for forecasters to think about.
- We want a diversity of question topics. While we want the questions to be topical, we also want the Quarterly Cup leaderboard to reflect broad forecasting skill, and avoid overrepresenting one particular topic or closely related set of questions in the scores. It's usually hard to keep it topical without launching several questions on major events, but we want to try to avoid going too heavy on one topic and cover many topics, especially those from our focus areas.
- We want the questions to have geographic diversity. Metaculus is US-based and therefore has a bias toward questions about the US, and the US tends to feature prominently in world news as well, but we also want to make sure we're asking valuable questions that touch on global issues or issues facing countries or regions outside the United States.