calculating contingent insights exploring calibrated wisdom formulating critical futures aggregating contingent contingencies delivering accurate predictions mapping the future modeling contingent insights generating precise insights mapping critical futures forecasting intelligent understanding computing accurate forecasts predicting accurate wisdom crowdsourcing calibrated estimations delivering accurate predictions


Importance of final predictions restored

By Anthony on Oct. 23, 2016, noon GMT

An unintended side-effect of the new scoring scheme, which averages over points on-the-line between question opening and closing, was that putting in a prediction right before closing makes hardly any effect. This is unfortunately both because it makes things less fun and exciting, and also because the community prediction at closing time is probably the most useful piece of information created by the community on each question, and should be optimized.

Thus in a slight tweak to the scoring scheme, we’ve now added extra weight to your last prediction; this makes the current scheme a hybrid between the original scheme (where all the weight was on the final prediction before closing) and the time-averaged scheme. The weighting is roughly 2/3 for the time-averaged part, 1/3 for the final prediction.

While the means to a best score is still to predict accurately, early, and often, this will hopefully help predictors better allocate their efforts.