Why your best guess is often no better than an expert's intuition

Why your best guess is often no better than an expert's intuition
Image: Intellect (generated)

In short: Forecasting is the art of predicting the future using past data, yet research suggests that experts often struggle to outperform non-experts in complex scenarios like conflict resolution. Whether you are managing supply chains or betting on politics, understanding the limits of your models is as vital as the data itself.

Forecasting is the process of making predictions based on historical and current data, distinct from planning, which dictates what the future should look like. While quantitative methods rely on statistical models—such as moving averages or neural networks—to project future values, qualitative methods rely on judgment and expert opinion when data is scarce. The choice of method depends heavily on the objective, with selection trees often used to match specific conditions to the right analytical approach.

A central challenge in forecasting is the degree of uncertainty. Even in fields like conflict prediction, studies indicate that experts may not necessarily be more accurate than those with less knowledge. Furthermore, techniques like 'role thinking'—attempting to see a situation from another's perspective—have not been shown to improve accuracy. This highlights a recurring theme: the reliability of a forecast often drops if the outcome is affected by the forecast itself, or if the underlying factors are not well understood.

Despite these limitations, forecasting remains a critical tool for decision-making. Philip E. Tetlock’s work on 'superforecasting' suggests that forecasting is a skill that can be refined, allowing individuals to become better calibrated or to reach conclusions earlier. In some governance models, such as futarchy, forecasts are even used to automatically trigger policy actions. Whether through simple naïve models or complex deterministic systems designed to reveal hidden dynamical structures, the goal remains to navigate uncertainty by turning past patterns into actionable insights.

Opens the Intellect+ feed with this card first. Swipe up for the next one.

Sources

To cite this card, link to https://intellectplus.co.uk/app/science-forecasting.

How we source, check and correct cards: Editorial standards.

General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.

Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?

Related

Finding something worth knowing…