peopleanalyst

library / lib6fe17d749360d795

Superforecasting

Philip E. Tetlock

In a sentence

An exploration of the art and science of prediction, revealing how ordinary people can cultivate a specific set of cognitive skills and habits of mind to become extraordinarily good at forecasting future events.

Most expert predictions are no better than random chance, but forecasting is not a mysterious gift—it's a skill that can be taught and learned. Drawing on decades of research and the results of a massive government-funded forecasting tournament, *Superforecasting* reveals that a small group of ordinary people, or 'superforecasters,' consistently outperform seasoned intelligence analysts and acclaimed pundits. This book deconstructs what makes them so good. It isn't their IQ or access to special information; it's *how* they think. By embracing uncertainty, thinking in probabilities, constantly updating their beliefs, and practicing active open-mindedness, these individuals achieve demonstrable, measurable foresight. This book is a practical guide to mastering their methods, empowering anyone to improve their ability to see the future and make better decisions in business, finance, policy, and everyday life.

The four lenses

  • Science
  • Statistics
  • Systems
  • Strategy

Tags

applied-statisticsbehavioral-sciencestrategy

The model

This model, derived from 'Superforecasting', explains how specific cognitive-behavioral practices and environmental conditions lead to improved forecasting accuracy. It posits that while cognitive ability and domain knowledge are necessary preconditions, the key drivers of superior foresight are a set of learnable skills and mindsets, such as probabilistic reasoning, active open-mindedness, and disciplined belief updating, which can be enhanced through training and collaborative teamwork.

Forecasting Trainingdesign lever

Structured instruction on cognitive biases, probabilistic reasoning, and forecasting best practices designed to improve judgment. The book cites a 60-minute tutorial that improved accuracy by about 10%, demonstrating its efficacy as a lever for improvement.

Deliberative Practice and Feedbackdesign lever

A systematic process of making numerous forecasts, receiving clear, timely, and unambiguous feedback on their accuracy (e.g., Brier scores), and analyzing both successes and failures to refine one's mental models and improve calibration.

Collaborative Teamingdesign lever

The practice of working in groups ('superteams') structured to foster constructive confrontation, information sharing, and collective problem-solving, thereby mitigating individual biases and aggregating diverse perspectives into a more accurate collective judgment.

Perpetual Beta Orientationpsychological state

A foundational mindset combining a 'growth mindset' (belief that abilities are malleable) and 'grit' (passionate perseverance), manifesting as a relentless commitment to learning, self-improvement, and adapting one's forecasting process based on feedback.

Actively Open-Minded Thinkingpsychological state

A cognitive style characterized by the willingness to seek out and seriously consider evidence and perspectives that contradict one's existing beliefs, treating beliefs as testable hypotheses rather than cherished possessions. This counteracts belief perseverance and confirmation bias.

Probabilistic Reasoningpsychological state

The skill of thinking about uncertainty in granular, numerical terms, moving beyond a simple 'yes/no/maybe' framework to distinguish between fine-grained degrees of likelihood. This includes numeracy and the ability to update probabilities according to Bayesian principles.

Dragonfly-Eye Perspective Takingbehavioral pattern

The cognitive process of actively seeking out and synthesizing information and judgments from multiple sources and viewpoints—including balancing the 'outside view' (base rates) with the 'inside view' (case-specific details)—into a single, more robust judgment.

Disciplined Belief Updatingbehavioral pattern

The practice of revising forecasts frequently but in proportion to the diagnostic value of new evidence, avoiding both under-reaction due to belief perseverance and over-reaction to noise. It represents the behavioral manifestation of Bayesian reasoning.

Cognitive Ability and Knowledgecontextual condition

An individual's baseline level of fluid intelligence, numeracy, and crystallized knowledge about the world. The book argues this serves as a necessary but not sufficient precondition for high-level performance, with diminishing returns beyond a certain threshold.

Forecasting Accuracyoutcome metric

The degree to which a forecaster's probabilistic judgments correspond with actual outcomes over time, typically measured by a proper scoring rule like the Brier score, which rewards both calibration (probabilities matching frequencies) and resolution (correctly assigning high probabilities to events that occur and low to those that do not).

How they connect

  • forecasting training → influences probabilistic reasoning
  • forecasting training → influences dragonfly eye perspective taking
  • deliberative practice and feedback → influences perpetual beta orientation
  • deliberative practice and feedback → influences disciplined belief updating
  • collaborative teaming → influences actively open minded thinking
  • collaborative teaming → influences dragonfly eye perspective taking
  • perpetual beta orientation → influences disciplined belief updating
  • actively open minded thinking → predicts forecasting accuracy
  • probabilistic reasoning → predicts forecasting accuracy
  • dragonfly eye perspective taking → predicts forecasting accuracy
  • disciplined belief updating → predicts forecasting accuracy
  • cognitive ability and knowledge → influences forecasting accuracy

The story

The reader The reader is an intelligent, curious professional, leader, or investor who makes high-stakes decisions based on expectations about the future and wants to develop a reliable, evidence-based skill for seeing what's coming.

External problem

They are forced to rely on their own flawed intuition or the predictions of overconfident pundits, leading to poor decisions, missed opportunities, and exposure to unnecessary risk.

Internal problem

They feel uncertain, anxious, and frustrated by their inability to distinguish credible forecasts from compelling but baseless stories, leaving them feeling like they are navigating the future blind.

Philosophical problem

It is just plain wrong that our most critical decisions—in business, policy, and finance—are guided by forecasting methods of unknown accuracy while scientifically-validated paths to improvement are ignored.

The plan

  1. Adopt the mindset of a superforecaster: embrace uncertainty, intellectual humility, and a commitment to 'perpetual beta'.
  2. Master the techniques of superior judgment, such as probabilistic thinking, balancing inside and outside views, and disciplined belief updating.
  3. Engage in deliberate practice with clear, timely feedback to continuously learn from both successes and failures.

Success

  • The reader becomes a more disciplined, numerate, and self-aware thinker.
  • They make demonstrably better decisions in their professional and personal lives.
  • They navigate future uncertainty with greater clarity, skill, and confidence.

At stake

  • The reader will continue to be swayed by confident but inaccurate pundits and vulnerable to their own cognitive biases.
  • They will keep making critical decisions based on flawed judgments, leading to costly mistakes, professional setbacks, and missed opportunities.
  • They remain stuck in a world of vague pronouncements, unable to learn from experience and improve their foresight.

Questions this book answers

Is accurate forecasting a real and measurable skill, or is the future fundamentally unpredictable?
What distinguishes truly skilled forecasters from overconfident experts who are no better than chance?
Can the ability to forecast accurately be learned and cultivated through practice and training?
What specific cognitive habits, thinking styles, and analytical processes do 'superforecasters' use to achieve superior results?
How can collaboration in teams be structured to enhance, rather than hinder, forecasting accuracy?

Glossary

Forecasting Training
Structured instruction on cognitive biases, probabilistic reasoning, and forecasting best practices designed to improve judgment. The book cites a 60-minute tutorial that improved accuracy by about 10%, demonstrating its efficacy as a lever for improvement.
Deliberative Practice and Feedback
A systematic process of making numerous forecasts, receiving clear, timely, and unambiguous feedback on their accuracy (e.g., Brier scores), and analyzing both successes and failures to refine one's mental models and improve calibration.
Collaborative Teaming
The practice of working in groups ('superteams') structured to foster constructive confrontation, information sharing, and collective problem-solving, thereby mitigating individual biases and aggregating diverse perspectives into a more accurate collective judgment.
Perpetual Beta Orientation
A foundational mindset combining a 'growth mindset' (belief that abilities are malleable) and 'grit' (passionate perseverance), manifesting as a relentless commitment to learning, self-improvement, and adapting one's forecasting process based on feedback.
Actively Open-Minded Thinking
A cognitive style characterized by the willingness to seek out and seriously consider evidence and perspectives that contradict one's existing beliefs, treating beliefs as testable hypotheses rather than cherished possessions. This counteracts belief perseverance and confirmation bias.
Probabilistic Reasoning
The skill of thinking about uncertainty in granular, numerical terms, moving beyond a simple 'yes/no/maybe' framework to distinguish between fine-grained degrees of likelihood. This includes numeracy and the ability to update probabilities according to Bayesian principles.
Dragonfly-Eye Perspective Taking
The cognitive process of actively seeking out and synthesizing information and judgments from multiple sources and viewpoints—including balancing the 'outside view' (base rates) with the 'inside view' (case-specific details)—into a single, more robust judgment.
Disciplined Belief Updating
The practice of revising forecasts frequently but in proportion to the diagnostic value of new evidence, avoiding both under-reaction due to belief perseverance and over-reaction to noise. It represents the behavioral manifestation of Bayesian reasoning.