Summary

After conducting a study on forecasters, Philip Tetlock determined a set of traits that encapsulate super-forecasters. This includes: probabilistic, curious, humble, open-minded, intelligent, numerate, dragonfly-eyed / a fox, collaborative, reflective, and resilient. This book provides tips for being a better forecaster.

However, Tetlock applies interesting caveats, including in times where a leader’s authority is needed and in the long term (3-5 years) when black swan events tend to muddle any predictability and experts are as good as dart-throwing chimpanzees.

Key Takeaways

Notes

10 Commandments for Super-forecasters

  1. Triage: Focus on questions not too easy or too difficult, enough to learn from
  2. Decompose: Break seemingly intractable problems into sub-problems (eg. Fermi)
  3. Predict: Strike the right balance between inside and outside views
  4. Update: Strike balance between over- and under-reacting to new evidence (Bayesian)
  5. Look for the clashing causal forces at work in each problem (seek counterarguments)
  6. Granularity: Strive to determine correct amount of doubt in prediction
  7. Strike the right balance between over- and under-confidence (calibration, resolution)
  8. Learn: Look for the errors behind prediction mistakes, but beware hindsight bias
  9. Collaborate: Bring out the best in others, let them bring out the best in you
  10. Practice: Master the error-balancing bicycle