Summary
After conducting a study on forecasters, Philip Tetlock determined a set of traits that encapsulate super-forecasters. This includes: probabilistic, curious, humble, open-minded, intelligent, numerate, dragonfly-eyed / a fox, collaborative, reflective, and resilient. This book provides tips for being a better forecaster.
However, Tetlock applies interesting caveats, including in times where a leader’s authority is needed and in the long term (3-5 years) when black swan events tend to muddle any predictability and experts are as good as dart-throwing chimpanzees.
Key Takeaways
- Don’t bother predicting more than 3-5 years in advance
- Practice active open-mindedness: seek dissenting opinions
- Live in perpetual beta
- Share knowledge, join communities. Givers who openly contribute their insights tend to do better than takers
Notes
10 Commandments for Super-forecasters
- Triage: Focus on questions not too easy or too difficult, enough to learn from
- Decompose: Break seemingly intractable problems into sub-problems (eg. Fermi)
- Predict: Strike the right balance between inside and outside views
- Update: Strike balance between over- and under-reacting to new evidence (Bayesian)
- Look for the clashing causal forces at work in each problem (seek counterarguments)
- Granularity: Strive to determine correct amount of doubt in prediction
- Strike the right balance between over- and under-confidence (calibration, resolution)
- Learn: Look for the errors behind prediction mistakes, but beware hindsight bias
- Collaborate: Bring out the best in others, let them bring out the best in you
- Practice: Master the error-balancing bicycle