Not trusting experts

Thomas de Zengotita recommends this book: Expert Political Judgment : How Good is It? How Can We Know? Zengotita writes

The answer is shocking at first but makes perfect sense on further reflection. It seems that experts (not only in politics but other areas as well) are worse judges of what is likely to happen than a reasonably well-informed ordinary citizen.

How could this be? Well, the real fun is in the details of the research, but the common-sense foundation for the result is simply stated. First, experts are likely to have some framework of interpretation to defend, so they force facts into that framework. Second, experts have a gazillion factors to consider when they make predictions, so they get lost in a gazillion plus scenarios and lose track of the obvious.

As a result of these all-too-human inclinations, experts actually come out worse as predictors than what you would get if you just chose outcomes at random.

Makes sense to me…

5 thoughts on “Not trusting experts

  1. Chris Pearse

    This reminds me of a recent Dragon’s Den episode where financially successful business experts had diametrically opposing views on the potential success of a particular venture (this happens fairly frequently). The Dragons’ reputation (and their “framework of interpretation”) seems to force them into outright and derisory condemnation, or financial commitment – nothing in between. Makes good TV though!

    Reply
  2. Antony Mayfield

    For more on how experts defend a position I recommend reading Freakonomics, be Steven D Levitt (or searching the book for “expert” on Amazon.com for a taste of the arguments). Basically, Levitt takes a look at how experts twist the truth according to how they are incentivised.

    Reply
  3. Tom Asacker

    Thanks for that one Johnnie. It explains a lot. 😉

    Pick up Zengotita’s book – Mediated. I think you’ll like it. I did.

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.