Blinded with science

We’re continually assured that government policies are grounded in evidence, whether it’s an anti-bullying programme in Finland, an alcohol awareness initiative in Texas or climate change responses around the globe. Science itself, we’re told, is guiding our footsteps.

There’s just one problem: science is in deep trouble. Last year, Richard Horton, editor of The Lancet, admitted that “much of the scientific literature, perhaps half, may simply be untrue.” In his words, “science has taken a turn toward darkness.”

Medical research, psychology, and economics are all in the grip of a ‘reproducibility crisis.’ A pharmaceutical company attempting to confirm the findings of 53 landmark cancer studies was successful in only six instances, a failure rate of 89pc. In 2012, a psychology journal devoted an entire issue to reliability problems in that discipline, with one essay titled “Why science is not necessarily self-correcting.” Likewise, a 2015 report prepared for the Board of Governors of the US Federal Reserve concluded that “economics research is usually not replicable.” Its authors were able to verify the findings of only one third of 67 papers published in reputable economics journals. After enlisting the help of the original researchers, the success rate rose to a still dismal 49pc.

Government policies can’t be considered evidence-based if the evidence on which they depend hasn’t been independently verified, yet the vast majority of academic research is never put to this test. Instead, something called peer review takes place. When a research paper is submitted, journals invite a couple of people to evaluate it. Known as referees, these individuals recommend that the paper be published, modified, or rejected.

If one gets what one pays for, it’s worth observing that referees typically work for free. They lack both the time and the resources to perform anything other than a cursory overview.