Bad Science (26 page)

The
Telegraph
went on to explain that Krigsman’s most recent unpublished claim was replicating similar work from 1998 by Dr. Andrew Wakefield and from 2002 by Professor John O’Leary. This was, to say the least, a misstatement. There is no work from 1998 by Wakefield that fits the
Telegraph
’s claim—at least not in PubMed that I can find. I suspect the newspaper was confused about the infamous
Lancet
paper on MMR, which by 2004 had already been partially retracted.

There are, however, two papers suggesting that traces of genetic material from the measles virus have been found in children. They have received a mountain of media coverage over half a decade, and yet the media have remained studiously silent on the published evidence suggesting that they were false positives, as we shall now see.

One, in which it is claimed that genetic material from measles vaccine was found in blood cells, is from Kawashima et al. in 2002, also featuring Wakefield as an author. Doubt is cast on this both by attempts to replicate it, showing where the false positives probably appeared, and by the testimony of Nick Chadwick, the Ph.D. student whose work we described above. Even Andrew Wakefield himself no longer relies on this paper.

The other is O’Leary’s paper from 2002, also featuring Wakefield as an author, which produced evidence of measles RNA in tissue samples from children. Further experiments, again, have illustrated where the false positives seem to have arisen, and in 2004, when Professor Stephen Bustin was examining the evidence for the legal aid case, he explained how he established to his satisfaction—during a visit to the O’Leary lab—that these were false positives resulting from contamination and inadequate experimental methods. He has shown, first, that there were no controls to check for false positives (contamination is a huge risk when you are looking for minuscule traces of genetic material, so you generally run blank samples to make sure they do come out blank); he found calibration problems with the machines, problems with logbooks, and worse. He expanded on this at enormous length in a U.S. court case on autism and vaccines in 2006. You can read his detailed explanation in full online. To my astonishment, not one journalist in the U.K. has ever bothered to report it.

Both these papers claiming to show a link received blanket media coverage at the time, as did Krigsman’s claims.

What They Didn’t Tell You

In the May 2006 issue of the
Journal of Medical Virology
there was a very similar study to the one described by Krigsman, only this one had actually been published, by Afzal et al. It looked for measles RNA in children with regressive autism after MMR vaccination, much like the unpublished Krigsman study, and it used tools so powerful they could detect measles RNA down to single-figure copy numbers. It found no evidence of the magic vaccine-strain measles RNA to implicate MMR. Perhaps because of that unfrightening result, the study was loudly ignored by the press.

Because it has been published in full, I can read it and pick holes in it, and I am more than happy to do so: because science is about critiquing openly published data and methodologies, rather than press-released chimeras, and in the real world all studies have some flaws, to a greater or lesser extent. Often they are practical ones; here, for example, the researchers couldn’t get hold of the tissue they ideally would have used, because they could not get ethics committee approval for intrusive procedures like lumbar punctures and gut biopsies on children (Wakefield did manage to obtain such samples, but he was, we should remember, found guilty by the U.K. medical regulator (the General Medical Council) of professional misconduct for conducting these invasive tests without ethics committee approval; his sentence has not been handed down as yet).

Surely they could have borrowed some existing samples, from children said to be damaged by vaccines? You’d have thought so. They report in the paper that they tried to ask anti-MMR researchers—if that’s not an unfair term—whether they could borrow some of their tissue samples to work on. They were ignored.
²¹

Afzal et al. were not reported in the media, anywhere at all, except by me, in my column.

This is not an isolated case. Another major paper was published in the leading academic journal
Pediatrics
a few months later—to complete media silence—again suggesting very strongly that the earlier results from Kawashima and O’Leary were in error and false positives. D’Souza et al. replicated the earlier experiments very closely, and in some respects more carefully; most important, it traced out the possible routes by which a false positive could have occurred and made some astonishing findings.

False positives are common in PCR, because it works by using enzymes to replicate RNA, so you start with a small amount in your sample, which is then “amplified up,” copied over and over again, until you have enough to measure and work with. Beginning with a single molecule of genetic material, PCR can generate one hundred billion similar molecules in an afternoon. Because of this, the PCR process is exquisitely sensitive to contamination—as numerous innocent people languishing in jail could tell you—so you have to be very careful and clean up as you go.

As well as raising concerns about contamination, D’Souza also found that the O’Leary method might have accidentally amplified the wrong bits of RNA.

Let’s be clear, this is absolutely not about criticizing individual researchers. Techniques move on, results are sometimes not replicable, and not all double-checking is practical (although Bustin’s testimony is that standards in the O’Leary lab were problematic). But what is striking is that the media rabidly picked up on the original frightening data and then completely ignored the new reassuring data. This study by D’Souza, like Afzal’s before it, was unanimously ignored by the media. It was covered, by my count, in: my column, one Reuters piece that was picked up by nobody, and one post on the lead researcher’s boyfriend’s blog (where he talked about how proud he was of his girlfriend). Nowhere else.
²²

You could say, very reasonably, that this is all very much par for the course; newspapers report the news, and it’s not very interesting if a piece of research comes out saying something is safe. But I would argue—perhaps sanctimoniously—that the media have a special responsibility in this case, because they themselves demanded “more research” and, moreover, because
at the very same time
that they were ignoring properly conducted and fully published negative findings, they were talking up scary findings from an unpublished study by Krigsman, a man with a track record of making scary claims that remain unpublished.

MMR is not an isolated case in this regard. You might remember the scare stories about mercury fillings from the past two decades; they come around every few years, usually accompanied by a personal anecdote in which fatigue, dizziness, and headaches all are vanquished following the removal of the fillings by one visionary dentist. Traditionally these stories conclude with a suggestion that the dental establishment may well be covering up the truth about mercury and a demand for more research into its safety.

The first large-scale randomized control trials on the safety of mercury fillings were published recently, and if you were waiting to see these hotly anticipated results, personally demanded by journalists on innumerable newspapers, you’d be out of luck, because they were reported nowhere. Nowhere. This was a study of more than one thousand children, some of whom were given mercury fillings, and some mercury-free fillings, measuring kidney function and neuro-developmental outcomes like memory, coordination, nerve conduction, IQ, and so on over several years. It was a well-conducted study. There were no significant differences between the two groups. That’s worth knowing about if you’ve ever been scared by the media’s reports on mercury fillings, and by God, you’d have been scared.

BBC Panorama
featured a particularly chilling documentary in 1994 titled
The Poison in Your Mouth
. It opened with dramatic footage of men in full protective gear rolling barrels of mercury around. I’m not giving you the definitive last word on mercury here. But I think we can safely assume there is no
Panorama
documentary in the pipeline covering the startling new research data suggesting that mercury fillings may not be harmful after all.

In some respects this is just one more illustration of how unreliable intuition can be in assessing risks like those presented with a vaccine. Not only is it a flawed strategy for this kind of numerical assessment, on outcomes that are too rare for one person to collect meaningful data on them in their personal journey through life; but the information you are fed by the media about the wider population is ludicrously, outrageously, criminally crooked. So at the end of all this, what has the British news media establishment achieved?

Old Diseases Return

It’s hardly surprising that the MMR vaccination rate has fallen from 92 percent in 1996 to 73 percent today. In some parts of London it’s down to 60 percent, and figures from 2004 to 2005 showed that in Westminster only 38 percent of children had both jabs by the age of five.
²³

It is difficult to imagine what could be driving this if not a brilliantly successful and well-coordinated media anti-MMR campaign, which pitched emotion and hysteria against scientific evidence. People listen to journalists: this has been demonstrated repeatedly, and not just with the kinds of stories in this book.

A 2005 study in
The Medical Journal of Australia
looked at mammogram bookings and found that during the peak media coverage of Kylie Minogue’s breast cancer, bookings rose by 40 percent. The increase among previously unscreened women in the forty-to sixty-nine-year age-group was 101 percent. These surges were unprecedented. And I’m not cherry-picking: a systematic review from the Cochrane Collaboration found five studies looking at the use of specific health interventions before and after media coverage of specific stories, and each found that favorable publicity was associated with greater use, and unfavorable coverage with lower use.

It’s not just the public: medical practice is influenced by the media too, and so are academics. A mischievous paper from
The New England Journal of Medicine
in 1991 showed that if a study was covered by
The New York Times
, it was significantly more likely to be cited by other academic papers. Having come this far, you are probably unpicking this study already. Was coverage in
The New York Times
just a surrogate marker for the importance of the research? History provided the researchers with a control group to compare their results with: for three months, large parts of the paper went on strike, and while the journalists did produce an “edition of record,” it was never actually printed. They wrote stories about academic research, using the same criteria to judge importance that they always had, but the research they wrote about in articles that never saw the light of day saw no increase in citations.

People read newspapers. Despite everything we think we know, their contents seep in, we believe them to be true, and we act upon them, making it all the more tragic that their contents are so routinely flawed. Am I extrapolating unfairly from the extreme examples in this book? Perhaps not. In 2008 Gary Schwitzer, an ex-journalist who now works on quantitative studies of the media, published an analysis of five hundred health articles covering treatments from mainstream newspapers in the United States. Only 35 percent of stories were rated satisfactory for whether the journalist had “discussed the study methodology and the quality of the evidence” (because in the media, as we have seen repeatedly in this book, science is about absolute truth statements from arbitrary authority figures in white coats, rather than clear descriptions of studies and the reasons why people draw conclusions from them). Only 28 percent adequately covered benefits, and only 33 percent adequately covered harms. Articles routinely failed to give any useful quantitative information in absolute terms, preferring unhelpful eye catchers like “50 percent higher” instead.

In fact, there have been systematic quantitative surveys of the accuracy of health coverage in Canada, Australia, and the United States—I’m trying to get one off the ground in the U.K.—and the results have been universally unimpressive. It seems to me that the state of health coverage in the U.K. could well be a serious public health issue.

Meanwhile, the incidence of two of the three diseases covered by MMR is now increasing very impressively. We have the highest number of measles cases in England and Wales since current surveillance methods began in 1995, with cases occurring mostly in children who had not been adequately vaccinated: in 2007, 971 confirmed cases (mostly associated with prolonged outbreaks in traveling and religious communities, where vaccine uptake has been historically low), were reported, after 740 cases in 2006 (and the first death since 1992). Seventy-three percent of cases were in the southeast, and most of those were in London.

Mumps began rising again in 1999, after many years of cases in only double figures; by 2005 the United Kingdom had a mumps epidemic, with around five thousand notifications in January alone.

A lot of people who campaign against vaccines like to pretend that they don’t do much good and that the diseases they protect against were never very serious anyway. I don’t want to force anyone to have his or her child vaccinated, but equally I don’t think anyone is helped by misleading information. By contrast with the unlikely event of autism’s being associated with MMR, the risks from measles, though small, are real and quantifiable. The Peckham Report on immunization policy, published shortly after the introduction of the MMR vaccine, surveyed the recent experience of measles in Western countries and estimated that for every 1,000 cases notified, there would be 0.2 deaths, 10 hospital admissions, 10 neurological complications, and 40 respiratory complications. These estimates have been borne out in recent minor epidemics in the Netherlands (1999: 2,300 cases in a community philosophically opposed to vaccination, 3 deaths), Ireland (2000: 1,200 cases, 3 deaths) and Italy (2002: 3 deaths). It’s worth noting that plenty of these deaths were in previously healthy children, in developed countries, with good health care systems.