Review of medical studies says one third of original results are faulty


Wednesday, July 13th, 2005

And ‘there’s no proof subsequent studies … were necessarily correct’ — author’s caveat

Lindsey Tanner
Sun

CHICAGO — Here’s some medical news you can trust: A new study confirms that what doctors once said was good for you often turns out to be bad — or at least not as great as initially thought.

The report is a review of major studies published in three influential medical journals between 1990 and 2003, including 45 highly publicized studies that initially claimed a drug or other treatment worked.

Subsequent research contradicted results of seven studies — 16 per cent — and reported weaker results for seven others, an additional 16 per cent. That means nearly one-third of the original results did not hold up, according to the study in today’s Journal of the American Medical Association.

“Contradicted and potentially exaggerated findings are not uncommon in the most visible and most influential original clinical research,” said study author Dr. John Ioannidis, a researcher at the University of Ioannina in Greece.

Experts say the study is a reminder to doctors and patients that they should not put too much stock in a single study and understand that treatments often become obsolete with medical advances.

“A single study is not the final word, and that is an important message,” editors at the New England Journal of Medicine said in a statement about the study.

The refuted studies dealt with a wide range of drugs and treatments. Hormone pills were once thought to protect menopausal women from heart disease but later were shown to do the opposite. Contrary to initial results, vitamin E pills have not been shown to prevent heart attacks.

Contradictions also included a study that found nitric oxide does not improve survival in patients with respiratory failure, despite earlier claims. And a study suggested that an antibody treatment did not improve survival in certain sepsis patients; a smaller previous study found the opposite.

Ioannidis acknowledged an important but not very reassuring caveat: “There’s no proof that the subsequent studies … were necessarily correct.” But he noted that in all 14 cases in which results were contradicted or softened, the subsequent studies were either larger or better designed. Also, none of the contradicted treatments is currently recommended by medical guidelines.

Ioannidis’s study examined research in the New England Journal of Medicine, Lancet and JAMA — prominent journals whose weekly studies help feed a growing public appetite for medical news.

Not by accident, this week’s JAMA also includes a study contradicting previous thinking that stomach-lying helped improve breathing in children hospitalized with acute lung injuries. The new study found they did no better than patients lying on their backs.

Dr. Catherine DeAngelis, JAMA’s editor, said she included the study with Ioannidis’ report to highlight the nature of medical research. “The crazy part about science and yet the exciting part about science is you almost never have something that’s black and white,” she said.

© The Vancouver Sun 2005



Comments are closed.