Science News

Refuted Claims From Observational Studies Often Persist Despite Strong Evidence Against Them

ScienceDaily (Dec. 5, 2007) — Prominent claims from observational studies of the cardiovascular benefits of vitamin E often continue to be supported in medical literature despite strong contradictory evidence from randomized trials, according to a new study. Similar findings were found for claims regarding the protective effects of beta-carotene on cancer and estrogen on Alzheimer disease.

"Some research findings that have received wide attention in the scientific community, as proven by the high citation counts of the respective articles, are eventually contradicted by subsequent evidence. A number of such high-profile contradictions pertain to differences between nonrandomized and randomized studies," the authors write. Despite these contradictions, findings from observational trials may still be supported in some scientific circles.

Athina Tatsioni, M.D., of the University of Ioannina School of Medicine, Ioannina, Greece, and colleagues evaluated the change in favorable vs. unfavorable citations for two highly cited epidemiological studies that proposed major cardiovascular benefits associated with vitamin E in 1993, which were strongly contradicted by evidence from large randomized clinical trials (RCTs). To assess the generalizability of these findings, the researchers also examined the extent to which two other major contradicted claims, the effectiveness of beta-carotene for preventing cancer and of estrogens for preventing Alzheimer dementia, continue to be supported in the current medical literature.

For the vitamin E claims, the researchers sampled articles published in 1997, 2001, and 2005 (before, early, and late after publication of refuting evidence) that referenced the highly cited epidemiological studies and separately sampled articles published in 2005 and referencing the major contradicting RCT (HOPE trial). They also sampled articles published in 2006 that referenced highly cited articles proposing benefits associated with beta-carotene for cancer (published in 1981 and contradicted by RCTs in 1994-1996) and estrogen for Alzheimer disease (published in 1996 and contradicted by RCTs in 2004).

The researchers found that for the two vitamin E epidemiological studies, even in 2005, 50 percent of citing articles remained favorable. A favorable stance was independently less likely in more recent articles, specifically in articles that also cited the HOPE trial and in general/internal medicine vs. specialty journals. In a sample of 29 articles published in 2005 that had cited the HOPE study, six (20.7 percent) were still favorable to vitamin E, 11 (37.9 percent) were equivocal (uncertain), and 12 (41.4 percent) were unfavorable. "Even among articles that cited the contradicting HOPE trial rather than the positive epidemiological studies, the majority in 2005 still could not conclude that vitamin E was ineffective," the authors write.

Regarding the claims for beta-carotene, 10 citing articles (62.5 percent) were favorable, three (18.8 percent) equivocal, and three (18.8 percent) unfavorable. For estrogen, 29 citing articles (61.7 percent) were favorable, 14 (29.8 percent) equivocal, and 4 (8.5 percent) unfavorable. All beta-carotene citations and all but two estrogen citations appeared in specialty journals.

"Counterarguments defending vitamin E or estrogen included diverse selection and information biases and genuine differences across studies in participants, interventions, co-interventions, and outcomes. Favorable citations to beta-carotene, long after evidence contradicted its effectiveness, did not consider the contradicting evidence."

"... it can be difficult to discern whether perpetuated beliefs are based on careful consideration of all evidence and differential interpretation, inappropriate entrenchment of old information, lack of dissemination of newer data, or purposeful silencing of their existence. Regardless of the reasons, better communication between research specialists and evidence-based clinical science may improve this situation and may lead to more rational and concerted translational efforts in basic, pre-clinical, and clinical research," the researchers conclude.

Journal reference: JAMA. 2007;298(21):2517-2526.

Email or share this story:
| More

Story Source:

Adapted from materials provided by JAMA and Archives Journals, via EurekAlert!, a service of AAAS.

APA

MLA

Note: If no author is given, the source is cited instead.

Search ScienceDaily

Number of stories in archives: 77,761

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily's archives for related news topics,
the latest news stories, reference articles, science videos, images, and books.

 

Science Video News


Helping Cancer Survivors Grow Up

Studying childhood cancer patients who have suffered tissue and organ damage from chemotherapy treatments, researchers have found that growth. ...  > full story

Breaking News

... from NewsDaily.com

In Other News ...

Copyright Reuters 2008. See Restrictions.

Free Subscriptions

... from ScienceDaily

Get the latest science news with our free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Feedback

... we want to hear from you!

Tell us what you think of the new ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Post this page to your favorite social bookmarking site:
close
Include this item in your blog or web site:
close
Cite this article in your essay, paper, or report:
close
Email this page's link to a friend or colleague:
close