Featured Research

from universities, journals, and other organizations

Is Most Published Research Really False?

Date:
February 27, 2007
Source:
Public Library of Science
Summary:
In 2005, PLoS Medicine published an essay by John Ioannidis, called "Why most published research findings are false," that has been downloaded over 100,000 times. This week, PLoS Medicine revisits the essay, publishing two articles by researchers that move the debate in two new directions.

In 2005, PLoS Medicine published an essay by John Ioannidis, called "Why most published research findings are false," that has been downloaded over 100,000 times and that was called "an instant cult classic" in a Boston Globe op-ed of July 27 2006. This week, PLoS Medicine revisits the essay, publishing two articles by researchers that move the debate in two new directions.

In his 2005 essay, Dr Ioannidis wrote: "Published research findings are sometimes refuted by subsequent evidence, with ensuing confusion and disappointment." He argued that there is increasing concern that in modern research, false findings may be the majority or even the vast majority of published research claims, and went on to try and prove that most claimed research findings are false.

However, in this week's PLoS Medicine, Ramal Moonesinghe (US Centers for Disease Control and Prevention) and colleagues demonstrate that the likelihood of a published research result being true increases when that finding has been repeatedly replicated in multiple studies.

"As part of the scientific enterprise," say the authors, "we know that replication--the performance of another study statistically confirming the same hypothesis--is the cornerstone of science and replication of findings is very important before any causal inference can be drawn." While the importance of replication was acknowledged by Dr Ioannidis, say Dr Moonesinghe and colleagues, he did not show that the likelihood of a statistically significant research finding being true increases when that finding has been replicated in many studies.

The authors say that their new demonstration "should be encouraging news to researchers in their never-ending pursuit of scientific hypothesis generation and testing." Nevertheless, they acknowledge that "more methodologic work is needed to assess and interpret cumulative evidence of research findings and their biological plausibility," particularly in the exploding field of genetic associations.

In the second article, Benjamin Djulbegovic (University of South Florida, USA) and Iztok Hozo (Indiana University Northwest, USA) say that Dr Ioannidis "did not indicate when, if at all, potentially false research results may be considered as acceptable to society." In their article, they calculate the probability above which research findings may become acceptable.

Djulebegovic and Hozo's new model indicates that the probability above which research results should be accepted depends on the expected payback from the research (the benefits) and the inadvertent consequences (the harms). This probability may dramatically change depending on our willingness to tolerate error in accepting false research findings. Our acceptance of research findings changes as a function of what the authors call "acceptable regret," i.e., our tolerance of making a wrong decision in accepting the research hypothesis. They illustrate their findings by providing a new framework for early stopping rules in clinical research (i.e., when should we accept early findings from a clinical trial indicating the benefits as true?).

"Obtaining absolute 'truth' in research, say Djulbegovic and Hozo, "is impossible, and so society has to decide when less-than-perfect results may become acceptable."

Citations:

Moonesinghe R, Khoury MJ, Janssens ACJW (2007) Most published research fi ndings are false--But a little replication goes a long way. PLoS Med 4(2): e28. (http://dx.doi.org/10.1371/journal.pmed.0040028)

Djulbegovic B, Hozo I (2007) When should potentially false research fi ndings be considered acceptable? PLoS Med 4(2): e26. (http://dx.doi.org/10.1371/journal.pmed.0040026)


Story Source:

The above story is based on materials provided by Public Library of Science. Note: Materials may be edited for content and length.


Cite This Page:

Public Library of Science. "Is Most Published Research Really False?." ScienceDaily. ScienceDaily, 27 February 2007. <www.sciencedaily.com/releases/2007/02/070227105745.htm>.
Public Library of Science. (2007, February 27). Is Most Published Research Really False?. ScienceDaily. Retrieved September 21, 2014 from www.sciencedaily.com/releases/2007/02/070227105745.htm
Public Library of Science. "Is Most Published Research Really False?." ScienceDaily. www.sciencedaily.com/releases/2007/02/070227105745.htm (accessed September 21, 2014).

Share This



More Health & Medicine News

Sunday, September 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Sierra Leone's Nationwide Ebola Curfew Underway

Sierra Leone's Nationwide Ebola Curfew Underway

Newsy (Sep. 20, 2014) Sierra Leone is locked down as aid workers and volunteers look for new cases of Ebola. Video provided by Newsy
Powered by NewsLook.com
Changes Found In Brain After One Dose Of Antidepressants

Changes Found In Brain After One Dose Of Antidepressants

Newsy (Sep. 19, 2014) A study suggest antidepressants can kick in much sooner than previously thought. Video provided by Newsy
Powered by NewsLook.com
Could Grief Affect The Immune Systems Of Senior Citizens?

Could Grief Affect The Immune Systems Of Senior Citizens?

Newsy (Sep. 19, 2014) The study found elderly people are much more likely to become susceptible to infection than younger adults going though a similar situation. Video provided by Newsy
Powered by NewsLook.com
Jury Delivers Verdict in Salmonella Trial

Jury Delivers Verdict in Salmonella Trial

AP (Sep. 19, 2014) A federal jury has convicted three people in connection with an outbreak of salmonella poisoning five years ago that sickened hundreds of people and was linked to a number of deaths. (Sept. 19) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins