Featured Research

from universities, journals, and other organizations

Pediatric clinical studies appear prone to bias, review shows

Date:
July 12, 2010
Source:
Johns Hopkins Medical Institutions
Summary:
A review of nearly 150 randomized controlled trials on children -- all published in well-regarded medical journals -- reveals that 40 to 60 percent of the studies either failed to take steps to minimize risk for bias or to at least properly describe those measures.

A Johns Hopkins review of nearly 150 randomized controlled trials on children -- all published in well-regarded medical journals -- reveals that 40 to 60 percent of the studies either failed to take steps to minimize risk for bias or to at least properly describe those measures.

A report of the team's findings in the August issue of Pediatrics shows that experimental trials sponsored by pharmaceutical or medical-device makers, along with studies that are not registered in a public-access database, had higher risk for bias. So were trials that evaluate the effects of behavioral therapies rather than medication, the report states.

"There are thousands of pediatric trials going on in the world right now and given the risk that comes from distorted findings, we must ensure vigilance in how these studies are designed, conducted and judged," says lead investigator Michael Crocetti, M.D., M.P.H., a pediatrician at Johns Hopkins Children's Center. "Our review is intended as a step in that direction."

Considered the gold standard of medical research, the hallmark of double-blind randomized controlled trials (RTC) is a design that rules out or accounts for actual or potential bias. Results of such studies, when peer-reviewed and published in reputable medical journals, can influence the practice of medicine and patient care. A poorly designed or executed trial can therefore lead researchers to erroneous conclusions about the effectiveness of a drug or a procedure.

Citing the degree of bias risk in the studies they reviewed, the researchers caution pediatricians to be critical readers of studies, even in highly respected journals.

The investigators advise that when reading a report on a trial, pediatricians should not merely look at the bottom line but ask two essential questions: How did the researchers reach the conclusion? and Was their analysis unbiased?

Doctors should apply "smell tests," common sense and skeptical judgment about whether the conclusions fit the data, especially when a study boasts dramatic effects or drastic improvement.

Crocetti and colleagues used the Cochrane Collaboration tool, which assesses risk for bias along six critical aspects including randomization -- randomly assigning patients to different treatments -- and masking, the degree to which neither the patient nor the doctor knows which group of patients is receiving an active drug or intervention versus a placebo.

Investigators say that by analyzing each clinical trial along these and four other dimensions, the Cochrane Collaboration can answer what are perhaps the most important questions in medical research: How strong is the causal relationship between the therapy and the effect? and How valid are the conclusions made about the effect of the therapy?

Overall, 41 percent of the 146 trials in the review had improper or poorly described randomization techniques. Industry-funded trials were six times more likely to have high risk for biased randomization than government-funded trials or those funded by nonprofit organizations. And past research, the investigators point out, has shown that industry-funded trials are four to five times more likely to recommend an experimental drug.

"Industry funding is an important driver of medical discovery, but it is critical for investigators involved in such trials to ensure not only that the studies are conceived and executed cautiously with minimum risk for bias, but that any precautions taken against bias are also reported transparently," Crocetti says.

Trial registration -- and the transparency commitment it reflects -- is a key step in reducing bias or its influence, the researchers say. In their evaluation, registered trials were nearly 70 percent more likely to have robust randomization than non-registered trials, probably because the registration process itself forces researchers to answer many questions related to trial design and execution. Therefore, the investigators say, registering pediatric trials in the public domain will not only increase transparency but, in the long run, improve the validity of their results. In 2005, the International Committee of Medical Journal Editors called for registering all medical trials involving human subjects with www.ClinicalTrials.gov, a massive public repository of more than 70,000 trials from all over the world. However, less than 60 percent of the pediatric trials in the review were registered there.

The researchers also found that most of the trials (57 percent) either failed to use proper techniques that ensure anonymity or "blinding" to the type of treatment a patient gets, or they failed to clearly describe these techniques. The technique, called allocation concealment, ensures that neither the researcher nor the patient can guess which treatment they will get. The method also helps ensure that the treatment of one subject will not reveal to either scientists or the patients clues about the treatment of the next subject. Trials involving behavioral therapies were four times more likely to have this problem.

Overall, nearly 20 percent of the trials used improper masking techniques to ensure that neither the patient nor the researchers know which treatment went to which patient.

The 146 trials in the review appeared between 2007 and 2008 in the five leading pediatric journals -- Pediatrics, Pediatric Infectious Diseases, Journal of Pediatrics, Archives of Pediatrics and Adolescent Medicine and the Journal of the American Academy of Child and Adolescent Psychiatry -- and the three highest-ranked general medical journals -- JAMA, The New England Journal of Medicine and The Lancet.

Co-investigators on the research: Roberta Scherer, Ph.D., of the Johns Hopkins Bloomberg School of Public Health and Diane Amin, PA-C., of Hopkins.


Story Source:

The above story is based on materials provided by Johns Hopkins Medical Institutions. Note: Materials may be edited for content and length.


Journal Reference:

  1. Michael T. Crocetti, Diane D. Amin, and Roberta Scherer. Assessment of Risk of Bias Among Pediatric Randomized Controlled Trials. Pediatrics, 2010; DOI: 10.1542/peds.2009-3121

Cite This Page:

Johns Hopkins Medical Institutions. "Pediatric clinical studies appear prone to bias, review shows." ScienceDaily. ScienceDaily, 12 July 2010. <www.sciencedaily.com/releases/2010/07/100712103451.htm>.
Johns Hopkins Medical Institutions. (2010, July 12). Pediatric clinical studies appear prone to bias, review shows. ScienceDaily. Retrieved September 22, 2014 from www.sciencedaily.com/releases/2010/07/100712103451.htm
Johns Hopkins Medical Institutions. "Pediatric clinical studies appear prone to bias, review shows." ScienceDaily. www.sciencedaily.com/releases/2010/07/100712103451.htm (accessed September 22, 2014).

Share This



More Science & Society News

Monday, September 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Will Climate Rallies Spur Change?

Will Climate Rallies Spur Change?

Newsy (Sep. 21, 2014) Organizers of the People's Climate March and other rallies taking place in 166 countries hope to move U.N. officials to action ahead of their summit. Video provided by Newsy
Powered by NewsLook.com
Thousands March in NYC Over Climate Change

Thousands March in NYC Over Climate Change

AP (Sep. 21, 2014) Accompanied by drumbeats, wearing costumes and carrying signs, thousands of demonstrators filled the streets of Manhattan and other cities around the world on Sunday to urge policy makers to take action on climate change. (Sept. 21) Video provided by AP
Powered by NewsLook.com
Sierra Leone in Lockdown to Control Ebola

Sierra Leone in Lockdown to Control Ebola

AP (Sep. 21, 2014) Sierra Leone residents remained in lockdown on Saturday as part of a massive effort to confine millions of people to their homes in a bid to stem the biggest Ebola outbreak in history. (Sept. 20) Video provided by AP
Powered by NewsLook.com
Climate Change Rally Held in India Ahead of UN Summit

Climate Change Rally Held in India Ahead of UN Summit

AFP (Sep. 20, 2014) Some 125 world leaders are expected to commit to action on climate change at a UN summit Tuesday called to inject momentum in struggling efforts to tackle global warming. Duration: 00:41 Video provided by AFP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins