Featured Research

from universities, journals, and other organizations

Pediatric clinical studies appear prone to bias, review shows

Date:
July 12, 2010
Source:
Johns Hopkins Medical Institutions
Summary:
A review of nearly 150 randomized controlled trials on children -- all published in well-regarded medical journals -- reveals that 40 to 60 percent of the studies either failed to take steps to minimize risk for bias or to at least properly describe those measures.

A Johns Hopkins review of nearly 150 randomized controlled trials on children -- all published in well-regarded medical journals -- reveals that 40 to 60 percent of the studies either failed to take steps to minimize risk for bias or to at least properly describe those measures.

Related Articles


A report of the team's findings in the August issue of Pediatrics shows that experimental trials sponsored by pharmaceutical or medical-device makers, along with studies that are not registered in a public-access database, had higher risk for bias. So were trials that evaluate the effects of behavioral therapies rather than medication, the report states.

"There are thousands of pediatric trials going on in the world right now and given the risk that comes from distorted findings, we must ensure vigilance in how these studies are designed, conducted and judged," says lead investigator Michael Crocetti, M.D., M.P.H., a pediatrician at Johns Hopkins Children's Center. "Our review is intended as a step in that direction."

Considered the gold standard of medical research, the hallmark of double-blind randomized controlled trials (RTC) is a design that rules out or accounts for actual or potential bias. Results of such studies, when peer-reviewed and published in reputable medical journals, can influence the practice of medicine and patient care. A poorly designed or executed trial can therefore lead researchers to erroneous conclusions about the effectiveness of a drug or a procedure.

Citing the degree of bias risk in the studies they reviewed, the researchers caution pediatricians to be critical readers of studies, even in highly respected journals.

The investigators advise that when reading a report on a trial, pediatricians should not merely look at the bottom line but ask two essential questions: How did the researchers reach the conclusion? and Was their analysis unbiased?

Doctors should apply "smell tests," common sense and skeptical judgment about whether the conclusions fit the data, especially when a study boasts dramatic effects or drastic improvement.

Crocetti and colleagues used the Cochrane Collaboration tool, which assesses risk for bias along six critical aspects including randomization -- randomly assigning patients to different treatments -- and masking, the degree to which neither the patient nor the doctor knows which group of patients is receiving an active drug or intervention versus a placebo.

Investigators say that by analyzing each clinical trial along these and four other dimensions, the Cochrane Collaboration can answer what are perhaps the most important questions in medical research: How strong is the causal relationship between the therapy and the effect? and How valid are the conclusions made about the effect of the therapy?

Overall, 41 percent of the 146 trials in the review had improper or poorly described randomization techniques. Industry-funded trials were six times more likely to have high risk for biased randomization than government-funded trials or those funded by nonprofit organizations. And past research, the investigators point out, has shown that industry-funded trials are four to five times more likely to recommend an experimental drug.

"Industry funding is an important driver of medical discovery, but it is critical for investigators involved in such trials to ensure not only that the studies are conceived and executed cautiously with minimum risk for bias, but that any precautions taken against bias are also reported transparently," Crocetti says.

Trial registration -- and the transparency commitment it reflects -- is a key step in reducing bias or its influence, the researchers say. In their evaluation, registered trials were nearly 70 percent more likely to have robust randomization than non-registered trials, probably because the registration process itself forces researchers to answer many questions related to trial design and execution. Therefore, the investigators say, registering pediatric trials in the public domain will not only increase transparency but, in the long run, improve the validity of their results. In 2005, the International Committee of Medical Journal Editors called for registering all medical trials involving human subjects with www.ClinicalTrials.gov, a massive public repository of more than 70,000 trials from all over the world. However, less than 60 percent of the pediatric trials in the review were registered there.

The researchers also found that most of the trials (57 percent) either failed to use proper techniques that ensure anonymity or "blinding" to the type of treatment a patient gets, or they failed to clearly describe these techniques. The technique, called allocation concealment, ensures that neither the researcher nor the patient can guess which treatment they will get. The method also helps ensure that the treatment of one subject will not reveal to either scientists or the patients clues about the treatment of the next subject. Trials involving behavioral therapies were four times more likely to have this problem.

Overall, nearly 20 percent of the trials used improper masking techniques to ensure that neither the patient nor the researchers know which treatment went to which patient.

The 146 trials in the review appeared between 2007 and 2008 in the five leading pediatric journals -- Pediatrics, Pediatric Infectious Diseases, Journal of Pediatrics, Archives of Pediatrics and Adolescent Medicine and the Journal of the American Academy of Child and Adolescent Psychiatry -- and the three highest-ranked general medical journals -- JAMA, The New England Journal of Medicine and The Lancet.

Co-investigators on the research: Roberta Scherer, Ph.D., of the Johns Hopkins Bloomberg School of Public Health and Diane Amin, PA-C., of Hopkins.


Story Source:

The above story is based on materials provided by Johns Hopkins Medical Institutions. Note: Materials may be edited for content and length.


Journal Reference:

  1. Michael T. Crocetti, Diane D. Amin, and Roberta Scherer. Assessment of Risk of Bias Among Pediatric Randomized Controlled Trials. Pediatrics, 2010; DOI: 10.1542/peds.2009-3121

Cite This Page:

Johns Hopkins Medical Institutions. "Pediatric clinical studies appear prone to bias, review shows." ScienceDaily. ScienceDaily, 12 July 2010. <www.sciencedaily.com/releases/2010/07/100712103451.htm>.
Johns Hopkins Medical Institutions. (2010, July 12). Pediatric clinical studies appear prone to bias, review shows. ScienceDaily. Retrieved November 22, 2014 from www.sciencedaily.com/releases/2010/07/100712103451.htm
Johns Hopkins Medical Institutions. "Pediatric clinical studies appear prone to bias, review shows." ScienceDaily. www.sciencedaily.com/releases/2010/07/100712103451.htm (accessed November 22, 2014).

Share This


More From ScienceDaily



More Science & Society News

Saturday, November 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

European Parliament Might Call For Google's Break-Up

European Parliament Might Call For Google's Break-Up

Newsy (Nov. 22, 2014) This is the latest development in an antitrust investigation accusing Google of unfairly prioritizing own products and services in search results. Video provided by Newsy
Powered by NewsLook.com
WFP: Ebola Risks Heightened Among Women Throughout Africa

WFP: Ebola Risks Heightened Among Women Throughout Africa

AFP (Nov. 21, 2014) Having children has always been a frightening prospect in Sierra Leone, the world's most dangerous place to give birth, but Ebola has presented an alarming new threat for expectant mothers. Duration: 00:37 Video provided by AFP
Powered by NewsLook.com
Toyota's Hydrogen Fuel-Cell Green Car Soon Available in the US

Toyota's Hydrogen Fuel-Cell Green Car Soon Available in the US

AFP (Nov. 21, 2014) Toyota presented its hydrogen fuel-cell compact car called "Mirai" to US consumers at the Los Angeles auto show. The car should go on sale in 2015 for around $60.000. It combines stored hydrogen with oxygen to generate its own power. Duration: 01:18 Video provided by AFP
Powered by NewsLook.com
Raw: Paralyzed Marine Walks With Robotic Braces

Raw: Paralyzed Marine Walks With Robotic Braces

AP (Nov. 21, 2014) Marine Corps officials say a special operations officer left paralyzed by a sniper's bullet in Afghanistan walked using robotic leg braces in a ceremony to award him a Bronze Star. (Nov. 21) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Science & Society

Business & Industry

Education & Learning

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins