Featured Research

from universities, journals, and other organizations

Pediatric clinical studies appear prone to bias, review shows

Date:
July 12, 2010
Source:
Johns Hopkins Medical Institutions
Summary:
A review of nearly 150 randomized controlled trials on children -- all published in well-regarded medical journals -- reveals that 40 to 60 percent of the studies either failed to take steps to minimize risk for bias or to at least properly describe those measures.

A Johns Hopkins review of nearly 150 randomized controlled trials on children -- all published in well-regarded medical journals -- reveals that 40 to 60 percent of the studies either failed to take steps to minimize risk for bias or to at least properly describe those measures.

Related Articles


A report of the team's findings in the August issue of Pediatrics shows that experimental trials sponsored by pharmaceutical or medical-device makers, along with studies that are not registered in a public-access database, had higher risk for bias. So were trials that evaluate the effects of behavioral therapies rather than medication, the report states.

"There are thousands of pediatric trials going on in the world right now and given the risk that comes from distorted findings, we must ensure vigilance in how these studies are designed, conducted and judged," says lead investigator Michael Crocetti, M.D., M.P.H., a pediatrician at Johns Hopkins Children's Center. "Our review is intended as a step in that direction."

Considered the gold standard of medical research, the hallmark of double-blind randomized controlled trials (RTC) is a design that rules out or accounts for actual or potential bias. Results of such studies, when peer-reviewed and published in reputable medical journals, can influence the practice of medicine and patient care. A poorly designed or executed trial can therefore lead researchers to erroneous conclusions about the effectiveness of a drug or a procedure.

Citing the degree of bias risk in the studies they reviewed, the researchers caution pediatricians to be critical readers of studies, even in highly respected journals.

The investigators advise that when reading a report on a trial, pediatricians should not merely look at the bottom line but ask two essential questions: How did the researchers reach the conclusion? and Was their analysis unbiased?

Doctors should apply "smell tests," common sense and skeptical judgment about whether the conclusions fit the data, especially when a study boasts dramatic effects or drastic improvement.

Crocetti and colleagues used the Cochrane Collaboration tool, which assesses risk for bias along six critical aspects including randomization -- randomly assigning patients to different treatments -- and masking, the degree to which neither the patient nor the doctor knows which group of patients is receiving an active drug or intervention versus a placebo.

Investigators say that by analyzing each clinical trial along these and four other dimensions, the Cochrane Collaboration can answer what are perhaps the most important questions in medical research: How strong is the causal relationship between the therapy and the effect? and How valid are the conclusions made about the effect of the therapy?

Overall, 41 percent of the 146 trials in the review had improper or poorly described randomization techniques. Industry-funded trials were six times more likely to have high risk for biased randomization than government-funded trials or those funded by nonprofit organizations. And past research, the investigators point out, has shown that industry-funded trials are four to five times more likely to recommend an experimental drug.

"Industry funding is an important driver of medical discovery, but it is critical for investigators involved in such trials to ensure not only that the studies are conceived and executed cautiously with minimum risk for bias, but that any precautions taken against bias are also reported transparently," Crocetti says.

Trial registration -- and the transparency commitment it reflects -- is a key step in reducing bias or its influence, the researchers say. In their evaluation, registered trials were nearly 70 percent more likely to have robust randomization than non-registered trials, probably because the registration process itself forces researchers to answer many questions related to trial design and execution. Therefore, the investigators say, registering pediatric trials in the public domain will not only increase transparency but, in the long run, improve the validity of their results. In 2005, the International Committee of Medical Journal Editors called for registering all medical trials involving human subjects with www.ClinicalTrials.gov, a massive public repository of more than 70,000 trials from all over the world. However, less than 60 percent of the pediatric trials in the review were registered there.

The researchers also found that most of the trials (57 percent) either failed to use proper techniques that ensure anonymity or "blinding" to the type of treatment a patient gets, or they failed to clearly describe these techniques. The technique, called allocation concealment, ensures that neither the researcher nor the patient can guess which treatment they will get. The method also helps ensure that the treatment of one subject will not reveal to either scientists or the patients clues about the treatment of the next subject. Trials involving behavioral therapies were four times more likely to have this problem.

Overall, nearly 20 percent of the trials used improper masking techniques to ensure that neither the patient nor the researchers know which treatment went to which patient.

The 146 trials in the review appeared between 2007 and 2008 in the five leading pediatric journals -- Pediatrics, Pediatric Infectious Diseases, Journal of Pediatrics, Archives of Pediatrics and Adolescent Medicine and the Journal of the American Academy of Child and Adolescent Psychiatry -- and the three highest-ranked general medical journals -- JAMA, The New England Journal of Medicine and The Lancet.

Co-investigators on the research: Roberta Scherer, Ph.D., of the Johns Hopkins Bloomberg School of Public Health and Diane Amin, PA-C., of Hopkins.


Story Source:

The above story is based on materials provided by Johns Hopkins Medical Institutions. Note: Materials may be edited for content and length.


Journal Reference:

  1. Michael T. Crocetti, Diane D. Amin, and Roberta Scherer. Assessment of Risk of Bias Among Pediatric Randomized Controlled Trials. Pediatrics, 2010; DOI: 10.1542/peds.2009-3121

Cite This Page:

Johns Hopkins Medical Institutions. "Pediatric clinical studies appear prone to bias, review shows." ScienceDaily. ScienceDaily, 12 July 2010. <www.sciencedaily.com/releases/2010/07/100712103451.htm>.
Johns Hopkins Medical Institutions. (2010, July 12). Pediatric clinical studies appear prone to bias, review shows. ScienceDaily. Retrieved November 24, 2014 from www.sciencedaily.com/releases/2010/07/100712103451.htm
Johns Hopkins Medical Institutions. "Pediatric clinical studies appear prone to bias, review shows." ScienceDaily. www.sciencedaily.com/releases/2010/07/100712103451.htm (accessed November 24, 2014).

Share This


More From ScienceDaily



More Science & Society News

Monday, November 24, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Symantec Uncovers Sophisticated Spying Malware Regin

Symantec Uncovers Sophisticated Spying Malware Regin

Newsy (Nov. 24, 2014) A Symantec white paper reveals details about Regin, a spying malware of unusual complexity which is believed to be state-sponsored. Video provided by Newsy
Powered by NewsLook.com
Hackers Target Business Travellers

Hackers Target Business Travellers

Reuters - Business Video Online (Nov. 24, 2014) A newly detected malware, dubbed Darkhotel, infects hotel networks with spying software to steal sensitive data from the computers of high profile business executives, warns a leading computer security firm. Ciara Lee reports. Video provided by Reuters
Powered by NewsLook.com
Are Female Bosses More Likely To Be Depressed?

Are Female Bosses More Likely To Be Depressed?

Newsy (Nov. 24, 2014) A new study links greater authority with increased depressive symptoms among women in the workplace. Video provided by Newsy
Powered by NewsLook.com
NY Gov. on Flood Prep: 'prepared for the Worst'

NY Gov. on Flood Prep: 'prepared for the Worst'

AP (Nov. 23, 2014) First came the big storm. Now comes the big melt for residents of flood-prone areas around Buffalo. New York's governor says officials are preparing for the worst as the temperature is expected to rise and potentially melt several feet of snow. (Nov. 23) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Science & Society

Business & Industry

Education & Learning

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins