Featured Research

from universities, journals, and other organizations

Statistical Method Used Influences Results Of Observational Studies

Date:
January 17, 2007
Source:
JAMA and Archives Journals
Summary:
A study comparing different statistical methods used to remove the effects of selection bias in observational studies finds that results may vary and caution may be warranted when interpreting findings of studies using certain methods, according to an article in the January 17 issue of JAMA.

A study comparing different statistical methods used to remove the effects of selection bias in observational studies finds that results may vary and caution may be warranted when interpreting findings of studies using certain methods, according to an article in the January 17 issue of JAMA.

With financial, practical, and ethical challenges involved in undertaking randomized clinical trials (RCTs), investigators often use observational data to compare the outcomes of different therapies, to guide policy statements and clinical protocols, and in generalizing results to the community. However, these comparisons may be biased due to important baseline differences in prognostic factors among patients, often as a result of unobserved treatment selection biases, according to background information in the article.

Therese A. Stukel, Ph.D., of the Institute for Clinical Evaluative Sciences, Toronto, and colleagues compared four analytic methods applied to the same data to determine if the estimated benefit from invasive therapy depends on the statistical method used to adjust for overt (measured) and hidden (unmeasured) bias. Methods included multivariable model risk adjustment, propensity score risk adjustment, and propensity-based matching, which control for overt bias, and instrumental variable analysis, which is a method designed to control for hidden bias as well.

The study included 122,124 patients who were elderly (age 65-84 years), receiving Medicare, and hospitalized with acute myocardial infarction (AMI; heart attack) in 1994-1995, and who were eligible for cardiac catheterization. Patients who received cardiac catheterization (n = 73,238) were younger and had lower AMI severity than those who did not. Baseline chart reviews were taken from the Cooperative Cardiovascular Project and linked to Medicare health administrative data to provide a set of prognostic variables. Patients were followed up for 7 years through December 2001, to assess the association between long-term survival and cardiac catheterization within 30 days of hospital admission.

The researchers found that, even after accounting for prognostic variables, cardiac catheterization was associated with an approximate 50 percent relative decrease in death rate, using standard risk-adjustment methods such as multivariable model risk adjustment, propensity score risk adjustment, or propensity-based matching. Using regional catheterization rate as an instrument, the instrumental variable analysis showed a 16 percent relative decrease in the death rate. The survival benefits of routine invasive care from randomized clinical trials are between 8 percent and 21 percent.

"Within a large observational data set, the estimated association of invasive cardiac treatment with long-term mortality is sensitive to the analytic method used," the authors write.

"Randomized clinical trials cannot be undertaken in all situations in which evidence is needed to guide care. Well-designed observational studies are still needed to assess population effectiveness and to extend results to a general population setting. Our study serves as a cautionary note regarding their analysis and interpretation. First, propensity scores and propensity-based matching have the same limitations as multivariable risk adjustment model methods, and are no more likely to remove bias due to unmeasured confounding when strong selection bias exists. Second, instrumental variable analyses may remove both overt and hidden biases but are more suited to answer policy questions than to provide insight into a specific clinical question for a specific patient. Caution is advised regarding clinical protocols and policy statements for invasive care based on expected mortality benefits derived from traditional multivariable modeling and propensity score risk adjustment of observational studies," the researchers conclude.


Story Source:

The above story is based on materials provided by JAMA and Archives Journals. Note: Materials may be edited for content and length.


Cite This Page:

JAMA and Archives Journals. "Statistical Method Used Influences Results Of Observational Studies." ScienceDaily. ScienceDaily, 17 January 2007. <www.sciencedaily.com/releases/2007/01/070116205526.htm>.
JAMA and Archives Journals. (2007, January 17). Statistical Method Used Influences Results Of Observational Studies. ScienceDaily. Retrieved September 14, 2014 from www.sciencedaily.com/releases/2007/01/070116205526.htm
JAMA and Archives Journals. "Statistical Method Used Influences Results Of Observational Studies." ScienceDaily. www.sciencedaily.com/releases/2007/01/070116205526.htm (accessed September 14, 2014).

Share This



More Computers & Math News

Sunday, September 14, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Frustration As Drone Industry Outpaces Regulation In U.S.

Frustration As Drone Industry Outpaces Regulation In U.S.

Newsy (Sep. 14, 2014) U.S. firms worry they’re falling behind in the marketplace as the FAA considers how to regulate commercial drones. Video provided by Newsy
Powered by NewsLook.com
iPhone 6 Sales Mark Yet Another Year Of Records, Glitches

iPhone 6 Sales Mark Yet Another Year Of Records, Glitches

Newsy (Sep. 13, 2014) Customers looking to preorder the iPhone 6 on Friday experienced a few hiccups thanks to record demand for the device overnight. Video provided by Newsy
Powered by NewsLook.com
Is Photo-Sharing App Tiiny Really A Snapchat Competitor?

Is Photo-Sharing App Tiiny Really A Snapchat Competitor?

Newsy (Sep. 13, 2014) Tiiny, a photo-sharing app, is being called a Snapchat competitor. But after testing it ourselves, we'd have to disagree. Video provided by Newsy
Powered by NewsLook.com
Ebola Batters Sierra Leone Economy Too

Ebola Batters Sierra Leone Economy Too

Reuters - Business Video Online (Sep. 12, 2014) The World Health Organisation warns that local health workers in West Africa can't keep up with Ebola - and among those countries hardest hit by the outbreak, the economic damage is coming into focus, too. As David Pollard reports, Sierra Leone admits that growth in one of the poorest economies in the region is taking a beating. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

    Technology News



    Save/Print:
    Share:

    Free Subscriptions


    Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

    Get Social & Mobile


    Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

    Have Feedback?


    Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
    Mobile: iPhone Android Web
    Follow: Facebook Twitter Google+
    Subscribe: RSS Feeds Email Newsletters
    Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins