Featured Research

from universities, journals, and other organizations

Models to predict scientists' future impact often fail

Date:
October 30, 2013
Source:
Aalto University
Summary:
Models universities partially use to forecast scientists' future contributions are not as reliable as previously thought. Mathematical analysis of past performance cannot reliably determine the future performance, researchers say. This means that current models dangerously overestimate the predictability and should not be used for career advancement decision process.

Researchers are at work.
Credit: Aalto University

Models universities partially use to forecast scientists' future contributions are not as reliable as previously thought. In a recent study, Aalto University and IMT Institute for Advanced Studies Lucca researchers demonstrate mathematical analysis of past performance cannot reliably determine the future performance. This means that current models dangerously overestimate the predictability and should not be used for career advancement decision process.

Related Articles


"Based on our results, the predictability of current models for real application in recruitment decisions is questionable. Efforts to model future impact need to be aimed more directly at applications in the career advancement decision process," says Professor Santo Fortunato from Aalto University in Finland.

In recent years it has become more common for universities to use quantitative measures for yard-sticking the productivity and impact of individual researchers to help reduce hiring risks. Models thought to be capable of foreseeing a scientist's future impact by way of his or her future 'h-index' have become a common tool in recruitment decisions as well as other scientific evaluation, advancement, and reward processes.

Scientists concluded that great caution should be taken when attempting to forecast an individual's future based on their 'h-index'. Specifically the authors show that it is easy to grossly overestimate the predictability of cumulative measures over a person's entire career.

The study analyzed 762 scientists from three disciplines: physics, biology, and mathematics. By applying future impact models to these careers, a number of subtle, but critical, flaws in current models were identified. Specifically, the 'h-index' contains false autocorrelation, resulting in a significant overestimation of "predictive power." Moreover, the "predictive power" of these models vary greatly with the career age of scientists, producing least accurate estimates for already risk-burdened early career researchers.

Aalto researchers concluded that care must be taken to select the correct measures and methods to evaluate scientific candidates in the future. Increased attention should be paid to the potential shortfalls of quantitative methods when applied to the decision-making process.


Story Source:

The above story is based on materials provided by Aalto University. Note: Materials may be edited for content and length.


Journal Reference:

  1. Orion Penner, Raj K. Pan, Alexander M. Petersen, Kimmo Kaski, Santo Fortunato. On the Predictability of Future Impact in Science. Scientific Reports, 2013; 3 DOI: 10.1038/srep03052

Cite This Page:

Aalto University. "Models to predict scientists' future impact often fail." ScienceDaily. ScienceDaily, 30 October 2013. <www.sciencedaily.com/releases/2013/10/131030092952.htm>.
Aalto University. (2013, October 30). Models to predict scientists' future impact often fail. ScienceDaily. Retrieved March 26, 2015 from www.sciencedaily.com/releases/2013/10/131030092952.htm
Aalto University. "Models to predict scientists' future impact often fail." ScienceDaily. www.sciencedaily.com/releases/2013/10/131030092952.htm (accessed March 26, 2015).

Share This


More From ScienceDaily



More Mind & Brain News

Thursday, March 26, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

AAA: Distracted Driving a Serious Teen Problem

AAA: Distracted Driving a Serious Teen Problem

AP (Mar. 25, 2015) While distracted driving is not a new problem for teens, new research from the AAA Foundation for Traffic Safety says it&apos;s much more serious than previously thought. (March 25) Video provided by AP
Powered by NewsLook.com
Smartphone Use Changing Our Brain and Thumb Interaction, Say Researchers

Smartphone Use Changing Our Brain and Thumb Interaction, Say Researchers

Reuters - Innovations Video Online (Mar. 25, 2015) European researchers say our smartphone use offers scientists an ideal testing ground for human brain plasticity. Dr Ako Ghosh&apos;s team discovered that the brains and thumbs of smartphone users interact differently from those who use old-fashioned handsets. Jim Drury went to meet him. Video provided by Reuters
Powered by NewsLook.com
Many Don't Know They Have Alzheimer's, But Their Doctors Do

Many Don't Know They Have Alzheimer's, But Their Doctors Do

Newsy (Mar. 24, 2015) According to a new study by the Alzheimer&apos;s Association, more than half of those who have the degenerative brain disease aren&apos;t told by their doctors. Video provided by Newsy
Powered by NewsLook.com
A Quick 45-Minute Nap Can Improve Your Memory

A Quick 45-Minute Nap Can Improve Your Memory

Newsy (Mar. 23, 2015) Researchers found those who napped for 45 minutes to an hour before being tested on information recalled it five times better than those who didn&apos;t. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins