Featured Research

from universities, journals, and other organizations

Declining influence of high impact factor journals documented

Date:
November 7, 2012
Source:
Université de Montréal
Summary:
The most prestigious peer-reviewed journals in the world, such as Cell, Nature, Science, and the Journal of the American Medical Association (JAMA), have less and less influence amongst scientists, according to a new article. New research questions the relationship between journal “impact factor” and number of citations subsequently received by papers.

The most prestigious peer-reviewed journals in the world, such as Cell, Nature, Science, and the Journal of the American Medical Association (JAMA), have less and less influence amongst scientists, according to a paper co-authored by Vincent Larivière, a professor at the University of Montreal's School of Library and Information Sciences. He questions the relationship between journal "impact factor" and number of citations subsequently received by papers.

Related Articles


"In 1990, 45% of the top 5% most cited articles were published in the top 5% highest impact factor journals. In 2009, this rate was only 36%," Larivière said. "This means that the most cited articles are published less exclusively in high impact factor journals." The proportion of these articles published in major scholarly journals has sharply declined over the last twenty years. His study was based on a sample of more than 820 million citations and 25 million articles published between 1902 and 2009.

The findings were published in the Journal of the American Society for Information Science and Technology.

For each year analysed in the study, Larivière evaluated the strength of the relationship between article citations in the two years following publication against the journal impact factor. Then, he compared the proportion of the most cited articles published in the highest impact factor journals. "Using various measures, the goal was to see whether the 'predictive' power of impact factor on citations received by articles has changed over the years," Larivière said. "From 1902 to 1990, major findings were reported in the most prominent journals," notes Larivière. But this relationship is less true today."

Larivière and his colleagues George Lozano and Yves Gingras of UQAM's Observatoire des sciences et des technologies also found that the decline in high impact factor journals began in the early 90s, when the Internet experienced rapid growth within the scientific community. "Digital technology has changed the way researchers are informed about scientific texts. Historically, we all subscribed to paper journals. Periodicals were the main source for articles, and we didn't have to look outside the major journals," Larivière noted. "Since the advent of Google Scholar, for example, the process of searching information has completely changed. Search engines provide access to all articles, whether or not they are published in prestigious journals."

Impact factor as a measure of a journal's influence was developed in the 1960s by Eugene Garfield, one of the founders of bibliometrics. "It is basically the average number of times a journal's articles are cited over a two-year period," Larivière explained. "Initially, this indicator was used to help libraries decide which journals to subscribe to. But over time, it began to be used to evaluate researchers and determine the value of their publications." The importance of impact factor is so ingrained in academia's collective consciousness that researchers themselves use impact factor to decide which journals they will submit their articles to.

Various experts in bibliometrics have criticized the use of impact factor as a measure of an academic journal's visibility. A common criticism is that the indicator contains a calculation error. "Citations from all types of documents published by journal are counted," Larivière said, "but they are divided only by the number of articles and research notes. Impact factor is thus overestimated for journals that publish a good deal of editorials, letters to the editor, and science news, such as Science and Nature."

Another criticism is that the time frame in which citations are counted in calculating impact factor is too short. "There are research areas in which knowledge dissemination is faster than it is in others," Larivière said. "We cannot, for example, expect to get the same kind of impact factor in engineering and biomedical sciences." Yet journal impact factor is established in the two-year period following publication of articles regardless of the discipline.

The research results reveal some interesting points. On the one hand, journals are increasingly poor predictors of the number of citations an article can expect to receive. "Not only has the predictive power of impact factor declined, but also, impact factor is no longer suitable for evaluating research," Larivière argued. In his opinion, if we want to evaluate researchers and their work, it is best to use citations, which are a true measure of an article's impact. "This indicator is more accurate. It is not an estimation based on the hierarchy of journals." On the other hand, his work confirms that the dynamics of scholarly journals is changing, due especially to the open access of knowledge made possible by the Internet. "What then is the present function of scholarly journals?" Larivière asked. "One remains: peer review."


Story Source:

The above story is based on materials provided by Université de Montréal. Note: Materials may be edited for content and length.


Journal Reference:

  1. George A. Lozano, Vincent Larivière, Yves Gingras. The weakening relationship between the impact factor and papers' citations in the digital age. Journal of the American Society for Information Science and Technology, 2012; 63 (11): 2140 DOI: 10.1002/asi.22731

Cite This Page:

Université de Montréal. "Declining influence of high impact factor journals documented." ScienceDaily. ScienceDaily, 7 November 2012. <www.sciencedaily.com/releases/2012/11/121107073034.htm>.
Université de Montréal. (2012, November 7). Declining influence of high impact factor journals documented. ScienceDaily. Retrieved November 23, 2014 from www.sciencedaily.com/releases/2012/11/121107073034.htm
Université de Montréal. "Declining influence of high impact factor journals documented." ScienceDaily. www.sciencedaily.com/releases/2012/11/121107073034.htm (accessed November 23, 2014).

Share This


More From ScienceDaily



More Health & Medicine News

Sunday, November 23, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Ebola-Hit Sierra Leone's Late Cocoa Leaves Bitter Taste

Ebola-Hit Sierra Leone's Late Cocoa Leaves Bitter Taste

AFP (Nov. 23, 2014) — The arable district of Kenema in Sierra Leone -- at the centre of the Ebola outbreak in May -- has been under quarantine for three months as the cocoa harvest comes in. Duration: 01:32 Video provided by AFP
Powered by NewsLook.com
Don't Fall For Flu Shot Myths

Don't Fall For Flu Shot Myths

Newsy (Nov. 23, 2014) — Misconceptions abound when it comes to your annual flu shot. Medical experts say most people older than 6 months should get the shot. Video provided by Newsy
Powered by NewsLook.com
WFP: Ebola Risks Heightened Among Women Throughout Africa

WFP: Ebola Risks Heightened Among Women Throughout Africa

AFP (Nov. 21, 2014) — Having children has always been a frightening prospect in Sierra Leone, the world's most dangerous place to give birth, but Ebola has presented an alarming new threat for expectant mothers. Duration: 00:37 Video provided by AFP
Powered by NewsLook.com
Could Your Genes Be The Reason You're Single?

Could Your Genes Be The Reason You're Single?

Newsy (Nov. 21, 2014) — Researchers in Beijing discovered a gene called 5-HTA1, and carriers are reportedly 20 percent more likely to be single. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins