Featured Research

from universities, journals, and other organizations

Selecting mathematical models with greatest predictive power: Finding Occam's razor in an era of information overload

Date:
November 20, 2013
Source:
Indiana University-Purdue University Indianapolis School of Science
Summary:
How to predict actions and reactions of things invisible to human eye? Physicists now show that there may be a preferred strategy for selecting mathematical models with the greatest predictive power. Picking the best model is about sticking to the simplest line of reasoning, experts say.

How can the actions and reactions of proteins so small or stars so distant they are invisible to the human eye be accurately predicted? How can blurry images be brought into focus and reconstructed?

A new study led by physicist Steve Pressé, Ph.D., of the School of Science at Indiana University-Purdue University Indianapolis, shows that there may be a preferred strategy for selecting mathematical models with the greatest predictive power. Picking the best model is about sticking to the simplest line of reasoning, according to Pressé. His paper explaining his theory is published online this month in Physical Review Letters.

"Building mathematical models from observation is challenging, especially when there is, as is quite common, a ton of noisy data available," said Pressé, an assistant professor of physics who specializes in statistical physics. "There are many models out there that may fit the data we do have. How do you pick the most effective model to ensure accurate predictions? Our study guides us towards a specific mathematical statement of Occam's razor."

Occam's razor is an oft cited 14th century adage that "plurality should not be posited without necessity" sometimes translated as "entities should not be multiplied unnecessarily." Today it is interpreted as meaning that all things being equal, the simpler theory is more likely to be correct.

A principle for picking the simplest model to answer complex questions of science and nature, originally postulated in the 19th century by Austrian physicist Ludwig Boltzmann, had been embraced by the physics community throughout the world. Then, in 1998, an alternative strategy for picking models was developed by Brazilian Constantino Tsallis. This strategy has been widely used in business (such as in option pricing and for modeling stock swings) as well as scientific applications (such as for evaluating population distributions). The new study finds that Boltzmann's strategy, not the 20th century alternative, assures that the models picked are the simplest and most consistent with data.

"For almost three decades in physics we have had two main competing strategies for picking the best model. We needed some resolution," Pressé said. "Even as simple an experiment as flipping a coin or as complex an enterprise as understanding functions of proteins or groups of proteins in human disease need a model to describe them. Simply put, we need one Occam's razor, not two, when selecting models."

In addition to Pressé, co-authors of "Nonadditive entropies yield probability distributions with biases not warranted by the data" are Kingshuk Ghosh of the University of Denver, Julian Lee of Soongsil University, and Ken A. Dill of Stony Brook University.

Pressé is also the first author of a companion paper, "Principles of maximum entropy and maximum caliber in statistical physics" published in the July-September issue of the Reviews of Modern Physics.


Story Source:

The above story is based on materials provided by Indiana University-Purdue University Indianapolis School of Science. Note: Materials may be edited for content and length.


Cite This Page:

Indiana University-Purdue University Indianapolis School of Science. "Selecting mathematical models with greatest predictive power: Finding Occam's razor in an era of information overload." ScienceDaily. ScienceDaily, 20 November 2013. <www.sciencedaily.com/releases/2013/11/131120103619.htm>.
Indiana University-Purdue University Indianapolis School of Science. (2013, November 20). Selecting mathematical models with greatest predictive power: Finding Occam's razor in an era of information overload. ScienceDaily. Retrieved October 23, 2014 from www.sciencedaily.com/releases/2013/11/131120103619.htm
Indiana University-Purdue University Indianapolis School of Science. "Selecting mathematical models with greatest predictive power: Finding Occam's razor in an era of information overload." ScienceDaily. www.sciencedaily.com/releases/2013/11/131120103619.htm (accessed October 23, 2014).

Share This



More Computers & Math News

Thursday, October 23, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Chameleon Camouflage to Give Tanks Cloaking Capabilities

Chameleon Camouflage to Give Tanks Cloaking Capabilities

Reuters - Innovations Video Online (Oct. 22, 2014) — Inspired by the way a chameleon changes its colour to disguise itself; scientists in Poland want to replace traditional camouflage paint with thousands of electrochromic plates that will continuously change colour to blend with its surroundings. The first PL-01 concept tank prototype will be tested within a few years, with scientists predicting that a similar technology could even be woven into the fabric of a soldiers' clothing making them virtually invisible to the naked eye. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Internet of Things Aims to Smarten Your Life

Internet of Things Aims to Smarten Your Life

AP (Oct. 22, 2014) — As more and more Bluetooth-enabled devices are reaching consumers, developers are busy connecting them together as part of the Internet of Things. (Oct. 22) Video provided by AP
Powered by NewsLook.com
Google's Inbox Is The Latest Gmail Competitor

Google's Inbox Is The Latest Gmail Competitor

Newsy (Oct. 22, 2014) — Google's new e-mail app is meant for greater personalization and allows users to better categorize their mail, but Gmail isn't going away just yet. Video provided by Newsy
Powered by NewsLook.com
Free Math App Is A Teacher's Worst Nightmare

Free Math App Is A Teacher's Worst Nightmare

Newsy (Oct. 22, 2014) — New photo-recognition software from MicroBlink, called PhotoMath, solves linear equations and simple math problems with step-by-step results. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins