Featured Research

from universities, journals, and other organizations

What's behind a #1 ranking? Open-source LineUp software enables granular analysis of subjective ranking systems

Date:
January 31, 2014
Source:
Harvard School of Engineering and Applied Sciences
Summary:
Behind every “Top 100” list are a generous sprinkling of personal bias and subjective decisions. Lacking the tools to calculate how factors like median home prices and crime rates actually affect the “best places to live,” the public must take experts’ analysis at face value.

LineUp enables users to dynamically create their own rankings from raw data—in this example, the nutritional content of various breakfast cereals—by subjectively prioritizing some attributes over others.
Credit: Image courtesy of Alexander Lex

Behind every "Top 100" list are a generous sprinkling of personal bias and subjective decisions. Lacking the tools to calculate how factors like median home prices and crime rates actually affect the "best places to live," the public must take experts' analysis at face value.

To shed light on the trustworthiness of rankings, Harvard researchers have created LineUp, an open-source application that empowers ordinary citizens to make quick, easy judgments about rankings based on multiple attributes.

"It liberates people," says Alexander Lex, a postdoctoral researcher at the Harvard School of Engineering and Applied Sciences (SEAS). "Imagine if a magazine published a ranking of 'best restaurants.' With this tool, we don't have to rely on the editors' skewed or specific perceptions. Everybody on the Internet can go there and see what's really in the data and what part is personal opinion."

The first dynamic visualization software of its kind, LineUp allows users to assign weights to different parameters to create a custom ranking. For example, users might look at the raw data behind university rankings and decide for themselves the relative importance of student-faculty ratios or the number of citations per faculty member.

So intuitive and powerful is LineUp, that its creators -- Lex; his adviser Hanspeter Pfister, An Wang Professor of Computer Science at SEAS; Nils Gehlenborg, a research associate at Harvard Medical School; and Marc Streit and Samuel Gratzl at Johannes Kepler University in Linz -- earned the best paper award at the IEEE Information Visualization (InfoVis) conference in October 2013.

LineUp is part of a larger software package called Caleydo, an open-source visualization framework developed at Harvard, Johannes Kepler University, and Graz University of Technology. Caleydo visualizes genetic data and biological pathways -- for example, to analyze and characterize cancer subtypes.

"LineUp really was developed to address our need to understand the ranking of genes by mutation frequency and other clinical parameters in a group of patients," explains Pfister. "It is an ideal tool to create and visualize complex combined scores of bioinformatics algorithms."

"We started thinking about how we can make this easy for biologists to understand and how we can tell them what the most important parts of the dataset are," says Lex.

While LineUp is still being applied to formal genetic research, the group has chosen to also apply their work to simpler, more familiar ranking problems -- for example, the healthiness of different foods, best employers, or the best places to live.

LineUp introduces a dynamic element to the static analysis usually done on an Excel spreadsheet. It allows the user to immediately consider or ignore columns in a dataset by simply dragging them into or out of the window. It also enables side-by-side comparisons of alternative weighting systems.

And of course, not all metrics contribute to an item's rank the same way. Higher values of some metrics imply a higher rank, but not in all cases. LineUp has the ability to easily transform a dataset by inverting it, for example, making a lower crime rate correspond to a higher quality-of-life rank. Users can quickly apply and visualize the results of their intuitions.

Lex also emphasizes the potential for LineUp to be used predictively. Because LineUp makes it easy to pose many "what if" scenarios, a car manufacturer could devise a way to efficiently raise a vehicle's rank in a list of "best cars," perhaps by prioritizing fuel efficiency over style in the design process.

Previously, people without deep statistical or technical knowledge had no way of knowing authors' or institutions' potential biases or agendas. LineUp brings the public one step closer to simpler, personalized, and more meaningful data analysis.

"Essentially, it's a tool to allow people to explore the complexity of reality," says Lex.

LineUp is available as open-source software, free to use by anyone, at http://lineup.caleydo.org. The team is currently working on a web-based version that will make it easier to share and create rankings.

The research was supported in part by the Austrian Research Promotion Agency (840232), the Austrian Science Fund (J 3437-N15), Air Force Research Laboratory and Defense Advanced Research Projects Agency grant FA8750-12-C-0300, and the United States National Cancer Institute (U24 CA143867).


Story Source:

The above story is based on materials provided by Harvard School of Engineering and Applied Sciences. The original article was written by Manny Morone. Note: Materials may be edited for content and length.


Cite This Page:

Harvard School of Engineering and Applied Sciences. "What's behind a #1 ranking? Open-source LineUp software enables granular analysis of subjective ranking systems." ScienceDaily. ScienceDaily, 31 January 2014. <www.sciencedaily.com/releases/2014/01/140131230821.htm>.
Harvard School of Engineering and Applied Sciences. (2014, January 31). What's behind a #1 ranking? Open-source LineUp software enables granular analysis of subjective ranking systems. ScienceDaily. Retrieved April 19, 2014 from www.sciencedaily.com/releases/2014/01/140131230821.htm
Harvard School of Engineering and Applied Sciences. "What's behind a #1 ranking? Open-source LineUp software enables granular analysis of subjective ranking systems." ScienceDaily. www.sciencedaily.com/releases/2014/01/140131230821.htm (accessed April 19, 2014).

Share This



More Computers & Math News

Saturday, April 19, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Nintendo Changed Gaming World, but Its Future Uncertain: Upstone

Nintendo Changed Gaming World, but Its Future Uncertain: Upstone

AFP (Apr. 19, 2014) The Nintendo Game Boy celebrates its 25th anniversary Monday and game expert Stephen Upstone says the console can be credited with creating a trend towards handheld gaming devices. Duration: 01:21 Video provided by AFP
Powered by NewsLook.com
Facebook To Share Nearby Friends Data With Advertisers

Facebook To Share Nearby Friends Data With Advertisers

Newsy (Apr. 19, 2014) A Facebook spokesperson has confirmed the company will use GPS data from the new Nearby Friends feature for advertising sometime in the future. Video provided by Newsy
Powered by NewsLook.com
Man Claims He Found Loch Ness Monster With... Apple Maps?

Man Claims He Found Loch Ness Monster With... Apple Maps?

Newsy (Apr. 18, 2014) Andy Dixon showed the Daily Mail a screenshot of what he believes to be the mythical beast swimming just below the lake's surface. Video provided by Newsy
Powered by NewsLook.com
Facebook Announces Location-Sharing Feature 'Nearby Friends'

Facebook Announces Location-Sharing Feature 'Nearby Friends'

Newsy (Apr. 18, 2014) Facebook's pending Nearby Friends feature will give users the option to share their nonspecific or specific locations with certain friends. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins