Featured Research

from universities, journals, and other organizations

Need an expert? Try the crowd

August 14, 2012
University of Vermont
Can a crowd be an expert? Apparently, yes. Scientists have created the first-ever crowd-sourced predictive model.

"It's potentially a new way to do science."

Related Articles

In 1714, the British government held a contest. They offered a large cash prize to anyone who could solve the vexing "longitude problem" -- how to determine a ship's east/west position on the open ocean -- since none of their naval experts had been able to do so.

Lots of people gave it a try. One of them, a self-educated carpenter named John Harrison, invented the marine chronometer -- a rugged and highly precise clock -- that did the trick. For the first time, sailors could accurately determine their location at sea.

A centuries-old problem was solved. And, arguably, crowdsourcing was born.

Crowdsourcing is basically what it sounds like: posing a question or asking for help from a large group of people. Coined as a term in 2006, crowdsourcing has taken off in the internet era. Think of Wikipedia, and its thousands of unpaid contributors, now vastly larger than the Encyclopedia Britannica.

Crowdsourcing has allowed many problems to be solved that would be impossible for experts alone. Astronomers rely on an army of volunteers to scan for new galaxies. At climateprediction.net, citizens have linked their home computers to yield more than a hundred million hours of climate modeling; it's the world's largest forecasting experiment.

But what if experts didn't simply ask the crowd to donate time or answer questions? What if the crowd was asked to decide what questions to ask in the first place?

Could the crowd itself be the expert?

That's what a team at the University of Vermont decided to explore -- and the answer seems to be yes.

Prediction from the people

Josh Bongard and Paul Hines, professors in UVM's College of Engineering and Mathematical Sciences, and their students, set out to discover if volunteers who visited two different websites could pose, refine, and answer questions of each other -- that could effectively predict the volunteers' body weight and home electricity use.

The experiment, the first of its kind, was a success: the self-directed questions and answers by visitors to the websites led to computer models that effectively predict user's monthly electricity consumption and body mass index.

Their results, "Crowdsourcing Predictors of Behavioral Outcomes," were published in a recent edition of IEEE Transactions: Systems, Man and Cybernetics, a journal of the Institute of Electrical and Electronics Engineers.

"It's proof of concept that a crowd actually can come up with good questions that lead to good hypotheses," says Bongard, an expert on machine science.

In other words, the wisdom of the crowd can be harnessed to determine which variables to study, the UVM project shows -- and at the same time provide a pool of data by responding to the questions they ask of each other.

"The result is a crowdsourced predictive model," the Vermont scientists write.

Unexpected angles

Some of the questions the volunteers posed were obvious. For example, on the website dedicated to exploring body weight, visitors came up with the question: "Do you think of yourself as overweight?" And, no surprise, that proved to be the question with the most power to predict people's body weight.

But some questions posed by the volunteers were less obvious. "We had some eye-openers," Bongard says. "How often do you masturbate a month?" might not be the first question asked by weight-loss experts, but it proved to be the second-most-predictive question of the volunteer's self-reported weights -- more predictive than "how often do you eat during a day?"

"Sometimes the general public has intuition about stuff that experts miss -- there's a long literature on this," Hines says.

"It's those people who are very underweight or very overweight who might have an explanation for why they're at these extremes -- and some of those explanations might not be a simple combination of diet and exercise," says Bongard. "There might be other things that experts missed."

Cause and correlation

The researchers are quick to note that the variables revealed by the evolving Q&A on the experimental websites are simply correlated to outcomes -- body weight and electricity use -- not necessarily the cause.

"We're not arguing that this study is actually predictive of the causes," says Hines, "but improvements to this method may lead in that direction."

Nor do the scientists make claim to being experts on body weight or to be providing recommendations on health or diet (though Hines is an expert on electricity, and the EnergyMinder site he and his students developed for this project has a larger aim to help citizens understand and reduce their household energy use.)

"We're simply investigating the question: could you involve participants in the hypothesis-generation part of the scientific process?" Bongard says. "Our paper is a demonstration of this methodology."

"Going forward, this approach may allow us to involve the public in deciding what it is that is interesting to study," says Hines. "It's potentially a new way to do science."

And there are many reasons why this new approach might be helpful. In addition to forces that experts might simply not know about -- "can we elicit unexpected predictors that an expert would not have come up with sitting in his office?" Hines asks -- experts often have deeply held biases.

Faster discoveries

But the UVM team primarily sees their new approach as potentially helping to accelerate the process of scientific discovery. The need for expert involvement -- in shaping, say, what questions to ask on a survey or what variable to change to optimize an engineering design -- "can become a bottleneck to new insights," the scientists write.

"We're looking for an experimental platform where, instead of waiting to read a journal article every year about what's been learned about obesity," Bongard says, "a research site could be changing and updating new findings constantly as people add their questions and insights."

The goal: "exponential rises," the UVM scientists write, in the discovery of what causes behaviors and patterns -- probably driven by the people who care about them the most. For example, "it might be smokers or people suffering from various diseases," says Bongard. The team thinks this new approach to science could "mirror the exponential growth found in other online collaborative communities," they write.

"We're all problem-solving animals," says Bongard, "so can we exploit that? Instead of just exploiting the cycles of your computer or your ability to say 'yes' or 'no' on a survey -- can we exploit your creative brain?"

Story Source:

The above story is based on materials provided by University of Vermont. The original article was written by Joshua E. Brown. Note: Materials may be edited for content and length.

Cite This Page:

University of Vermont. "Need an expert? Try the crowd." ScienceDaily. ScienceDaily, 14 August 2012. <www.sciencedaily.com/releases/2012/08/120814213632.htm>.
University of Vermont. (2012, August 14). Need an expert? Try the crowd. ScienceDaily. Retrieved April 19, 2015 from www.sciencedaily.com/releases/2012/08/120814213632.htm
University of Vermont. "Need an expert? Try the crowd." ScienceDaily. www.sciencedaily.com/releases/2012/08/120814213632.htm (accessed April 19, 2015).

Share This

More From ScienceDaily

More Mind & Brain News

Sunday, April 19, 2015

Featured Research

from universities, journals, and other organizations

Featured Videos

from AP, Reuters, AFP, and other news services

Our Love Of Puppy Dog Eyes Explained By Science

Our Love Of Puppy Dog Eyes Explained By Science

Newsy (Apr. 17, 2015) Researchers found a spike in oxytocin occurs in both humans and dogs when they gaze into each other&apos;s eyes. Video provided by Newsy
Powered by NewsLook.com
Scientists Find Link Between Gestational Diabetes And Autism

Scientists Find Link Between Gestational Diabetes And Autism

Newsy (Apr. 17, 2015) Researchers who analyzed data from over 300,000 kids and their mothers say they&apos;ve found a link between gestational diabetes and autism. Video provided by Newsy
Powered by NewsLook.com
Video Messages Help Reassure Dementia Patients

Video Messages Help Reassure Dementia Patients

AP (Apr. 17, 2015) Family members are prerecording messages as part of a unique pilot program at the Hebrew Home in New York. The videos are trying to help victims of Alzheimer&apos;s disease and other forms of dementia break through the morning fog of forgetfulness. (April 17) Video provided by AP
Powered by NewsLook.com
Common Pain Reliever Might Dull Your Emotions

Common Pain Reliever Might Dull Your Emotions

Newsy (Apr. 16, 2015) Each week, millions of Americans take acetaminophen to dull minor aches and pains. Now researchers say it might blunt life&apos;s highs and lows, too. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.


Breaking News:

Strange & Offbeat Stories

Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News


Free Subscriptions

Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile

Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?

Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins