Science News
from research organizations

Citizen scientists rival experts in analyzing land-cover data

Date:
July 31, 2013
Source:
International Institute for Applied Systems Analysis
Summary:
Data gathered and analyzed by non-experts can rival the quality of data from experts, shows a new study of crowdsourced data from the Geo-Wiki project.
Share:
       
Total shares:  
FULL STORY

This map shows all the locations of all data collected.
Credit: Linda See, IIASA

Over the past 5 years, IIASA researchers on the Geo-Wiki project have been leading a team of citizen scientists who examine satellite data to categorize land cover or identify places where people live and farm. These data have led to several publications published in peer-reviewed journals.

"One question we always get is whether the analysis from laypeople is as good as that from experts. Can we rely on non-experts to provide accurate data analysis?" says IIASA researcher Linda See, who led the study published in the journal PLOS ONE.

The researchers compared 53,000 data points analyzed by more than 60 individuals, including experts and non-experts in remote sensing and geospatial sciences. The new study shows that non-experts were as good as experts at identifying human impact, a concept that has emerged from ecological sciences, in satellite land cover data.

However, the study showed, experts were better at identifying the specific land-cover types such as forest, farmland, grassland, or desert. When presented with control data where researchers knew the land-cover type, experts identified land cover correctly 69% of the time, while non-experts made correct classifications only 62% of the time. The researchers suggest that interactive training and feedback could help non-experts learn to make better classifications and continue to improve these numbers in the future.

"Citizen science has actually been around for a very long time in many different guises," says See. "But as the internet continues to proliferate in the developing world, and mobile devices and wearable sensors become the norm, we will see an explosion of activity in this area. Studies like this are critical for establishing the quality of data coming from citizens. What we need is more tools and techniques for helping us to continually improve this quality, and more partnerships with NGOs, industry, government and academia that actively involve and trust citizens."


Story Source:

The above story is based on materials provided by International Institute for Applied Systems Analysis. Note: Materials may be edited for content and length.


Journal Reference:

  1. Linda See, Alexis Comber, Carl Salk, Steffen Fritz, Marijn van der Velde, Christoph Perger, Christian Schill, Ian McCallum, Florian Kraxner, Michael Obersteiner. Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-Experts. PLoS ONE, 2013; 8 (7): e69958 DOI: 10.1371/journal.pone.0069958

Cite This Page:

International Institute for Applied Systems Analysis. "Citizen scientists rival experts in analyzing land-cover data." ScienceDaily. ScienceDaily, 31 July 2013. <www.sciencedaily.com/releases/2013/07/130731230118.htm>.
International Institute for Applied Systems Analysis. (2013, July 31). Citizen scientists rival experts in analyzing land-cover data. ScienceDaily. Retrieved May 23, 2015 from www.sciencedaily.com/releases/2013/07/130731230118.htm
International Institute for Applied Systems Analysis. "Citizen scientists rival experts in analyzing land-cover data." ScienceDaily. www.sciencedaily.com/releases/2013/07/130731230118.htm (accessed May 23, 2015).

Share This Page:


Science & Society News
May 23, 2015

Latest Headlines
updated 12:56 pm ET