Featured Research

from universities, journals, and other organizations

CrowdGrader brings crowdsourcing to the task of grading homework

Date:
September 11, 2013
Source:
University of California, Santa Cruz
Summary:
A new crowdsourcing tool that gets students involved in grading, CrowdGrader allows students to submit their homework online and then distributes the submitted solutions anonymously to other students in the class for grading.

Grading homework assignments for a large class can be a time-consuming chore, and overworked teaching assistants often have little time to give students detailed feedback. But help may be on the way: A new crowdsourcing tool developed at the University of California, Santa Cruz, lets students get involved in the grading.

Related Articles


CrowdGrader (www.crowdgrader.org) allows students to submit their homework online and then distributes the submitted solutions anonymously to other students in the class for grading. Using a novel crowdsourcing algorithm that relies on a reputation system to assess each student's grading accuracy, CrowdGrader combines the student-provided grades into a consensus grade for each submission. As an incentive to take the grading task seriously, each student's overall grade for an assignment depends in part on the quality of his or her work as a grader.

Luca de Alfaro, professor of computer science at UCSC's Baskin School of Engineering, worked with graduate student Michael Shavlovsky to develop CrowdGrader. They have been evaluating it for programming assignments (C++, Java, and Android) in computer science classes taught by de Alfaro and others at UCSC and at the University of Naples in Italy. Though still an experimental project, the preliminary results are encouraging, de Alfaro said.

"My impression is that the accuracy is not perfect, but it's no worse than what a TA does. There is always imprecision in grading," he said. "The real benefit is in the learning experience."

Grading other students' work actually helps students develop their programming skills, he said, because they get to see how other students have solved the same problem. Also, because their own work is graded by up to five other students, they get more feedback than they do from a teaching assistant.

"TAs are fairly consistent in the way they grade the homework submissions, but they tend to have schematic grading criteria that focus on some things and might miss others. From what I saw, the feedback from students gave a more holistic evaluation of the students' work," de Alfaro said.

De Alfaro and Shavlovsky described CrowdGrader in a recent technical report (arxiv.org/abs/1308.5273), which also presents the results of preliminary user studies. While more user studies are under way, de Alfaro said that he was happy with the results so far. He plans to use CrowdGrader in more classes this fall.

Crowdgrader is available online (www.crowdgrader.org), and anybody can use it. "It's hosted on a very stable platform, so if anybody wants to try it for their own classes, they can," de Alfaro said.


Story Source:

The above story is based on materials provided by University of California, Santa Cruz. Note: Materials may be edited for content and length.


Cite This Page:

University of California, Santa Cruz. "CrowdGrader brings crowdsourcing to the task of grading homework." ScienceDaily. ScienceDaily, 11 September 2013. <www.sciencedaily.com/releases/2013/09/130911160911.htm>.
University of California, Santa Cruz. (2013, September 11). CrowdGrader brings crowdsourcing to the task of grading homework. ScienceDaily. Retrieved January 27, 2015 from www.sciencedaily.com/releases/2013/09/130911160911.htm
University of California, Santa Cruz. "CrowdGrader brings crowdsourcing to the task of grading homework." ScienceDaily. www.sciencedaily.com/releases/2013/09/130911160911.htm (accessed January 27, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Tuesday, January 27, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Cablevision Enters Wi-Fi Phone Fray

Cablevision Enters Wi-Fi Phone Fray

Reuters - Business Video Online (Jan. 26, 2015) The entry by Cablevision and Google could intensify the already heated price wars for mobile phone service. Fred Katayama reports. Video provided by Reuters
Powered by NewsLook.com
Hector the Robot Mimics a Giant Stick Insect

Hector the Robot Mimics a Giant Stick Insect

Reuters - Innovations Video Online (Jan. 26, 2015) A robot based on a stick insect can navigate difficult terrain autonomously and adapt to its surroundings. Tara Cleary reports. Video provided by Reuters
Powered by NewsLook.com
Scientists Model Flying, Walking Drone After Vampire Bats

Scientists Model Flying, Walking Drone After Vampire Bats

Buzz60 (Jan. 26, 2015) Swiss scientists build a new drone that can both fly and walk, modeling it after the movements of common vampire bats. Jen Markham (@jenmarkham) has the story. Video provided by Buzz60
Powered by NewsLook.com
Malaysia Airlines Hack: Lizard Squad, ISIS Involved?

Malaysia Airlines Hack: Lizard Squad, ISIS Involved?

Newsy (Jan. 26, 2015) Malaysia Airlines on Sunday experienced website outages and what appeared to be an attack by hacker group Lizard Squad. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

    Health News

      Environment News

        Technology News



          Save/Print:
          Share:

          Free Subscriptions


          Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

          Get Social & Mobile


          Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

          Have Feedback?


          Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
          Mobile: iPhone Android Web
          Follow: Facebook Twitter Google+
          Subscribe: RSS Feeds Email Newsletters
          Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins