Featured Research

from universities, journals, and other organizations

'Fat finger' compensator: Scientists use game to generate database for analysis of drawing

Date:
July 22, 2013
Source:
Carnegie Mellon University
Summary:
The fingers of thousands of people who created sketches of Brad Pitt and Angelina Jolie on their iPhones can collectively guide and correct the drawing strokes of subsequent touchscreen users in a new application created by researchers. The app compensates for the "fat finger" problem associated with touchscreens, automatically correcting a person's drawing strokes while preserving the user's artistic style.

Drawing of Angelina Jolie.
Credit: Image courtesy of Carnegie Mellon University

The fingers of thousands of people who created sketches of Brad Pitt and Angelina Jolie on their iPhones can collectively guide and correct the drawing strokes of subsequent touchscreen users in an application created by researchers at Carnegie Mellon University and Microsoft Research.

Related Articles


The app compensates for the "fat finger" problem associated with touchscreens, automatically correcting a person's drawing strokes while preserving the user's artistic style. "Our goal was to make it invisible to the user, so people wouldn't even be aware the correction is taking place," said Alex Limpaecher, a Ph.D. student in Carnegie Mellon's Computer Science Department.

Adrien Treuille, associate professor of computer science and robotics at Carnegie Mellon, said the drawing assistance app is just one example of how Big Data can be used to enhance drawing and writing on touchscreens and even provide deep insights into art and perception. The trick has been to create drawing databases large enough to leverage -- an obstacle that he and his research team surmounted with an iPhone drawing game.

The game they created, DrawAFriend, motivated thousands of people to sketch Pitt, Jolie and other celebrities. In its first week, the game generated 1,500 images a day. The game is still operational and the resulting database now includes more than 17,000 images, each with stroke-by-stroke information about how it was created.

"We are in the middle of a Big Data revolution," Treuille said. "We've found that Big Data can be used to do amazing things. But success is not inevitable; you have to have the dataset first. With DrawAFriend, we've found a way to use crowdsourcing to create this critical resource for a data-impoverished phenomenon." Limpaecher will present the team's findings today at SIGGRAPH 2013, the International Conference on Computer Graphics and Interactive Techniques, in Anaheim, Calif. In addition to Treuille, the other team members were Nicholas Feltman, a Ph.D. student in computer science, and Michael Cohen, principal researcher in Microsoft Research's Interactive Visual Media Group.

In DrawAFriend, players take turns drawing faces of celebrities or of mutual friends from Facebook. One player draws the face, tracing over a photo. As the portrait comes together, stroke by stroke, the other player guesses which letters are in the name of the subject of the portrait, much like in the game Hangman.

Limpaecher said the game accomplishes a number of objectives. Not only does it create a large database of drawing strokes, the game motivates players to try to draw as best they can and also evaluates the quality of the drawing by tracking the success of the other players' guesses.

The team used the database of celebrity photos to create a simple stroke-correction method. By determining the consensus of the strokes from the database drawings, they found that they could cancel out the "noise" caused by large fingers trying to draw on small screens. This correction occurs in real-time so the person is not aware that the drawing is being cleaned up even as it is being created.

Other applications abound. For instance, Limpaecher said algorithms have previously been created for identifying whether a person is drawing a face, or a human figure, or other subject, but large databases have not been available to enable their use. Likewise, the correction function now used for sketches based on photos could be modified for freehand drawing.

To broaden the database, the game could be modified to include drawings other than portrait sketches. Treuille said databases of drawings also could be used to address more basic questions. Drawings often differ substantially in appearance from their real-life subjects, he noted, which suggests that databases of drawings could be mined for insights into human perception. Such findings, in turn, might help in developing better object recognition or scene analysis for computer vision systems.

The databases also might be used to create teaching tools to improve the artistic techniques of students, he added.

More information, including a video, is available on the project website, http://graphics.cs.cmu.edu/projects/drawafriend/. This research was supported by the National Science Foundation and gifts from Google, Qualcomm, Adobe, Intel and the Okawa Foundation.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "'Fat finger' compensator: Scientists use game to generate database for analysis of drawing." ScienceDaily. ScienceDaily, 22 July 2013. <www.sciencedaily.com/releases/2013/07/130722123201.htm>.
Carnegie Mellon University. (2013, July 22). 'Fat finger' compensator: Scientists use game to generate database for analysis of drawing. ScienceDaily. Retrieved March 5, 2015 from www.sciencedaily.com/releases/2013/07/130722123201.htm
Carnegie Mellon University. "'Fat finger' compensator: Scientists use game to generate database for analysis of drawing." ScienceDaily. www.sciencedaily.com/releases/2013/07/130722123201.htm (accessed March 5, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Thursday, March 5, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Star Wars-Inspired Prototype Creates Holographic Display

Star Wars-Inspired Prototype Creates Holographic Display

Reuters - Innovations Video Online (Mar. 5, 2015) A prototype holographic display named Leia - after the Star Wars princess who appeared in holographic form asking Obi-Wan Kenobu for help - is demonstrated at the Mobile World Congress in Barcelona. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
IKEA and Samsung Launch Embedded Wireless Charging Range

IKEA and Samsung Launch Embedded Wireless Charging Range

Reuters - Innovations Video Online (Mar. 5, 2015) Samsung and IKEA hope their new embedded wireless charging products, launched at Barcelona&apos;s Mobile World Congress, will tempt consumers eager for plugless power. Jim Drury reports. Video provided by Reuters
Powered by NewsLook.com
Samsung Unveils $30,000 'Dream Doghouse'

Samsung Unveils $30,000 'Dream Doghouse'

Buzz60 (Mar. 5, 2015) On display at the Crufts dog show in England, the &apos;dog kennel of the future&apos; comes with features like a doggie treadmill and Samsung tablet. Mike Janela (@mikejanela) has more. Video provided by Buzz60
Powered by NewsLook.com
Doctor in Your Pocket Is Getting Smarter

Doctor in Your Pocket Is Getting Smarter

Reuters - Business Video Online (Mar. 5, 2015) Mobile apps are turning smartphones into a personal doctors, with users able to measure heart rate, blood pressure and even blood sugar. But will it change our behaviour? Ivor Bennett reports from the Mobile World Congress in Barcelona. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins