Featured Research

from universities, journals, and other organizations

New smartphone app automatically tags photos: Sensors on location, surroundings, other phones nearby add context to a photo

Date:
June 29, 2011
Source:
Duke University
Summary:
So much for tagging photographs with names, locations and activities yourself -- a new cell phone application can take care of that for you. The system works by taking advantage of the multiple sensors on a mobile phone, as well as those of other mobile phones in the vicinity.

Pictude are Chuan Qin, left, Xuan Bao, right.
Credit: Qin, Bao

So much for tagging photographs with names, locations and activities yourself -- a new cell phone application can take care of that for you.

Related Articles


The system works by taking advantage of the multiple sensors on a mobile phone, as well as those of other mobile phones in the vicinity.

Dubbed TagSense, the new app was developed by students from Duke University and the University of South Carolina (USC) and unveiled at the ninth Association for Computing Machinery's International Conference on Mobile Systems, Applications and Services (MobiSys), being held in Washington, D.C.

"In our system, when you take a picture with a phone, at the same time it senses the people and the context by gathering information from all the other phones in the area," said Xuan Bao, a Ph.D. student in computer science at Duke who received his master's degree at Duke in electrical and computer engineering.

Bao and Chuan Qin, a visiting graduate student from USC, developed the app working with Romit Roy Choudhury, assistant professor of electrical and computer engineering at Duke's Pratt School of Engineering. Qin and Bao are currently involved in summer internships at Microsoft Research.

"Phones have many different kinds of sensors that you can take advantage of," Qin said. "They collect diverse information like sound, movement, location and light. By putting all that information together, you can sense the setting of a photograph and describe its attributes."

By using information about the environment of a photograph, the students believe they can achieve a more accurate tagging of a particular photograph than could be achieved by facial recognition alone. Such information about a photograph's entirety provides additional details that can then be searched at a later time.

For example, the phone's built-in accelerometer can tell if a person is standing still for a posed photograph, bowling or even dancing. Light sensors in the phone's camera can tell if the shot is being taken indoors or outdoors on a sunny or cloudy day. The sensors can also approximate environmental conditions -- such as snow or rain -- by looking up the weather conditions at that time and location. The microphone can detect whether or not a person in the photograph is laughing, or quiet. All of these attributes are then assigned to each photograph, the students said.

Bao pointed out that with multiple tags describing more than just a particular person's name, it would be easier to not only organize an album of photographs for future reference, but find particular photographs years later. With the exploding number of digital pictures in the cloud and in our personal computers, the ability to easily search and retrieve desired pictures will be valuable in the future, he said.

"So, for example, if you've taken a bunch of photographs at a party, it would be easy at a later date to search for just photographs of happy people dancing," Qin said. "Or more specifically, what if you just wanted to find photographs only of Mary dancing at the party and didn't want to look through all the photographs of Mary?"

These added details of automatic tagging could help complement existing tagging applications, according to senior researcher Roy Choudhury.

"While facial recognition programs continue to improve, we believe that the ability to identify photographs based on the setting of the photograph can lead to a richer, more detailed way to tag photographs," Roy Choudhury said. "TagSense was compared to Apple's iPhoto and Google's Picasa, and showed that it can provide greater sophistication in tagging photographs."

The students envision that TagSense would most likely be adopted by groups of people, such as friends, who would "opt in," allowing their mobile phone capabilities to be harnessed when members of the group were together. Importantly, Roy Choudhury added, TagSense would not request sensed data from nearby phones that do not belong to this group, thereby protecting users' privacy.

The experiments were conducted using eight Google Nexus One mobile phones on more than 200 photos taken at various locations across the Duke campus, including classroom buildings, gyms and the art museum.

The current application is a prototype, and the researchers believe that a commercial product could be available in a few years.

Srihari Nelakuditi, associate professor of computer science and engineering at USC, was also a member of the research team. The research is supported by the National Science Foundation. Roy Choudhury's Systems Networking Research Group is also supported by Microsoft, Nokia, Verizon, and Cisco.


Story Source:

The above story is based on materials provided by Duke University. Note: Materials may be edited for content and length.


Cite This Page:

Duke University. "New smartphone app automatically tags photos: Sensors on location, surroundings, other phones nearby add context to a photo." ScienceDaily. ScienceDaily, 29 June 2011. <www.sciencedaily.com/releases/2011/06/110629122809.htm>.
Duke University. (2011, June 29). New smartphone app automatically tags photos: Sensors on location, surroundings, other phones nearby add context to a photo. ScienceDaily. Retrieved October 25, 2014 from www.sciencedaily.com/releases/2011/06/110629122809.htm
Duke University. "New smartphone app automatically tags photos: Sensors on location, surroundings, other phones nearby add context to a photo." ScienceDaily. www.sciencedaily.com/releases/2011/06/110629122809.htm (accessed October 25, 2014).

Share This



More Computers & Math News

Saturday, October 25, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Real-Life Transformer Robot Walks, Then Folds Into a Car

Real-Life Transformer Robot Walks, Then Folds Into a Car

Buzz60 (Oct. 24, 2014) — Brave Robotics and Asratec teamed with original Transformers toy company Tomy to create a functional 5-foot-tall humanoid robot that can march and fold itself into a 3-foot-long sports car. Jen Markham has the story. Video provided by Buzz60
Powered by NewsLook.com
Microsoft Riding High On Strong Surface, Cloud Performance

Microsoft Riding High On Strong Surface, Cloud Performance

Newsy (Oct. 24, 2014) — Microsoft's Q3 earnings showed its tablets and cloud services are really hitting their stride. Video provided by Newsy
Powered by NewsLook.com
The Best Apps to Organize Your Life

The Best Apps to Organize Your Life

Buzz60 (Oct. 23, 2014) — Need help organizing your bills, schedules and other things? Ko Im (@konakafe) has the best apps to help you stay on top of it all! Video provided by Buzz60
Powered by NewsLook.com
Nike And Apple Team Up To Create Wearable ... Something

Nike And Apple Team Up To Create Wearable ... Something

Newsy (Oct. 23, 2014) — For those looking for wearable tech that's significantly less nerdy than Google Glass, Nike CEO Mark Parker says don't worry, It's on the way. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins