Featured Research

from universities, journals, and other organizations

Robotic Perception, On Purpose

Date:
December 10, 2009
Source:
ICT Results
Summary:
Researchers have developed technology that enables a robot to combine data from both sound and vision to create combined, purposeful perception. In the process, they have taken the field to a new level.

European researchers developed technology that enables a robot to combine data from both sound and vision to create combined, purposeful perception. In the process, they have taken the field to a new level.

Currently, computer vision is good at recognising objects in images and videos and has been successfully employed in several specialised industrial applications, such as quality control during microchip fabrication.

But robotic perception is much weaker in less defined situations, like understanding and responding to human behaviour and even conversations. Yet, it is precisely this sort of interaction which promises the most compelling applications for future humanoid technology, where people-like robots can act as guides, or mix with people, or use perception to infer appropriate actions.

More importantly, these broad robotic applications will deliver insights into other disciplines, like cognition and neuroscience.

A truly perceptive robot, capable of acting independently and appropriately in complex situations remains a distant goal, but European researchers brought it much closer with their Perception-on-Purpose (POP) project.

Original, by design

"The originality of our project was our attempt to integrate two different sensory modalities, namely sound and vision," explains Radu Horaud, POP's coordinator.

"This was very difficult to do, because you are integrating two completely different physical phenomena," he adds.

Vision works from the reflection of light waves from an object, and it allows the observer to infer certain properties, like size, shape, density and texture. But with sound you are interested in locating the direction of the source, and trying to identify the type of sound it is.

Tricky issue

On its own, sound is difficult to pinpoint, because it needs to be located in a 3D space. Then there is the problem of background noise, such as an open window letting in sounds from next door.

But it turned out that integrating two different senses helped the researchers in their bid to locate and tune into relevant sounds.

"It is not that easy to decide what is foreground and what is background using sound alone, but by combining the two modalities -- sound and vision -- it becomes much easier," reveals Horaud.

"If you are able to locate ten sound sources in ten different directions, but if in one of these directions you see a face, then you can much more easily concentrate on that sound and throw out the other ones."

Integrated technology

This was one approach that the team took and, with the algorithms they developed, their robot, called Popeye, was able to identify the speaker with a fair degree of reliability.

"There is more work to be done on that aspect of the work, it is not completely robust yet," warns Horaud.

Still, it was a very strong result, and what makes it even more impressive is that the team managed to integrate all the technology into a neat and compact robotic platform.

"Most often, sound research is conducted in specialised labs, with arrays of microphones and a very controlled acoustic environment. But we integrated our two microphones and two cameras onto the head of our Popeye. The idea is to have an agent-centred cognitive system," Horaud stresses.

Powerful technology

The Popeye packs a lot of powerful technology into a small space and offers purposeful robotic perception. This is important because Horaud argues persuasively that, in evolutionary terms, multi-sensory perception and cognition are linked.

By perceiving a hand-held object with their two eyes, for example, monkeys -- and the first hominids after them -- developed stereo vision and hence were able to learn many properties of an object from combined tactile and visual data. Over time, they developed new skills, including building tools, from this information.

Horaud feels, too, that some modern uses of artificial intelligence (AI), like chess applications, are limited because they do not learn from their environment. They are programmed with abstract data -- say, chess moves -- and they process that.

"They cannot infer predicates from natural images; they cannot draw abstract information from physical observations," he stresses.

For now, POP has achieved many of its aims and developed very promising approaches. Commercial applications for this type of technology are not out of the question, and the researchers also hope to continue their work in a further project.

That project would look at extending some of POP's results into a functioning humanoid robot. In the meantime, POP's work means that the purposefully perceptive robot has become a not-so-distant future technology.

The POP project received funding from the Sixth Framework Programme for research.


Story Source:

The above story is based on materials provided by ICT Results. Note: Materials may be edited for content and length.


Cite This Page:

ICT Results. "Robotic Perception, On Purpose." ScienceDaily. ScienceDaily, 10 December 2009. <www.sciencedaily.com/releases/2009/11/091111120724.htm>.
ICT Results. (2009, December 10). Robotic Perception, On Purpose. ScienceDaily. Retrieved October 23, 2014 from www.sciencedaily.com/releases/2009/11/091111120724.htm
ICT Results. "Robotic Perception, On Purpose." ScienceDaily. www.sciencedaily.com/releases/2009/11/091111120724.htm (accessed October 23, 2014).

Share This



More Computers & Math News

Thursday, October 23, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Chameleon Camouflage to Give Tanks Cloaking Capabilities

Chameleon Camouflage to Give Tanks Cloaking Capabilities

Reuters - Innovations Video Online (Oct. 22, 2014) — Inspired by the way a chameleon changes its colour to disguise itself; scientists in Poland want to replace traditional camouflage paint with thousands of electrochromic plates that will continuously change colour to blend with its surroundings. The first PL-01 concept tank prototype will be tested within a few years, with scientists predicting that a similar technology could even be woven into the fabric of a soldiers' clothing making them virtually invisible to the naked eye. Matthew Stock reports. Video provided by Reuters
Powered by NewsLook.com
Internet of Things Aims to Smarten Your Life

Internet of Things Aims to Smarten Your Life

AP (Oct. 22, 2014) — As more and more Bluetooth-enabled devices are reaching consumers, developers are busy connecting them together as part of the Internet of Things. (Oct. 22) Video provided by AP
Powered by NewsLook.com
Free Math App Is A Teacher's Worst Nightmare

Free Math App Is A Teacher's Worst Nightmare

Newsy (Oct. 22, 2014) — New photo-recognition software from MicroBlink, called PhotoMath, solves linear equations and simple math problems with step-by-step results. Video provided by Newsy
Powered by NewsLook.com
Rate Hike Worries Down on Inflation Data

Rate Hike Worries Down on Inflation Data

Reuters - Business Video Online (Oct. 22, 2014) — Inflation remains well under control according to the latest consumer price index, giving the Federal Reserve more room to keep interest rates low for awhile. Bobbi Rebell reports. Video provided by Reuters
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins