Featured Research

from universities, journals, and other organizations

Room With 85 Microphones And 8 Cameras Recognizes Speakers And Focuses On Them

Date:
February 5, 2009
Source:
Plataforma SINC
Summary:
A room with 85 microphones and eight cameras that act as the eyes and ears of a projected talking head that is capable of recognizing speakers and turning towards their position. The project brings the vision of interacting with machines in a human way one step closer.

The smart room seen from four of its cameras.
Credit: UPC / SINC

A room with 85 microphones and eight cameras that act as the eyes and ears of a projected talking head that is capable of recognizing speakers and turning towards their position. The project by these UPC researchers brings the vision of interacting with machines in a human way one step closer.

The research at the Polytechnic University of Catalonia (UPC) that has led to the design of this room seeks to change, first and foremost, the way in which we interact with computers. According to Josep Ramσn Casas, a research involved in the project, "the classic computer interface is comprised of a monitor, a keyboard and a mouse. In one way or another, the keyboard and the mouse are the methods used to enter information in the system; the monitor and the speakers, on the other hand, are how the system returns the information we are looking for".

In this room, that interface is generated by a system that more closely resembles what we as humans use. "We don't interact with another human with a monitor, keyboard and mouse, rather we talk to a person, who sees us and reacts accordingly. This room works in the same way", says Casas. The cameras and the microphones in the "smart room" act as sensors, so the room can see and hear what is going on inside and, according to the researcher, "when something is asked of it, the room reacts".

The output in this case comes from a talking head that addresses the person who asked the question and responds precisely with the information requested. "It is a talking bust projected with a synthesizer that moves in synch with its speech; it is like a secretary. The talking head moves to look at and address the person who asked the question", Josep R. Casas tells SINC.

Despite its promising outlook, the room is not a "science fiction house". Or at least that is not the project carried out by UPC. Through this interface, the room "can do the same thing that any other computer can do; that is, it can not do anything physical, but it can provide information. The room", says Josep Ramσn Casas, "does not act as a servant, rather it provides answers similar to those we would obtain from a computer".

Another of the unique features offered by this project is that the response from the "head" changes depending on the number of people in the room. The talking head also has a certain amount of good manners: if there is just one person in the room, it assumes that the information projected through the speakers will only be heard by that person and, therefore, it will not be a nuisance. However, if there are several people in the room, explains Casas, "it shows good manners and does not interrupt when the people are talking, and when someone asks it for information, it provides that information without bothering the others".

According to the researchers in the work published this month in Personal and Ubiquitous Computers, the smart room applied to an educational environment works in the following way: when people enter the room, it uses "multi-mode detection" to start to perceive and analyze the individuals. During the class, the room intervenes when a student raises their hand, alerting the teacher; when the teacher leaves the area, a pre-recorded message is played automatically; when the students take too long to finish a task, the room timer takes notice and plays another pre-recorded message. Finally, when the students leave, the room plays a good-bye message or complementary instructions (on how to exit the building or with the exercises that they must complete at home for that subject).

This application, called Memory Jog, was first developed in 2004 with the "meeting latecomer" version (the room provides information when someone enters). From there, the "teaching environment" was developed (the one described in the article). Finally, there is a demo called "journalists scenario", based on Memory Jog, that emulates an editorial office instead of a classroom.

Despite these efforts, the objective of these researchers is not so much to create a concept of a futuristic home, rather to evaluate the mechanisms used by the software to understand what it is seeing. Josep Ramσn Casas, speaking for his colleagues, said "we are not specialists in artificial intelligences, rather we use the room as an analysis environment; that is, how the room understands what happens inside, which is what are work is based on".


Story Source:

The above story is based on materials provided by Plataforma SINC. Note: Materials may be edited for content and length.


Journal Reference:

  1. Neumann et al. Integration of audiovisual sensors and technologies in a smart room. Personal and Ubiquitous Computing, 2009; 13 (1): 15 DOI: 10.1007/s00779-007-0172-1

Cite This Page:

Plataforma SINC. "Room With 85 Microphones And 8 Cameras Recognizes Speakers And Focuses On Them." ScienceDaily. ScienceDaily, 5 February 2009. <www.sciencedaily.com/releases/2009/02/090204140813.htm>.
Plataforma SINC. (2009, February 5). Room With 85 Microphones And 8 Cameras Recognizes Speakers And Focuses On Them. ScienceDaily. Retrieved April 20, 2014 from www.sciencedaily.com/releases/2009/02/090204140813.htm
Plataforma SINC. "Room With 85 Microphones And 8 Cameras Recognizes Speakers And Focuses On Them." ScienceDaily. www.sciencedaily.com/releases/2009/02/090204140813.htm (accessed April 20, 2014).

Share This



More Computers & Math News

Sunday, April 20, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Nintendo Changed Gaming World, but Its Future Uncertain: Upstone

Nintendo Changed Gaming World, but Its Future Uncertain: Upstone

AFP (Apr. 19, 2014) — The Nintendo Game Boy celebrates its 25th anniversary Monday and game expert Stephen Upstone says the console can be credited with creating a trend towards handheld gaming devices. Duration: 01:21 Video provided by AFP
Powered by NewsLook.com
Why Did Nike Fire Most Of Its Nike FuelBand Team?

Why Did Nike Fire Most Of Its Nike FuelBand Team?

Newsy (Apr. 19, 2014) — Nike fired most of its Digital Sport hardware team, the group behind Nike's FuelBand device. Could Apple or an overcrowded market be behind layoffs? Video provided by Newsy
Powered by NewsLook.com
Nearly Two Weeks On, The Internet Copes With Heartbleed

Nearly Two Weeks On, The Internet Copes With Heartbleed

Newsy (Apr. 19, 2014) — The Internet is taking important steps in patching the vulnerabilities Heartbleed highlighted, but those preventive measures carry their own costs. Video provided by Newsy
Powered by NewsLook.com
Facebook To Share Nearby Friends Data With Advertisers

Facebook To Share Nearby Friends Data With Advertisers

Newsy (Apr. 19, 2014) — A Facebook spokesperson has confirmed the company will use GPS data from the new Nearby Friends feature for advertising sometime in the future. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins