Featured Research

from universities, journals, and other organizations

Human-Computer Interaction Gets A Helping Hand, Eye And Voice

Date:
August 11, 2000
Source:
National Science Foundation
Summary:
Computers are one step closer to "understanding" people, thanks to progress in human-computer interaction research at Rutgers University funded by the National Science Foundation (NSF) Directorate for Computer and Information Science and Engineering.

Research moves toward more-natural communication with computers

Computers are one step closer to "understanding" people, thanks to progress in human-computer interaction research at Rutgers University funded by the National Science Foundation (NSF) Directorate for Computer and Information Science and Engineering.

Keyboard and mouse inputs suffice for many users and PC applications. But NSF-funded researchers in a project called STIMULATE are developing systems that mimic other forms of communication that humans use to interact with each other, including eye contact, touch and voice. The experimental hardware and software may find uses in medicine, the military and other fields that could benefit from more natural forms of human-computer interaction across distributed networks. NSF funding is about $780,000 for three years.

Computer scientists and electrical engineers at Rutgers have designed Multimodal Input Manager (MIM) hardware that simultaneously receives speech, gaze and tactile signals. Then special software called Fusion Agent assimilates the complex inputs so the computer may respond to subtle signals that humans routinely use to communicate with one another.

A pneumatic "force-feedback" glove, patented by Rutgers, weighs less than three ounces and reads gestures by detecting fingertip positions relative to the palm. It lets the user point at the computer screen, overriding signals from a gaze-tracking camera.

Whereas other gaze trackers require cumbersome headpieces, the MIM's gimbal-mounted unit sits on the desktop and rotates to detect where the user is looking. After a 10-second initial calibration of the infrared detectors, the user can direct a cursor just by looking at a section of the computer screen.

"While we don't foresee that the keyboard and mouse will become obsolete anytime soon," said STIMULATE project leader James Flanagan, "MIM technology opens possibilities for improving current computer applications and for developing entirely new ones that require more-refined modes of human-computer interaction."

The software even detects lip movement to steer a microphone array for use in high-noise environments. For groups of users, the array can home in on the vocal source, even if the person speaking moves around the room.

MIM users at multiple locations can simultaneously interact with each other in a unified, 3D-work environment. Using the Java programming language, the project also produced new cWorld (for Collaborative World) software that lets teams of users construct those virtual environments.

"Human-computer interaction like STIMULATE is a major thrust of NSF's new Information Technology Research (ITR) program," said Michael Lesk, who oversees the $90 million ITR initiative in fiscal year 2000. "This is the kind of risk-taking project where success is not guaranteed but potential benefit is enormous." Lesk also noted the participation of 22 graduate students and 15 undergraduates in the project.

The MIM has been tested by medical doctors for analyzing images of blood samples, X-rays and MRI tests. A physician can use the tactile, voice-recognition and eye-tracking inputs to rapidly separate distinct image characteristics, then vocally query the database for samples that match.

Another field test of the MIM hardware was a disaster-relief simulation involving Army National Guard officers at Fort Dix, New Jersey. By using the STIMULATE system to interact with remote staff, a command officer was able to rapidly process 2D and 3D representations of logistical, personnel and equipment data. Due to the unsuitability of a keyboard and mouse, these tasks are presently handled with voice-only communications, and data are plotted using acetate map overlays and grease pencils.

-NSF-

For illustrations of STIMULATE, see: http://www.nsf.gov/od/lpa/news/press/00/stimulate.htm


Story Source:

The above story is based on materials provided by National Science Foundation. Note: Materials may be edited for content and length.


Cite This Page:

National Science Foundation. "Human-Computer Interaction Gets A Helping Hand, Eye And Voice." ScienceDaily. ScienceDaily, 11 August 2000. <www.sciencedaily.com/releases/2000/07/000727080959.htm>.
National Science Foundation. (2000, August 11). Human-Computer Interaction Gets A Helping Hand, Eye And Voice. ScienceDaily. Retrieved September 16, 2014 from www.sciencedaily.com/releases/2000/07/000727080959.htm
National Science Foundation. "Human-Computer Interaction Gets A Helping Hand, Eye And Voice." ScienceDaily. www.sciencedaily.com/releases/2000/07/000727080959.htm (accessed September 16, 2014).

Share This



More Computers & Math News

Tuesday, September 16, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Microsoft to Buy 'Minecraft' Maker for $2.5B

Microsoft to Buy 'Minecraft' Maker for $2.5B

AP (Sep. 15, 2014) Microsoft will acquire the maker of the long-running hit game Minecraft for $2.5 billion as the company continues to invest in its Xbox gaming platform and looks to grab attention on mobile phones. (Sept. 15) Video provided by AP
Powered by NewsLook.com
Manufacturer Prints 3-D Car In Record Time

Manufacturer Prints 3-D Car In Record Time

Newsy (Sep. 15, 2014) Automobile manufacturer Local Motors created a drivable electric car using a 3-D printer. Printing the body only took 44 hours. Video provided by Newsy
Powered by NewsLook.com
What $2.5B Deal Could Mean For Microsoft, 'Minecraft'

What $2.5B Deal Could Mean For Microsoft, 'Minecraft'

Newsy (Sep. 15, 2014) While Microsoft looks to be expanding its mobile business, the creators of "Minecraft" are stepping aside. Video provided by Newsy
Powered by NewsLook.com
Frustration As Drone Industry Outpaces Regulation In U.S.

Frustration As Drone Industry Outpaces Regulation In U.S.

Newsy (Sep. 14, 2014) U.S. firms worry they’re falling behind in the marketplace as the FAA considers how to regulate commercial drones. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins