Featured Research

from universities, journals, and other organizations

Here Comes The Holodeck: Virtual Reality + Artificial Intelligence = New Training Tool

Date:
May 10, 2001
Source:
University Of Southern California
Summary:
The use of virtual reality or arcade games to practice hand-eye coordination or quick reaction, or even to teach factual information is easy to understand and well accepted. But can such techniques also teach sound judgement and clear thinking in an emergency?

The use of virtual reality or arcade games to practice hand-eye coordination or quick reaction, or even to teach factual information is easy to understand and well accepted. But can such techniques also teach sound judgement and clear thinking in an emergency?

Related Articles


New programs developed by the University of Southern California's Information Sciences Institute (ISI) and two other cooperating USC institutes are designed to do just this by melding advances in artificial intelligence with state of the art work in rendering virtual environments in animation and sound.

A "Mission Rehearsal Exercise" developed for the U.S. Army by ISI, the USC Institute for Creative Technology (ICT), and the USC Integrated Media Systems Center (IMSC) takes soldier-trainees on a virtual reality mission in a troubled town in Bosnia. There, they must deal with a situation threatening to spin out of control.

It uses a movie-theater-sized (8 -feet tall, 31-foot wide) curved screen that looms around trainees. Combining with the screen images is highly directional and lifelike "immersive sound," creating a convincing illusion of being present at the scene, rather than observing a show.

The scene is populated with animated figures that exist only as computer programs, but are nevertheless autonomous agents who can interact with human trainees in real time.

An article about the Mission Rehearsal Exercise (MRE) program appeared in the documentation for AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment, at Stanford University March 26-28 2001. Presentation of another paper, along with partial demonstration of the system is scheduled for the Agents 2001 conference in Montreal, Que. May 28-June 1, 2001.

The army simulation is an early attempt to reach toward the "holodeck," the virtual reality training and recreation facility seen in "Star Trek: The Next Generation," according to project leader Jeff Rickel of ISI.

In one simulation scenario, a lieutenant enters the village to deal with one problem -- a weapons inspection team being threatened by an angry crowd -- and finds another one as well: an American jeep has accidentally struck and injured a local child.

Should the lieutenant split his forces to deal with both situations? If so, how? Meanwhile, a TV camera crew arrives, further complicating the situation.

The scene of the village uses 3-D computer modeling to create basic shapes visible from any angle enhanced by texture mapping. The group used commercial software from Boston Dynamics to add animations of people, and an extremely sophisticated sound system -- with multiple sound tracks (up to 64 tracks for some effects) played through no less than 12 speaker channels. Chris Kyriakakis of the IMSC created this system.

Two kinds of autonomous software agents inhabit this complex and convincing environment. Most are basic robotic programs that carry on a limited range of pre-scripted, routinized behavior -- milling in the background, standing around, etc.

Three -- the detachment medic and sergeant, and the anxious mother -- are more complex. These are software actors who have substantial abilities to react to what the trainee does. Their faces change expression, thanks to software from the Santa Cruz, CA-based Haptek Corporation. They move, and most strikingly, they can respond to speech.

Scripted characters are relatively easy to create, explains Rickel, "but have limited flexibility, making them well suited for bit parts." AI characters are more difficult to program, but can interact with people and with their environment in more flexible ways, making them well suited for key roles such as the mother, sergeant, and medic, who all have to interact with the human lieutenant.

Research by Rickel and his colleagues, who also include Jonathan Gratch, Randall Hill, and William Swartout of ICT and Stacy Marsella of ISI, has built on earlier work at ISI by Rickel and W. Lewis Johnson developing a teaching agent called "Steve."

Steve instructed Navy recruits in a virtual-reality world presented through VR glasses, responding to their simple questions. The Sergeant and the Medic are more advanced versions of Steve. Steve's appearance has been updated from the legless floating presence in the early version to a more lifelike form.

The third AI character, the Mother, adds another layer: she goes beyond words to the expression of emotions. Gratch and Marsella were responsible for this feature.

Another major addition to the Steve agent is the use of a dramatic story line, with continuing incidents driving the action. To keep score at the end, a television story reported by the news crew on the scene records the result of the trainee's responses to the situation, chronicling either an abandoned boy in critical condition, or a boy out of danger because of timely action.

"The work we have done in one way shows how far away the holodeck is -- but in another shows how useful it may be," Rickel said. "The project represents a grand challenge for both AI and virtual reality, but the potential payoff is a powerful new medium for experiential learning."

"What makes the Mission Rehearsal Exercise project unique is that we are bringing together for the first time a set of technologies including immersive audio, large scale graphics, and virtual humans and linking them to an interactive story line to create a compelling experience." added William Swartout of the ICT.

"The synergies that result are powerful. We were surprised to find that even though the system is still at its beginnings, some people came away from the simulation emotionally moved. I don't think this effect is due to any one element alone, but rather it is due to all of them working together."


Story Source:

The above story is based on materials provided by University Of Southern California. Note: Materials may be edited for content and length.


Cite This Page:

University Of Southern California. "Here Comes The Holodeck: Virtual Reality + Artificial Intelligence = New Training Tool." ScienceDaily. ScienceDaily, 10 May 2001. <www.sciencedaily.com/releases/2001/05/010510072050.htm>.
University Of Southern California. (2001, May 10). Here Comes The Holodeck: Virtual Reality + Artificial Intelligence = New Training Tool. ScienceDaily. Retrieved December 18, 2014 from www.sciencedaily.com/releases/2001/05/010510072050.htm
University Of Southern California. "Here Comes The Holodeck: Virtual Reality + Artificial Intelligence = New Training Tool." ScienceDaily. www.sciencedaily.com/releases/2001/05/010510072050.htm (accessed December 18, 2014).

Share This


More From ScienceDaily



More Computers & Math News

Thursday, December 18, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Navy Unveils Robot Fish

Navy Unveils Robot Fish

Reuters - Light News Video Online (Dec. 18, 2014) The U.S. Navy unveils an underwater device that mimics the movement of a fish. Tara Cleary reports. Video provided by Reuters
Powered by NewsLook.com
How 2014 Shaped The Future Of The Internet

How 2014 Shaped The Future Of The Internet

Newsy (Dec. 18, 2014) It has been a long, busy year for Net Neutrality. The stage is set for an expected landmark FCC decision sometime in 2015. Video provided by Newsy
Powered by NewsLook.com
Amazon Offering One-Hour Delivery Through Prime Now

Amazon Offering One-Hour Delivery Through Prime Now

Newsy (Dec. 18, 2014) Amazon is now offering one-hour delivery to Amazon Prime members in Manhattan and hopes to expand to other cities soon. Video provided by Newsy
Powered by NewsLook.com
Jaguar Unveils 360 Virtual Windshield Making Car Pillars Appear Transparent

Jaguar Unveils 360 Virtual Windshield Making Car Pillars Appear Transparent

Buzz60 (Dec. 17, 2014) Jaguar unveils a virtual 360 degree windshield that may be the most futuristic automotive development yet. Jen Markham explains. Video provided by Buzz60
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins