Featured Research

from universities, journals, and other organizations

Sound With Space And Motion

Date:
June 30, 2004
Source:
University Of California Davis
Summary:
Motion-tracked binaural sound (MTB) captures cues for direction, distance and movement and the subtleties of natural, ambient sound that other systems don't.

UC Davis graduate student Bob Dalton tries out the sound studio. (Debbie Aldridge/UC Davis photo)

A conversation snaps around you. A string trio plays in front of you as you turn your attention from cello to violin. A soprano walks across the stage, and you turn your head to follow her voice. Conventional sound recording cannot capture those experiences -- but an invention by audio engineers at the University of California, Davis is changing that.

Motion-tracked binaural sound (MTB) captures cues for direction, distance and movement and the subtleties of natural, ambient sound that other systems don't. Developed by Ralph Algazi, Richard Duda and Dennis Thompson at the Interface Laboratory in the UC Davis Center for Image Processing and Integrated Computing (CIPIC), the patent-pending technique uses off-the-shelf equipment that won't break the bank.

For the listener, it's an eerie experience of listening to invisible people talking, playing music or singing around you while you can turn your attention from one to another.

"Conventional audio playback doesn't reflect how you hear in real life," Algazi said. "Your body, the shape of your head and the room acoustics all affect how you hear."

Conventional binaural recording uses microphones embedded in a dummy head to record sound, so that playback through headphones mimics the recording. That method does a fair job of reproducing sounds to the left and right but not to the front, where sounds appear to come from immediately in front of or behind your head. Furthermore, it doesn't allow for movement, Duda said.

"The problem is that people do not keep still," Duda said.

The new method records through multiple microphones (eight for voice, 16 for music) spaced around a head-sized ball or cylinder. The sound is played back through headphones with a small tracking device attached to the top to follow head movements. As you turn your head while listening, the system mixes sound from different microphones, reproducing what you would hear if you were in the room.

Listeners can move their heads to locate a sound source, turn to "face" a person speaking and tell when sound sources are nearby or far away. In addition, MTB captures the ambient sounds of the location, so you recognize the echoes in a church or the confines of a conference room.

The engineers have made sample recordings with musicians from the UC Davis music department and visiting classical and bluegrass musicians.

"The system can capture the sound of instruments much more fully than a conventional single microphone. It captures changes in sound and the effects of a room in a way that is much closer to reality," Algazi said.

"I think they have something really wonderful," said Pablo Ortiz, chair of the Department of Music at UC Davis.

"The thing that's interesting to me is the way that it records space," Ortiz said.

William Beck, a composer of electronic music and lecturer in the music department, said that live recordings could be a major application.

"The 'being there' feel is something people would really like," Beck said.

The technique could also be used for teleconferencing, computer games and virtual- or augmented-reality systems. The work, which is supported by grants from the National Science Foundation, was presented at the 116th Convention of the Audio Engineering Society held in May 2004 in Berlin, Germany.

The CIPIC Interface Laboratory is a multidisciplinary research center that studies human perception and its role in the interface between humans and machines.


Story Source:

The above story is based on materials provided by University Of California Davis. Note: Materials may be edited for content and length.


Cite This Page:

University Of California Davis. "Sound With Space And Motion." ScienceDaily. ScienceDaily, 30 June 2004. <www.sciencedaily.com/releases/2004/06/040630082125.htm>.
University Of California Davis. (2004, June 30). Sound With Space And Motion. ScienceDaily. Retrieved July 23, 2014 from www.sciencedaily.com/releases/2004/06/040630082125.htm
University Of California Davis. "Sound With Space And Motion." ScienceDaily. www.sciencedaily.com/releases/2004/06/040630082125.htm (accessed July 23, 2014).

Share This




More Matter & Energy News

Wednesday, July 23, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Government Approves East Coast Oil Exploration

Government Approves East Coast Oil Exploration

AP (July 18, 2014) The Obama administration approved the use of sonic cannons to discover deposits under the ocean floor by shooting sound waves 100 times louder than a jet engine through waters shared by endangered whales and turtles. (July 18) Video provided by AP
Powered by NewsLook.com
Sunken German U-Boat Clearly Visible For First Time

Sunken German U-Boat Clearly Visible For First Time

Newsy (July 18, 2014) The wreckage of the German submarine U-166 has become clearly visible for the first time since it was discovered in 2001. Video provided by Newsy
Powered by NewsLook.com
Obama: U.S. Must Have "smartest Airports, Best Power Grid"

Obama: U.S. Must Have "smartest Airports, Best Power Grid"

Reuters - US Online Video (July 17, 2014) President Barak Obama stopped by at a lunch counter in Delaware before making remarks about boosting the nation's infrastructure. Mana Rabiee reports. Video provided by Reuters
Powered by NewsLook.com
Crude Oil Prices Bounce Back After Falling Below $100 a Barrel

Crude Oil Prices Bounce Back After Falling Below $100 a Barrel

TheStreet (July 16, 2014) Oil Futures are bouncing back after tumbling below $100 a barrel for the first time since May yesterday. Jeff Grossman is the president of BRG Brokerage and trades at the NYMEX. Grossman tells TheStreet the Middle East is always a concern for oil traders. Oil prices were pushed down in recent weeks on Libya increasing its production. Supply disruptions in Iraq fading also contributed to prices falling. News from China's economic front showing a growth for the second quarter also calmed fears on its slowdown. Jeff Grossman talks to TheStreet's Susannah Lee on this and more on the Energy Department's Energy Information Administration (EIA) report. Video provided by TheStreet
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins