Featured Research

from universities, journals, and other organizations

How vision captures sound now somewhat uncertain

Date:
January 16, 2014
Source:
Duke University
Summary:
Contrary to previous research, researchers have found that neurons in a particular brain region respond differently, not similarly, based on whether the stimuli is visual or auditory. The finding provides insight into how vision captures the location of perceived sound.

When listening to someone speak, we also rely on lip-reading and gestures to help us understand what the person is saying. To link these sights and sounds, the brain has to know where each stimulus is located so it can coordinate processing of related visual and auditory aspects of the scene. New research challenges previous understanding of how the brain works this through.
Credit: Minerva Studio / Fotolia

When listening to someone speak, we also rely on lip-reading and gestures to help us understand what the person is saying.

To link these sights and sounds, the brain has to know where each stimulus is located so it can coordinate processing of related visual and auditory aspects of the scene. That's how we can single out a conversation when it's one of many going on in a room.

While past research has shown that the brain creates a similar code for vision and hearing to integrate this information, Duke University researchers have found the opposite: neurons in a particular brain region respond differently, not similarly, based on whether the stimuli is visual or auditory.

The finding, which posted Jan. 15 in the journal PLOS ONE, provides insight into how vision captures the location of perceived sound.

The idea among brain researchers has been that the neurons in a brain area known as the superior colliculus employ a "zone defense" when signaling where stimuli are located. That is, each neuron monitors a particular region of an external scene and responds whenever a stimulus -- either visual or auditory -- appears in that location. Through teamwork, the ensemble of neurons provides coverage of the entire scene.

But the study by Duke researchers found that auditory neurons don't behave that way. When the target was a sound, the neurons responded as if playing a game of tug-of-war, said lead author Jennifer Groh, a professor of psychology and neuroscience at Duke.

"The neurons responded to nearly all sound locations. But how vigorously they responded depended on where the sound was," Groh said. "It's still teamwork, but a different kind. It's pretty cool that the neurons can use two different strategies, play two different games, at the same time."

Groh said the finding opens up a mystery: if neurons respond differently to visual and auditory stimuli at similar locations in space, then the underlying mechanism of how vision captures sound is now somewhat uncertain.

"Which neurons are 'on' tells you where a visual stimulus is located, but how strongly they're 'on' tells you where an auditory stimulus is located," said Groh, who conducted the study with co-author Jung Ah Lee, a postdoctoral fellow at Duke.

"Both of these kinds of signals can be used to control behavior, like eye movements, but it is trickier to envision how one type of signal might directly influence the other."

The study involved assessing the responses of neurons, located in the rostral superior colliculus of the midbrain, as two rhesus monkeys moved their eyes to visual and auditory targets.

The sensory targets -- light-emitting diodes attached to the front of nine speakers -- were placed 58 inches in front of the animals. The speakers were located from 24 degrees left to 24 degrees right of the monkey in 6-degree increments.

The researchers then measured the monkey's responses to bursts of white noise and the illuminating of the lights.

Groh said how the brain takes raw input of one form and converts it into something else "may be broadly useful for more cognitive processes."

"As we develop a better understanding of how those computations unfold it may help us understand a little bit more about how we think," she said.


Story Source:

The above story is based on materials provided by Duke University. Note: Materials may be edited for content and length.


Journal Reference:

  1. Jungah Lee, Jennifer M. Groh. Different Stimuli, Different Spatial Codes: A Visual Map and an Auditory Rate Code for Oculomotor Space in the Primate Superior Colliculus. PLoS ONE, 2014; 9 (1): e85017 DOI: 10.1371/journal.pone.0085017

Cite This Page:

Duke University. "How vision captures sound now somewhat uncertain." ScienceDaily. ScienceDaily, 16 January 2014. <www.sciencedaily.com/releases/2014/01/140116130822.htm>.
Duke University. (2014, January 16). How vision captures sound now somewhat uncertain. ScienceDaily. Retrieved October 22, 2014 from www.sciencedaily.com/releases/2014/01/140116130822.htm
Duke University. "How vision captures sound now somewhat uncertain." ScienceDaily. www.sciencedaily.com/releases/2014/01/140116130822.htm (accessed October 22, 2014).

Share This



More Mind & Brain News

Wednesday, October 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

Newsy (Oct. 21, 2014) A medical team has for the first time given a man the ability to walk again after transplanting cells from his brain onto his severed spinal cord. Video provided by Newsy
Powered by NewsLook.com
Portable Breathalyzer Gets You Home Safely

Portable Breathalyzer Gets You Home Safely

Buzz60 (Oct. 21, 2014) Breeze, a portable breathalyzer, gets you home safely by instantly showing your blood alcohol content, and with one tap, lets you call an Uber, a cab or a friend from your contact list to pick you up. Sean Dowling (@SeanDowlingTV) has the details. Video provided by Buzz60
Powered by NewsLook.com
Your Birth Season Might Determine Your Temperament

Your Birth Season Might Determine Your Temperament

Newsy (Oct. 20, 2014) A new study says the season you're born in can determine your temperament — and one season has a surprising outcome. Video provided by Newsy
Powered by NewsLook.com
Movies Might Desensitize Violence For Parents, Not Just Kids

Movies Might Desensitize Violence For Parents, Not Just Kids

Newsy (Oct. 20, 2014) A study suggests that parents become desensitized to violent movies as well as children, which leads them to allow their kids to view violent films. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins