Featured Research

from universities, journals, and other organizations

'Seeing' bodies with sound (no sight required)

Date:
March 6, 2014
Source:
Cell Press
Summary:
People born unable to see are readily capable of learning to perceive the shape of the human body through soundscapes that translate images into sound, according to researchers. With a little training, soundscapes representing the outlines and silhouettes of bodies cause the brain's visual cortex -- and specifically an area dedicated in normally sighted people to processing body shapes -- to light up with activity.

People born unable to see are readily capable of learning to perceive the shape of the human body through soundscapes that translate images into sound, according to researchers who report their findings in the Cell Press journal Current Biology on March 6. With a little training, soundscapes representing the outlines and silhouettes of bodies cause the brain's visual cortex -- and specifically an area dedicated in normally sighted people to processing body shapes -- to light up with activity.

With no more than 70 hours of training on average, study participants could recognize the presence of a human form. What's more, they were able to detect the exact posture of the person in the image and imitate it.

"The idea is to replace information from a missing sense by using input from a different sense," explains Amir Amedi of The Hebrew University of Jerusalem. "It's just like bats and dolphins use sounds and echolocation to 'see' using their ears."

"Imagine for instance a diagonal line going down from left to right; if we use a descending musical scale -- going on the piano from right to left -- it will describe it nicely," continues Ella Striem-Amit, also of The Hebrew University. "And if the diagonal line is going up from left to right, then we use an ascending musical scale."

The researchers first taught people to perceive simple dots and lines. Then those individuals learned to connect the lines with junctions or curves, gradually working up to more and more complex images.

The success of the sensory substitution approach suggests great potential for its use in therapy more broadly, the researchers say.

"We're beginning to understand [that] the brain is more than a pure sensory machine," Amedi says. "It is a highly flexible task machine. The time has come to revive the focus on practical visual rehabilitation with sensory substitution devices."

In the current study, the researchers used an algorithm they call vOICe, which translates images in black and white. But they've since developed a newer algorithm, EyeMusic, which incorporates color information through the use of different musical instruments. The EyeMusic app is freely available on iTunes, where the researchers hope it can be useful to the blind and the general public alike.


Story Source:

The above story is based on materials provided by Cell Press. Note: Materials may be edited for content and length.


Journal Reference:

  1. Ella Striem-Amit, Amir Amedi. Visual Cortex Extrastriate Body-Selective Area Activation in Congenitally Blind People “Seeing” by Using Sounds. Current Biology, 06 March 2014 DOI: 10.1016/j.cub.2014.02.010

Cite This Page:

Cell Press. "'Seeing' bodies with sound (no sight required)." ScienceDaily. ScienceDaily, 6 March 2014. <www.sciencedaily.com/releases/2014/03/140306130413.htm>.
Cell Press. (2014, March 6). 'Seeing' bodies with sound (no sight required). ScienceDaily. Retrieved September 20, 2014 from www.sciencedaily.com/releases/2014/03/140306130413.htm
Cell Press. "'Seeing' bodies with sound (no sight required)." ScienceDaily. www.sciencedaily.com/releases/2014/03/140306130413.htm (accessed September 20, 2014).

Share This



More Mind & Brain News

Saturday, September 20, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Could Grief Affect The Immune Systems Of Senior Citizens?

Could Grief Affect The Immune Systems Of Senior Citizens?

Newsy (Sep. 19, 2014) The study found elderly people are much more likely to become susceptible to infection than younger adults going though a similar situation. Video provided by Newsy
Powered by NewsLook.com
Food Addiction Might Be Caused By PTSD

Food Addiction Might Be Caused By PTSD

Newsy (Sep. 18, 2014) New research shows that women who suffer from PTSD are three times more likely to develop a food addiction. Video provided by Newsy
Powered by NewsLook.com
Corporal Punishment on Decline, Debate Renews

Corporal Punishment on Decline, Debate Renews

AP (Sep. 16, 2014) Corporal punishment in the United States is on the decline, but there is renewed debate over its use after Minnesota Vikings running back Adrian Peterson was charged with child abuse. (Sept. 16) Video provided by AP
Powered by NewsLook.com
FDA Eyes Skin Shocks Used at Mass. School

FDA Eyes Skin Shocks Used at Mass. School

AP (Sep. 15, 2014) The FDA is considering whether to ban devices used by the Judge Rotenberg Educational Center in Canton, Massachusetts, the only place in the country known to use electrical skin shocks as aversive conditioning for aggressive patients. (Sept. 15) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins