Featured Research

from universities, journals, and other organizations

Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said

Date:
November 10, 2008
Source:
NWO (Netherlands Organization for Scientific Research)
Summary:
Scientists have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices. In their Science article "Who" is Saying "What"? Brain-Based Decoding of Human Voice and Speech the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain.

Researchers have demonstrated that speech sounds and voices (such as those in the audio waves depicted above) can be identified by means of a unique 'neural fingerprint' in the listener's brain.
Credit: iStockphoto

Scientists from Maastricht University have developed a method to look into the brain of a person and read out who has spoken to him or her and what was said. With the help of neuroimaging and data mining techniques the researchers mapped the brain activity associated with the recognition of speech sounds and voices.

Related Articles


In their Science article "'Who' is Saying 'What'? Brain-Based Decoding of Human Voice and Speech," the four authors demonstrate that speech sounds and voices can be identified by means of a unique 'neural fingerprint' in the listener's brain. In the future this new knowledge could be used to improve computer systems for automatic speech and speaker recognition.

Seven study subjects listened to three different speech sounds (the vowels /a/, /i/ and /u/), spoken by three different people, while their brain activity was mapped using neuroimaging techniques (fMRI). With the help of data mining methods the researchers developed an algorithm to translate this brain activity into unique patterns that determine the identity of a speech sound or a voice. The various acoustic characteristics of vocal cord vibrations (neural patterns) were found to determine the brain activity.

Just like real fingerprints, these neural patterns are both unique and specific: the neural fingerprint of a speech sound does not change if uttered by somebody else and a speaker's fingerprint remains the same, even if this person says something different.

Moreover, this study revealed that part of the complex sound-decoding process takes place in areas of the brain previously just associated with the early stages of sound processing. Existing neurocognitive models assume that processing sounds actively involves different regions of the brain according to a certain hierarchy: after a simple processing in the auditory cortex the more complex analysis (speech sounds into words) takes place in specialised regions of the brain. However, the findings from this study imply a less hierarchal processing of speech that is spread out more across the brain.

The research was partly funded by the Netherlands Organisation for Scientific Research (NWO): Two of the four authors, Elia Formisano and Milene Bonte carried out their research with an NWO grant (Vidi and Veni). The data mining methods were developed during the PhD research of Federico De Martino (doctoral thesis defended at Maastricht University on 24 October 2008).


Story Source:

The above story is based on materials provided by NWO (Netherlands Organization for Scientific Research). Note: Materials may be edited for content and length.


Journal Reference:

  1. Elia Formisano, Federico De Martino, Milene Bonte, Rainer Goebel. ”Who” is Saying “What”? Brain-Based Decoding of Human Voice and Speech. Science, November 2008

Cite This Page:

NWO (Netherlands Organization for Scientific Research). "Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said." ScienceDaily. ScienceDaily, 10 November 2008. <www.sciencedaily.com/releases/2008/11/081110071240.htm>.
NWO (Netherlands Organization for Scientific Research). (2008, November 10). Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said. ScienceDaily. Retrieved December 22, 2014 from www.sciencedaily.com/releases/2008/11/081110071240.htm
NWO (Netherlands Organization for Scientific Research). "Neuroimaging Of Brain Shows Who Spoke To A Person And What Was Said." ScienceDaily. www.sciencedaily.com/releases/2008/11/081110071240.htm (accessed December 22, 2014).

Share This


More From ScienceDaily



More Mind & Brain News

Monday, December 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Researchers Test Colombian Village With High Alzheimer's Rates

Researchers Test Colombian Village With High Alzheimer's Rates

AFP (Dec. 19, 2014) In Yarumal, a village in N. Colombia, Alzheimer's has ravaged a disproportionately large number of families. A genetic "curse" that may pave the way for research on how to treat the disease that claims a new victim every four seconds. Duration: 02:42 Video provided by AFP
Powered by NewsLook.com
Double-Amputee Becomes First To Move Two Prosthetic Arms With His Mind

Double-Amputee Becomes First To Move Two Prosthetic Arms With His Mind

Buzz60 (Dec. 19, 2014) A double-amputee makes history by becoming the first person to wear and operate two prosthetic arms using only his mind. Jen Markham has the story. Video provided by Buzz60
Powered by NewsLook.com
Prenatal Exposure To Pollution Might Increase Autism Risk

Prenatal Exposure To Pollution Might Increase Autism Risk

Newsy (Dec. 18, 2014) Harvard researchers found children whose mothers were exposed to high pollution levels in the third trimester were twice as likely to develop autism. Video provided by Newsy
Powered by NewsLook.com
Yoga Could Be As Beneficial For The Heart As Walking, Biking

Yoga Could Be As Beneficial For The Heart As Walking, Biking

Newsy (Dec. 17, 2014) Yoga can help your weight, blood pressure, cholesterol and heart just as much as biking and walking does, a new study suggests. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins