Featured Research

from universities, journals, and other organizations

How selective hearing works in the brain: 'Cocktail party effect' explained

Date:
April 18, 2012
Source:
University of California - San Francisco
Summary:
The longstanding mystery of how selective hearing works -- how people can tune in to a single speaker while tuning out their crowded, noisy environs -- has just been solved. Psychologists have known for decades about the so-called "cocktail party effect," a name that evokes the Mad Men era in which it was coined. It is the remarkable human ability to focus on a single speaker in virtually any environment -- a classroom, sporting event or coffee bar -- even if that person's voice is seemingly drowned out by a jabbering crowd.

The longstanding mystery of how selective hearing works -- how people can tune in to a single speaker while tuning out their crowded, noisy environs has now been solved.
Credit: sg / Fotolia

The longstanding mystery of how selective hearing works -- how people can tune in to a single speaker while tuning out their crowded, noisy environs -- is solved this week in the journal Nature by two scientists from the University of California, San Francisco (UCSF).

Related Articles


Psychologists have known for decades about the so-called "cocktail party effect," a name that evokes the Mad Men era in which it was coined. It is the remarkable human ability to focus on a single speaker in virtually any environment -- a classroom, sporting event or coffee bar -- even if that person's voice is seemingly drowned out by a jabbering crowd.

To understand how selective hearing works in the brain, UCSF neurosurgeon Edward Chang, MD, a faculty member in the UCSF Department of Neurological Surgery and the Keck Center for Integrative Neuroscience, and UCSF postdoctoral fellow Nima Mesgarani, PhD, worked with three patients who were undergoing brain surgery for severe epilepsy.

Part of this surgery involves pinpointing the parts of the brain responsible for disabling seizures. The UCSF epilepsy team finds those locales by mapping the brain's activity over a week, with a thin sheet of up to 256 electrodes placed under the skull on the brain's outer surface or cortex. These electrodes record activity in the temporal lobe -- home to the auditory cortex.

UCSF is one of few leading academic epilepsy centers where these advanced intracranial recordings are done, and, Chang said, the ability to safely record from the brain itself provides unique opportunities to advance our fundamental knowledge of how the brain works.

"The combination of high-resolution brain recordings and powerful decoding algorithms opens a window into the subjective experience of the mind that we've never seen before," Chang said.

In the experiments, patients listened to two speech samples played to them simultaneously in which different phrases were spoken by different speakers. They were asked to identify the words they heard spoken by one of the two speakers.

The authors then applied new decoding methods to "reconstruct" what the subjects heard from analyzing their brain activity patterns. Strikingly, the authors found that neural responses in the auditory cortex only reflected those of the targeted speaker. They found that their decoding algorithm could predict which speaker and even what specific words the subject was listening to based on those neural patterns. In other words, they could tell when the listener's attention strayed to another speaker.

"The algorithm worked so well that we could predict not only the correct responses, but also even when they paid attention to the wrong word," Chang said.

Speech Recognition by the Human Brain and Machines

The new findings show that the representation of speech in the cortex does not just reflect the entire external acoustic environment but instead just what we really want or need to hear.

They represent a major advance in understanding how the human brain processes language, with immediate implications for the study of impairment during aging, attention deficit disorder, autism and language learning disorders.

In addition, Chang, who is also co-director of the Center for Neural Engineering and Prostheses at UC Berkeley and UCSF, said that we may someday be able to use this technology for neuroprosthetic devices for decoding the intentions and thoughts from paralyzed patients that cannot communicate.

Revealing how our brains are wired to favor some auditory cues over others it may even inspire new approaches toward automating and improving how voice-activated electronic interfaces filter sounds in order to properly detect verbal commands.

How the brain can so effectively focus on a single voice is a problem of keen interest to the companies that make consumer technologies because of the tremendous future market for all kinds of electronic devices with voice-active interfaces. While the voice recognition technologies that enable such interfaces as Apple's Siri have come a long way in the last few years, they are nowhere near as sophisticated as the human speech system.

An average person can walk into a noisy room and have a private conversation with relative ease -- as if all the other voices in the room were muted. In fact, said Mesgarani, an engineer with a background in automatic speech recognition research, the engineering required to separate a single intelligible voice from a cacophony of speakers and background noise is a surprisingly difficult problem.

Speech recognition, he said, is "something that humans are remarkably good at, but it turns out that machine emulation of this human ability is extremely difficult."

This work was funded by the National Institutes of Health and the Ester A. and Joseph Klingenstein Foundation.


Story Source:

The above story is based on materials provided by University of California - San Francisco. The original article was written by Jason Bardi. Note: Materials may be edited for content and length.


Journal Reference:

  1. Nima Mesgarani, Edward F. Chang. Selective cortical representation of attended speaker in multi-talker speech perception. Nature, 2012; DOI: 10.1038/nature11020

Cite This Page:

University of California - San Francisco. "How selective hearing works in the brain: 'Cocktail party effect' explained." ScienceDaily. ScienceDaily, 18 April 2012. <www.sciencedaily.com/releases/2012/04/120418135045.htm>.
University of California - San Francisco. (2012, April 18). How selective hearing works in the brain: 'Cocktail party effect' explained. ScienceDaily. Retrieved October 25, 2014 from www.sciencedaily.com/releases/2012/04/120418135045.htm
University of California - San Francisco. "How selective hearing works in the brain: 'Cocktail party effect' explained." ScienceDaily. www.sciencedaily.com/releases/2012/04/120418135045.htm (accessed October 25, 2014).

Share This



More Mind & Brain News

Saturday, October 25, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Academic Scandal Shocks UNC

Academic Scandal Shocks UNC

AP (Oct. 23, 2014) A scandal involving bogus classes and inflated grades at the University of North Carolina was bigger than previously reported, a new investigation found. (Oct. 23) Video provided by AP
Powered by NewsLook.com
Working Mother Getaway: Beaches Turks & Caicos

Working Mother Getaway: Beaches Turks & Caicos

Working Mother (Oct. 22, 2014) Feast your eyes on this gorgeous family-friendly resort. Video provided by Working Mother
Powered by NewsLook.com
What Your Favorite Color Says About You

What Your Favorite Color Says About You

Buzz60 (Oct. 22, 2014) We all have one color we love to wear, and believe it or not, your color preference may reveal some of your character traits. In celebration of National Color Day, Krystin Goodwin (@kyrstingoodwin) highlights what your favorite colors may say about you. Video provided by Buzz60
Powered by NewsLook.com
First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

Newsy (Oct. 21, 2014) A medical team has for the first time given a man the ability to walk again after transplanting cells from his brain onto his severed spinal cord. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins