Featured Research

from universities, journals, and other organizations

Language learning: Video games used to crack the speech code

Date:
May 18, 2011
Source:
Carnegie Mellon University
Summary:
When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings? To replicate the challenges of learning language as an infant, researchers used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units.

When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings?

To replicate the challenges of learning language as an infant, Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units. They will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

To uncover how spoken sounds are decoded, the research team designed a video game narrated in deliberately distorted speech. The soundtrack, unintelligible in any language, was the only source of instruction for 77 adult players in the study. With just two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that the use of a video game is a promising new way to explore language learning. "This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

Understanding how language is learned has broad implications from treating dyslexia -- which causes difficulty identifying functional sound units -- to improving second language learning. Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English. "Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said.

Holt, director of CMU's Speech Perception and Learning Laboratory, investigates how the brain interprets sound in order to provide a model of auditory categorization to solve problems related to speech perception and communication disorders. Holt and her colleagues are interested in taking this current study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid and robust learning. Their next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view their real-time brain reactions to the video game.

This study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond, an independent Swedish foundation with the objective to promote and support the humanities and social sciences.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. ScienceDaily, 18 May 2011. <www.sciencedaily.com/releases/2011/05/110518105722.htm>.
Carnegie Mellon University. (2011, May 18). Language learning: Video games used to crack the speech code. ScienceDaily. Retrieved September 17, 2014 from www.sciencedaily.com/releases/2011/05/110518105722.htm
Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. www.sciencedaily.com/releases/2011/05/110518105722.htm (accessed September 17, 2014).

Share This



More Mind & Brain News

Wednesday, September 17, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

FDA Eyes Skin Shocks Used at Mass. School

FDA Eyes Skin Shocks Used at Mass. School

AP (Sep. 15, 2014) The FDA is considering whether to ban devices used by the Judge Rotenberg Educational Center in Canton, Massachusetts, the only place in the country known to use electrical skin shocks as aversive conditioning for aggressive patients. (Sept. 15) Video provided by AP
Powered by NewsLook.com
Shocker: Journalists Are Utterly Addicted To Coffee

Shocker: Journalists Are Utterly Addicted To Coffee

Newsy (Sep. 13, 2014) A U.K. survey found that journalists consumed the most amount of coffee, but that's only the tip of the coffee-related statistics iceberg. Video provided by Newsy
Powered by NewsLook.com
'Magic Mushrooms' Could Help Smokers Quit

'Magic Mushrooms' Could Help Smokers Quit

Newsy (Sep. 11, 2014) In a small study, researchers found that the majority of long-time smokers quit after taking psilocybin pills and undergoing therapy sessions. Video provided by Newsy
Powered by NewsLook.com
'Fat Shaming' Might Actually Cause Weight Gain

'Fat Shaming' Might Actually Cause Weight Gain

Newsy (Sep. 11, 2014) A study for University College London suggests obese people who are discriminated against gain more weight than those who are not. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

    Environment News

      Technology News



      Save/Print:
      Share:

      Free Subscriptions


      Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

      Get Social & Mobile


      Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

      Have Feedback?


      Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
      Mobile: iPhone Android Web
      Follow: Facebook Twitter Google+
      Subscribe: RSS Feeds Email Newsletters
      Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins