Featured Research

from universities, journals, and other organizations

Language learning: Video games used to crack the speech code

Date:
May 18, 2011
Source:
Carnegie Mellon University
Summary:
When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings? To replicate the challenges of learning language as an infant, researchers used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units.

When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings?

To replicate the challenges of learning language as an infant, Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units. They will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

To uncover how spoken sounds are decoded, the research team designed a video game narrated in deliberately distorted speech. The soundtrack, unintelligible in any language, was the only source of instruction for 77 adult players in the study. With just two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that the use of a video game is a promising new way to explore language learning. "This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

Understanding how language is learned has broad implications from treating dyslexia -- which causes difficulty identifying functional sound units -- to improving second language learning. Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English. "Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said.

Holt, director of CMU's Speech Perception and Learning Laboratory, investigates how the brain interprets sound in order to provide a model of auditory categorization to solve problems related to speech perception and communication disorders. Holt and her colleagues are interested in taking this current study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid and robust learning. Their next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view their real-time brain reactions to the video game.

This study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond, an independent Swedish foundation with the objective to promote and support the humanities and social sciences.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. ScienceDaily, 18 May 2011. <www.sciencedaily.com/releases/2011/05/110518105722.htm>.
Carnegie Mellon University. (2011, May 18). Language learning: Video games used to crack the speech code. ScienceDaily. Retrieved July 31, 2014 from www.sciencedaily.com/releases/2011/05/110518105722.htm
Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. www.sciencedaily.com/releases/2011/05/110518105722.htm (accessed July 31, 2014).

Share This




More Mind & Brain News

Thursday, July 31, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Dieting At A Young Age Might Lead To Harmful Health Habits

Dieting At A Young Age Might Lead To Harmful Health Habits

Newsy (July 30, 2014) Researchers say women who diet at a young age are at greater risk of developing harmful health habits, including eating disorders and alcohol abuse. Video provided by Newsy
Powered by NewsLook.com
It's Not Just Facebook: OKCupid Experiments With Users Too

It's Not Just Facebook: OKCupid Experiments With Users Too

Newsy (July 29, 2014) If you've been looking for love online, there's a chance somebody has been looking at how you're looking. Video provided by Newsy
Powered by NewsLook.com
How Your Face Can Leave A Good Or Bad First Impression

How Your Face Can Leave A Good Or Bad First Impression

Newsy (July 29, 2014) Researchers have found certain facial features can make us seem more attractive or trustworthy. Video provided by Newsy
Powered by NewsLook.com
Losing Sleep Leaves You Vulnerable To 'False Memories'

Losing Sleep Leaves You Vulnerable To 'False Memories'

Newsy (July 27, 2014) A new study shows sleep deprivation can make it harder for people to remember specific details of an event. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

    Environment News

    Technology News



      Save/Print:
      Share:

      Free Subscriptions


      Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

      Get Social & Mobile


      Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

      Have Feedback?


      Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
      Mobile: iPhone Android Web
      Follow: Facebook Twitter Google+
      Subscribe: RSS Feeds Email Newsletters
      Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins