Featured Research

from universities, journals, and other organizations

Language learning: Video games used to crack the speech code

Date:
May 18, 2011
Source:
Carnegie Mellon University
Summary:
When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings? To replicate the challenges of learning language as an infant, researchers used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units.

When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings?

To replicate the challenges of learning language as an infant, Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units. They will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

To uncover how spoken sounds are decoded, the research team designed a video game narrated in deliberately distorted speech. The soundtrack, unintelligible in any language, was the only source of instruction for 77 adult players in the study. With just two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that the use of a video game is a promising new way to explore language learning. "This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

Understanding how language is learned has broad implications from treating dyslexia -- which causes difficulty identifying functional sound units -- to improving second language learning. Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English. "Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said.

Holt, director of CMU's Speech Perception and Learning Laboratory, investigates how the brain interprets sound in order to provide a model of auditory categorization to solve problems related to speech perception and communication disorders. Holt and her colleagues are interested in taking this current study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid and robust learning. Their next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view their real-time brain reactions to the video game.

This study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond, an independent Swedish foundation with the objective to promote and support the humanities and social sciences.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. ScienceDaily, 18 May 2011. <www.sciencedaily.com/releases/2011/05/110518105722.htm>.
Carnegie Mellon University. (2011, May 18). Language learning: Video games used to crack the speech code. ScienceDaily. Retrieved April 24, 2014 from www.sciencedaily.com/releases/2011/05/110518105722.htm
Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. www.sciencedaily.com/releases/2011/05/110518105722.htm (accessed April 24, 2014).

Share This



More Mind & Brain News

Thursday, April 24, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Study Says Most Crime Not Linked To Mental Illness

Study Says Most Crime Not Linked To Mental Illness

Newsy (Apr. 22, 2014) A new study finds most crimes committed by people with mental illness are not caused by symptoms of their illness or disorder. Video provided by Newsy
Powered by NewsLook.com
How Smaller Plates And Cutlery Could Make You Feel Fuller

How Smaller Plates And Cutlery Could Make You Feel Fuller

Newsy (Apr. 22, 2014) NBC's "Today" conducted an experiment to see if changing the size of plates and utensils affects the amount individuals eat. Video provided by Newsy
Powered by NewsLook.com
Do We Get Nicer With Age?

Do We Get Nicer With Age?

Newsy (Apr. 22, 2014) A recent report claims personality can change over time as we age, and usually that means becoming nicer and more emotionally stable. Video provided by Newsy
Powered by NewsLook.com
How to Master Motherhood With the Best Work/Life Balance

How to Master Motherhood With the Best Work/Life Balance

TheStreet (Apr. 22, 2014) In the U.S., there are more than 11 million couples trying to conceive at any given time. From helping celebrity moms like Bethanny Frankel to ordinary soon-to-be-moms, TV personality and parenting expert, Rosie Pope, gives you the inside scoop on mastering motherhood. London-born entrepreneur Pope is the creative force behind Rosie Pope Maternity and MomPrep. She explains why being an entrepreneur offers the best life balance for her and tips for all types of moms. Video provided by TheStreet
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins