Featured Research

from universities, journals, and other organizations

Language learning: Video games used to crack the speech code

Date:
May 18, 2011
Source:
Carnegie Mellon University
Summary:
When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings? To replicate the challenges of learning language as an infant, researchers used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units.

When we speak, our enunciation and pronunciation of words and syllables fluctuates and varies from person to person. Given this, how do infants decode all of the spoken sounds they hear to learn words and meanings?

To replicate the challenges of learning language as an infant, Carnegie Mellon University's Lori Holt and Sung-Joo Lim and Stockholm University's Francisco Lacerda used video game training with a mock "alien" language. They discovered that listeners quickly recognize word-like units. They will present their findings at the Acoustical Society of America's annual meeting May 23-27 in Seattle.

To uncover how spoken sounds are decoded, the research team designed a video game narrated in deliberately distorted speech. The soundtrack, unintelligible in any language, was the only source of instruction for 77 adult players in the study. With just two hours of play, the participants could reliably extract world-length sound categories from continuous alien sounds and apply that learning to advance through the game.

"Traditionally, when we study adult learning in the lab, it's nothing like how infants learn language," said Holt, professor of psychology at CMU and a specialist in auditory cognitive neuroscience. "This video game models for adults the challenge language learning poses to infants. This presents the opportunity to study learning in ways that are just not feasible with infants."

Lacerda, professor of phonetics and an expert in language acquisition, agrees that the use of a video game is a promising new way to explore language learning. "This is a wonderful opportunity to approximate the task facing infants by creating a setting where adults are forced to infer what the meaning of different sound elements might be, and to do it in a functional way."

Understanding how language is learned has broad implications from treating dyslexia -- which causes difficulty identifying functional sound units -- to improving second language learning. Lim, a graduate student in psychology at CMU and lead author of the study, has used the game to help adults learn English. "Native speakers of Japanese can use this type of training to learn English consonants they have difficulty distinguishing," she said.

Holt, director of CMU's Speech Perception and Learning Laboratory, investigates how the brain interprets sound in order to provide a model of auditory categorization to solve problems related to speech perception and communication disorders. Holt and her colleagues are interested in taking this current study further to determine how the video game and its alien soundtrack engage different areas of the brain to produce rapid and robust learning. Their next step is to investigate this by observing players with functional magnetic resonance imaging (fMRI) to view their real-time brain reactions to the video game.

This study was funded by grants from the National Science Foundation, National Institutes of Health and Riksbankens Jubileumsfond, an independent Swedish foundation with the objective to promote and support the humanities and social sciences.


Story Source:

The above story is based on materials provided by Carnegie Mellon University. Note: Materials may be edited for content and length.


Cite This Page:

Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. ScienceDaily, 18 May 2011. <www.sciencedaily.com/releases/2011/05/110518105722.htm>.
Carnegie Mellon University. (2011, May 18). Language learning: Video games used to crack the speech code. ScienceDaily. Retrieved July 24, 2014 from www.sciencedaily.com/releases/2011/05/110518105722.htm
Carnegie Mellon University. "Language learning: Video games used to crack the speech code." ScienceDaily. www.sciencedaily.com/releases/2011/05/110518105722.htm (accessed July 24, 2014).

Share This




More Mind & Brain News

Thursday, July 24, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

China's Ageing Millions Look Forward to Bleak Future

China's Ageing Millions Look Forward to Bleak Future

AFP (July 24, 2014) China's elderly population is expanding so quickly that children struggle to look after them, pushing them to do something unexpected in Chinese society- move their parents into a nursing home. Duration: 02:07 Video provided by AFP
Powered by NewsLook.com
Idaho Boy Helps Brother With Disabilities Complete Triathlon

Idaho Boy Helps Brother With Disabilities Complete Triathlon

Newsy (July 23, 2014) An 8-year-old boy helped his younger brother, who has a rare genetic condition that's confined him to a wheelchair, finish a triathlon. Video provided by Newsy
Powered by NewsLook.com
Huge Schizophrenia Study Finds Dozens Of New Genetic Causes

Huge Schizophrenia Study Finds Dozens Of New Genetic Causes

Newsy (July 22, 2014) The 83 new genetic markers could open dozens of new avenues for schizophrenia treatment research. Video provided by Newsy
Powered by NewsLook.com
Why Do People Believe We Only Use 10 Percent Of Our Brains?

Why Do People Believe We Only Use 10 Percent Of Our Brains?

Newsy (July 22, 2014) The new sci-fi thriller "Lucy" is making people question whether we really use all our brainpower. But, as scientists have insisted for years, we do. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins