Featured Research

from universities, journals, and other organizations

What Is The Sound Of One Person Talking? New Speech Collection Tells All, Syllable By Syllable

Date:
May 1, 2006
Source:
Ohio State University
Summary:
When researchers interviewed 40 Columbus residents about their opinions on life in the city, the scientists ignored what the people had to say. All the scientists really cared about was how they said it.

This screen shot shows a typical display found on the DVD of the Buckeye Speech Corpus. Shown are two visual representations of a phrase spoken by one of the talkers, indicating volume and frequency. Below the displays is a line with a transcription of what the speaker is saying. Then comes a line of €œphonemic labeling,€ which shows how each word spoken was pronounced €“ similar to the pronunciation guides found in a dictionary. Please listen to the accompanying audio to hear the woman speaking this phrase.
Credit: Image courtesy of Ohio State University

When researchers interviewed 40 Columbus residents about their opinions on life in the city, the scientists ignored what the people had to say.

All the scientists really cared about was how they said it.

In a lab at Ohio State University , researchers recorded 30- to 60-minute casual interviews with these residents, talking about how Columbus has changed over the years, how families should get along, as well as issues in sports, traffic and politics.

The participants were told that the purpose of the study was to learn how people express “everyday” opinions in conversation. But when the interviews were over, the scientists didn't even examine the views that were expressed.

Instead, they painstakingly listened to every spoken word – indeed every syllable - along with coughs, laughs and pauses in the conversation, and then labeled what actually was spoken.

The result is a 306,652-word repository of how people in central Ohio speak. Now scientists from around the world, and in a variety of disciplines, can use the collection – called the Buckeye Speech Corpus – to advance their research. (Researchers refer to a collected body of recordings as a corpus.)

“A critical part of communication is how your ears translate the sounds coming out of my mouth into recognizable words,” said Mark Pitt, one of the leaders of the project, and professor of psychology at Ohio State.

“You don't have to go to school to learn how to do it. It is fast and efficient. The scientific question is ‘how is this done?' The corpus will help researchers find answers to that question and many others.”

Other members of this large research team include Eric Fosler-Lussier, assistant professor of computer science and engineering, and Elizabeth Hume, professor of linguistics, both at Ohio State.

The corpus, available to researchers on DVD, includes the actual recordings of the interviews, a written transcript, and several levels of labeling. The first half of the corpus was officially released in March.

A typical display of a stretch of speech from the DVD shows two visual representations of speech from one of the talkers, indicating volume and frequency. Below the displays is a line with a transcription of what the speaker is saying. Then comes a line of “phonemic labeling,” which shows how each word spoken was pronounced – similar to the pronunciation guides found in a dictionary.

This phonemic labeling is a key part of the corpus, because in casual conversations, people don't always use the proper English pronunciations they were taught in school, said Laura Dilley, a post-doctoral researcher in psychology who works on the corpus.

“It's interesting because of the many kinds of modifications that happen to the acoustics of speech in conversations,” Dilley said. “For example, we may pronounce ‘don't you' as ‘don'tcha' when we are talking.

“By looking at the phonemic transcriptions we can tell exactly how a person pronounced a word. And from that scientists may be able to make some inferences about why people produce the sound one way as opposed to another.”

The interviews are also labeled to show when people made non-word sounds during a conversation, such as a cough.

“Even laughs are noted, because some researchers may be interested in how that is part of a conversation,” Pitt said. “It can convey meaning as well.”

The 40 residents were interviewed in 1999 and 2000. But it has taken until this year to label the speech of half of the speakers, Pitt said. The data from the remaining 20 participants should be available by the end of the year.

“Collecting the interviews took a long time. But what really takes a long time is labeling them. Researchers had to listen to each conversation and figure out what sounds of the language the speakers said or didn't say. It's very difficult and very time consuming,” he said.

When you actually sit down to label each word, “they can blend together and be very difficult to identify,” Pitt said. “Sometimes you scratch your head trying to figure out how to label the speech. But when you're just listening to it as part of the conversation, it is all perfectly intelligible. That's part of the mystery of communication that scientists are trying to figure out.”

A combination of factors makes the Buckeye Speech Corpus a unique resource for researchers, according to Pitt and Dilley. For one, it is one of the largest corpora of high-fidelity, conversational speech available. Other corpora involve speakers reading words directly from a text, but that is very different than conversation. There are also corpora of conversational speech recorded over the telephone, but that does not have the high fidelity of this corpus, and the dynamic of face-to-face conversation.

Another key difference is that the Buckeye Corpus is available free to researchers, both in academia and industry.

Although the Buckeye Corpus has been available for only a few weeks, researchers from around the world are already ordering copies of it. A researcher from Italy ordered the corpus to study “slips of the tongue,” such as when people accidentally substitute one word for another that sounds similar (saying “rabbit” instead of “habit”).

Pitt and Dilley expect a lot more interest in the corpus.

“Across a variety of fields -- in communication, speech sciences, linguistics, speech and hearing, computer science, psychology – the corpus will provide different uses,” Pitt said. “It was created for all these scientific communities.”

Computer scientists could use the corpus to help improve speech recognition software. Communication researchers will find it useful to study conversational dynamics. Psychologists will be interested in what listeners are faced with in terms of the physical and acoustic properties of speech.

Eventually, the corpus will have a search function that will make it even more useful. “If a researcher wanted to look up all the uses or pronunciations of a certain word in the interviews, he or she could do that,” Dilley said.

The work of transcribing and labeling the interviews allowed the Ohio State researchers to uncover some interesting facts about how people speak in conversation.

For instance, the speakers spoke a total of 306,652 words, but only 9,600 different words. Almost 80 percent of the total words spoken were one-syllable words. One and two-syllable words made up more than 90 percent of the total words spoken.

Slightly more than half of the words spoken (57 percent) were function words – words like prepositions, pronouns and conjunctions that have mostly grammatical uses within a sentence. The remaining 43 percent were content words, which includes nouns, verbs and adjectives.

The Buckeye Speech Corpus project was originally funded with a seed grant from Ohio State's Office of Research. It has since received funding from the National Institute on Deafness and Other Communication Disorders, which is part of the National Institutes of Health.

Ohio State may be emerging as a center for corpora of conversational speech, Pitt said, as the Department of Speech and Hearing Sciences was just awarded a large, multi-year grant from NIH to collect interviews with speakers native to Ohio, Wisconsin, and western North Carolina.

Researchers can learn more about the corpus, and order a copy, at http://buckeyecorpus.osu.edu


Story Source:

The above story is based on materials provided by Ohio State University. Note: Materials may be edited for content and length.


Cite This Page:

Ohio State University. "What Is The Sound Of One Person Talking? New Speech Collection Tells All, Syllable By Syllable." ScienceDaily. ScienceDaily, 1 May 2006. <www.sciencedaily.com/releases/2006/05/060501230302.htm>.
Ohio State University. (2006, May 1). What Is The Sound Of One Person Talking? New Speech Collection Tells All, Syllable By Syllable. ScienceDaily. Retrieved September 21, 2014 from www.sciencedaily.com/releases/2006/05/060501230302.htm
Ohio State University. "What Is The Sound Of One Person Talking? New Speech Collection Tells All, Syllable By Syllable." ScienceDaily. www.sciencedaily.com/releases/2006/05/060501230302.htm (accessed September 21, 2014).

Share This



More Mind & Brain News

Sunday, September 21, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Could Grief Affect The Immune Systems Of Senior Citizens?

Could Grief Affect The Immune Systems Of Senior Citizens?

Newsy (Sep. 19, 2014) The study found elderly people are much more likely to become susceptible to infection than younger adults going though a similar situation. Video provided by Newsy
Powered by NewsLook.com
Food Addiction Might Be Caused By PTSD

Food Addiction Might Be Caused By PTSD

Newsy (Sep. 18, 2014) New research shows that women who suffer from PTSD are three times more likely to develop a food addiction. Video provided by Newsy
Powered by NewsLook.com
Corporal Punishment on Decline, Debate Renews

Corporal Punishment on Decline, Debate Renews

AP (Sep. 16, 2014) Corporal punishment in the United States is on the decline, but there is renewed debate over its use after Minnesota Vikings running back Adrian Peterson was charged with child abuse. (Sept. 16) Video provided by AP
Powered by NewsLook.com
FDA Eyes Skin Shocks Used at Mass. School

FDA Eyes Skin Shocks Used at Mass. School

AP (Sep. 15, 2014) The FDA is considering whether to ban devices used by the Judge Rotenberg Educational Center in Canton, Massachusetts, the only place in the country known to use electrical skin shocks as aversive conditioning for aggressive patients. (Sept. 15) Video provided by AP
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins