Featured Research

from universities, journals, and other organizations

Gestures that speak: Gesticulating while speaking is not just a 'colorful' habit

Date:
June 23, 2014
Source:
Sissa Medialab
Summary:
Have you ever found yourself gesticulating – and felt a bit stupid for it – while talking on the phone? You’re not alone: it happens very often that people accompany their speech with hand gestures, sometimes even when no one can see them. Why can’t we keep still while speaking? "Because gestures and words very probably form a single 'communication system', which ultimately serves to enhance expression intended as the ability to make oneself understood," explains a neuroscientist.

Have you ever found yourself gesticulating -- and felt a bit stupid for it -- while talking on the phone? You're not alone: it happens very often that people accompany their speech with hand gestures, sometimes even when no one can see them. Why can't we keep still while speaking? "Because gestures and words very probably form a single 'communication system', which ultimately serves to enhance expression intended as the ability to make oneself understood," explains Marina Nespor, a neuroscientist at the International School for Advanced Studies (SISSA) of Trieste.

Nespor, together with Alan Langus, a SISSA research fellow, and Bahia Guellai from the Universitι Paris Ouest Nanterre La Dιfence, who conducted the investigation at SISSA, has just published a study in Frontiers in Psychology which demonstrates the role of gestures in speech "prosody."

Linguists define prosody as the intonation and rhythm of spoken language, features that help to highlight sentence structure and therefore make the message easier to understand. For example, without prosody, nothing would distinguish the declarative statement "this is an apple" from the surprise question "this is an apple?" (in this case the difference lies in the intonation).

According to Nespor and colleagues, even hand gestures are part of prosody: "the prosody that accompanies speech is not 'modality specific'" explains Langus. "Prosodic information, for the person receiving the message, is a combination of auditory and visual cues. The 'superior' aspects (at the cognitive processing level) of spoken language are mapped to the motor-programs responsible for the production of both speech sounds and accompanying hand gestures."

Nespor, Langus and Guellai had 20 Italian speakers listen to a series of "ambiguous" utterances, which could be said with different prosodies corresponding to two different meanings. Examples of utterances were "come sicuramente hai visto la vecchia sbarra la porta" where, depending on meaning, "vecchia" can be the subject of the main verb (sbarrare, to block) or an adjective qualifying the subject (sbarra, bar) ('As you for sure have seen the old lady blocks the door' versus 'As you for sure have seen the old bar carries it'). The utterances could be simply listened to ("audio only" modality) or be presented in a video, where the participants could both listen to the sentences and see the accompanying gestures. In the "video" stimuli, the condition could be "matched" (gestures corresponding to the meaning conveyed by speech prosody) or "mismatched" (gestures matching the alternative meaning).

"In the matched conditions there was no improvement ascribable to gestures: the participants' performance was very good both in the video and in the "audio only" sessions. It's in the mismatched condition that the effect of hand gestures became apparent," explains Langus. "With these stimuli the subjects were much more likely to make the wrong choice (that is, they'd choose the meaning indicated in the gestures rather than in the speech) compared to matched or audio-only conditions. This means that gestures affect how meaning is interpreted, and we believe this points to the existence of a common cognitive system for gestures, intonation and rhythm of spoken language."

"In human communication, voice is not sufficient: even the torso and in particular hand movements are involved, as are facial expressions," concludes Nespor.


Story Source:

The above story is based on materials provided by Sissa Medialab. Note: Materials may be edited for content and length.


Journal Reference:

  1. Bahia Guellai, Alan Langus and Marina Nespor. Prosody in the hands of the speaker. Front. Psychol., 2014 DOI: 10.3389/fpsyg.2014.00700

Cite This Page:

Sissa Medialab. "Gestures that speak: Gesticulating while speaking is not just a 'colorful' habit." ScienceDaily. ScienceDaily, 23 June 2014. <www.sciencedaily.com/releases/2014/06/140623092259.htm>.
Sissa Medialab. (2014, June 23). Gestures that speak: Gesticulating while speaking is not just a 'colorful' habit. ScienceDaily. Retrieved October 22, 2014 from www.sciencedaily.com/releases/2014/06/140623092259.htm
Sissa Medialab. "Gestures that speak: Gesticulating while speaking is not just a 'colorful' habit." ScienceDaily. www.sciencedaily.com/releases/2014/06/140623092259.htm (accessed October 22, 2014).

Share This



More Mind & Brain News

Wednesday, October 22, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

First-Of-Its-Kind Treatment Gives Man Ability To Walk Again

Newsy (Oct. 21, 2014) — A medical team has for the first time given a man the ability to walk again after transplanting cells from his brain onto his severed spinal cord. Video provided by Newsy
Powered by NewsLook.com
Portable Breathalyzer Gets You Home Safely

Portable Breathalyzer Gets You Home Safely

Buzz60 (Oct. 21, 2014) — Breeze, a portable breathalyzer, gets you home safely by instantly showing your blood alcohol content, and with one tap, lets you call an Uber, a cab or a friend from your contact list to pick you up. Sean Dowling (@SeanDowlingTV) has the details. Video provided by Buzz60
Powered by NewsLook.com
Your Birth Season Might Determine Your Temperament

Your Birth Season Might Determine Your Temperament

Newsy (Oct. 20, 2014) — A new study says the season you're born in can determine your temperament — and one season has a surprising outcome. Video provided by Newsy
Powered by NewsLook.com
Movies Might Desensitize Violence For Parents, Not Just Kids

Movies Might Desensitize Violence For Parents, Not Just Kids

Newsy (Oct. 20, 2014) — A study suggests that parents become desensitized to violent movies as well as children, which leads them to allow their kids to view violent films. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins