Featured Research

from universities, journals, and other organizations

Eye Movements Indicate Initial Attempts To Process What Humans Hear

Date:
February 21, 2003
Source:
Brown University
Summary:
By mapping eye movements in fractions of a second, a Brown researcher has found humans attempt to make sense of what they are hearing through visual cues long before they have heard an entire idea. The finding offers insight into how the mind uses vision to rapidly process information.

DENVER — By mapping eye movements in fractions of a second, a Brown researcher has found humans attempt to make sense of what they are hearing through visual cues long before they have heard an entire idea. The finding offers insight into how the mind uses vision to rapidly process information.

Related Articles


Julie Sedivy, assistant professor of cognitive and linguistic sciences, will present her research during the annual meeting of the American Association for the Advancement of Science (AAAS) in Denver. Sedivy will participate in a panel discussion, “The Eyes Have It: Eye Movements and the Spoken Language,” Feb. 17, 2003, at 8:30 a.m.

Sedivy is interested in the process by which humans assign meaning to words and phrases. Psycholinguists know that as humans process language they make many split-second decisions about the words they are hearing. But questions remain about how humans cope with uncertainty at every stage of that moment-by-moment decision process.

In a series of studies involving approximately 150 people, participants sat either in front of a computer screen that displayed an image of objects or in front a work surface set with objects and received verbal instructions concerning the objects. Researchers used a headband-mounted camera to map the participants’ eye movements every thirtieth of a second.

Given a scene of a table set with a drinking glass and pitcher, the participants heard instructions such as “pick up the tall glass.” Researchers found that participants frequently looked first at a pitcher in the display, indicating attempts to interpret “tall” early, and prior to hearing the entire noun “glass.”

“On the basis of one or two sounds, we saw the participants’ eye movements begin to shift,” said Sedivy. “As soon as they identified a word, they began to map it.”

However, when a short glass was added to the scene so that there were three objects – a pitcher, tall glass, and short glass – participants were more likely to look at the taller of the drinking glasses when they heard “tall” because size was the distinguishing factor between the two glasses.

The finding suggests that humans consult a whole domain of information, including visual cues and expectations about rational communicative behavior, in resolving the uncertainty involved in processing a sentence, according to Sedivy.

There appears to be a set of mutual expectations between conversational partners, for example, that redundant information is typically avoided. In the example with the pitcher and two drinking glasses, “tall” would be redundant in referring to the pitcher, because there is only one pitcher, while there are two glasses, Sedivy said.

If that type of complex and subtle information were not available, the immediate moment-by-moment mapping of sounds to meaning would only serve to introduce a great deal of uncertainty to language processing, according to Sedivy. For example, if mapping to an object begins upon hearing “tall” rather than waiting until the following word “glass,” given a scene in which there are two tall objects, the chance of an initial mapping guess being correct is only fifty percent.

Not subject to the conscious control by humans, the automatic eye movements are so subtle they are unnoticed by study participants, who may feel simply that their eyes are taking in the whole scene all at once when, in fact, the eyes are darting rapidly from one very specific location to another.

“This is a surprising relationship between highly intelligent processes of language understanding and low-level automatic processes such as eye movements,” Sedivy said. “As humans, we have to deal with multiple levels of information simultaneously, and those different levels of information must be incorporated into the study of linguistics.”

Sedivy conducted the research with Daniel Grodner, a postdoctoral fellow in cognitive and linguistic sciences; Anjula Joshi, research technician; and current and former undergraduate assistants including Charles Joseph, Estelle Reyes, Gitana Chunyo and Rachel Sussman. The work was funded by grants from the National Science Foundation and the National Institutes of Health.


Story Source:

The above story is based on materials provided by Brown University. Note: Materials may be edited for content and length.


Cite This Page:

Brown University. "Eye Movements Indicate Initial Attempts To Process What Humans Hear." ScienceDaily. ScienceDaily, 21 February 2003. <www.sciencedaily.com/releases/2003/02/030221075847.htm>.
Brown University. (2003, February 21). Eye Movements Indicate Initial Attempts To Process What Humans Hear. ScienceDaily. Retrieved January 31, 2015 from www.sciencedaily.com/releases/2003/02/030221075847.htm
Brown University. "Eye Movements Indicate Initial Attempts To Process What Humans Hear." ScienceDaily. www.sciencedaily.com/releases/2003/02/030221075847.htm (accessed January 31, 2015).

Share This


More From ScienceDaily



More Mind & Brain News

Saturday, January 31, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

NFL Concussions Down; Still on Parents' Minds

NFL Concussions Down; Still on Parents' Minds

AP (Jan. 30, 2015) The NFL announced this week that the number of game concussions dropped by a quarter over last season. Still, the dangers of the sport still weigh on players, and parents&apos; minds. (Jan. 30) Video provided by AP
Powered by NewsLook.com
Study Shows Newborn Chicks Count From Left to Right Just Like Humans

Study Shows Newborn Chicks Count From Left to Right Just Like Humans

Buzz60 (Jan. 30, 2015) Researchers for the first time identified human&apos;s innate preference for associating low and high numbers with the left and right respectively in another species. Jen Markham (@jenmarkham) explains. Video provided by Buzz60
Powered by NewsLook.com
Best Mood Elevating, Feel Good Shakes & Smoothies

Best Mood Elevating, Feel Good Shakes & Smoothies

Buzz60 (Jan. 30, 2015) You can elevate your mood by having a meal in a glass. Fitness and nutrition expert John Basedow (@JohnBasedow) offers the best &apos;feel good&apos; smoothies and shakes chock full of depression-relieving ingredients...including apples, berries, lemons, cucumbers, papaya, kiwi, spinach, kale, whey protein, matcha, ginger, turmeric and cinnamon. Video provided by Buzz60
Powered by NewsLook.com
Poll Says Firstborn Is Responsible, Youngest Is Funnier

Poll Says Firstborn Is Responsible, Youngest Is Funnier

Newsy (Jan. 30, 2015) According to a poll out of the U.K., eldest siblings feel more responsible and successful than their younger siblings. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Health & Medicine

Mind & Brain

Living & Well

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins