Featured Research

from universities, journals, and other organizations

Neuroscientists reveal how the brain learns to recognize objects

Date:
September 22, 2010
Source:
Massachusetts Institute of Technology
Summary:
Understanding how the brain recognizes objects is a central challenge for understanding human vision, and for designing artificial vision systems. (No computer system comes close to human vision.) A new study by neuroscientists suggests that the brain learns to solve the problem of object recognition through its vast experience in the natural world.

Neurons in the inferior temporal cortex (IT) confuse the identity of two different objects (in this case, a BMW Z3 and a Volkswagen Beetle) after repeated exposure to the two objects in rapid succession.
Credit: Image courtesy of James DiCarlo

Understanding how the brain recognizes objects is a central challenge for understanding human vision, and for designing artificial vision systems. (No computer system comes close to human vision.) A new study by MIT neuroscientists suggests that the brain learns to solve the problem of object recognition through its vast experience in the natural world.

Related Articles


Take for example, a dog. It may be sitting nearby or far away or standing in sunshine or shadow. Although each variation in the dog's position, pose or illumination produces a different pattern of light on the retina, we still recognize it as a dog.

One possible way to acquire this ability to recognize an object, despite these variations, is through a simple form of learning. Objects in the real world usually don't suddenly change their identity, so any two patterns appearing on the retina in rapid succession likely arise from the same object. Any difference between the two patterns probably means the object has changed its position rather than having been replaced by another object. So by simply learning to associate images that appear in rapid succession, the brain might learn to recognize objects even if viewed from different angles, distances, or lighting conditions.

To test this idea, called "temporal contiguity," graduate student Nuo Li and associate professor James DiCarlo at MIT's McGovern Institute for Brain Research "tricked" monkeys by exposing them to an altered visual world in which the normal rules of temporal contiguity did not apply. They recorded electrical activity from individual neurons in a region of the monkey brain called the inferior temporal cortex (IT), where object recognition is thought to happen. IT neurons respond selectively to particular objects; a neuron might, for example, fire more strongly in response to images of a Dalmatian than to pictures a rhinoceros, regardless of its size or position on the retina.

In the new study, which appears in the Sept. 23 issue of Neuron, monkeys observed an object on a computer screen as the object became larger or smaller, as though it were approaching or receding from view. But in some cases, the researchers replaced an object with another as it changed in size. For example, as a Dalmatian became larger on the screen, it suddenly transformed into a rhinoceros.

"We know that IT neurons are involved in object recognition, so our prediction was that these neurons would become confused," explains Li. "By exposing them to this artificial visual experience, we undermined the regularities that we hypothesized teach neurons to recognize the object at multiple sizes."

After a few hours, each IT neuron did indeed become confused. For example, a neuron that preferred a dog over a rhino (regardless of size) began to lose this preference specifically among large dogs and large rhinos (the size at which the temporal contiguity rules had been broken by the researchers). In some cases, the object preferences even started to reverse, and the neuron would begin to prefer large rhinos over large dogs. In other words, the altered visual experience was not merely degrading existing patterns of selectivity but also creating new ones. The new results offered the strongest support yet for the "temporal contiguity" hypothesis of object representation.

"Our monkeys saw only a few hundred examples of these altered visual stimuli during the experiment," says DiCarlo. "If we extrapolate to a lifetime of visual experience, we think this effect is a major contributor to object constancy."

In earlier work, Li and DiCarlo had shown a similar effect when object identities were switched during eye movements. "But we couldn't tell whether that result was peculiar to eye movements -- for example, you don't need eye movements to observe a large image of a car changing into a small image of the same car," says DiCarlo. "Our new results strongly suggest that this is a general mechanism for learning about object identity across a wide range of real-world conditions."

The researchers did not measure the monkeys' behavior during the new study, so it is not known whether the monkeys themselves become confused by the altered visual experience. But similar effects have been seen in human studies, and it seems likely that the changing pattern of neural activity would lead to changes in perceptual judgments. DiCarlo and colleagues plan to test this in future studies.

Funding was provided by the McGovern Institute for Brain Research at MIT, McKnight Endowment Fund for Neuroscience, and NIH.


Story Source:

The above story is based on materials provided by Massachusetts Institute of Technology. Note: Materials may be edited for content and length.


Journal Reference:

  1. Nuo Li, James J. DiCarlo. Unsupervised natural visual experience rapidly reshapes size invariant object representation in inferior temporal cortex. Neuron, 2010; 67 (6): 1062-1075 DOI: 10.1016/j.neuron.2010.08.029

Cite This Page:

Massachusetts Institute of Technology. "Neuroscientists reveal how the brain learns to recognize objects." ScienceDaily. ScienceDaily, 22 September 2010. <www.sciencedaily.com/releases/2010/09/100922121937.htm>.
Massachusetts Institute of Technology. (2010, September 22). Neuroscientists reveal how the brain learns to recognize objects. ScienceDaily. Retrieved December 19, 2014 from www.sciencedaily.com/releases/2010/09/100922121937.htm
Massachusetts Institute of Technology. "Neuroscientists reveal how the brain learns to recognize objects." ScienceDaily. www.sciencedaily.com/releases/2010/09/100922121937.htm (accessed December 19, 2014).

Share This


More From ScienceDaily



More Computers & Math News

Friday, December 19, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Building Google Into Cars

Building Google Into Cars

Reuters - Business Video Online (Dec. 19, 2014) Google's next Android version could become the standard that'll power your vehicle's entertainment and navigation features, Reuters has learned. Fred Katayama reports. Video provided by Reuters
Powered by NewsLook.com
After Sony Hack, What's Next?

After Sony Hack, What's Next?

Reuters - US Online Video (Dec. 19, 2014) The hacking attack on Sony Pictures has U.S. government officials weighing their response to the cyber-attack. Linda So reports. Video provided by Reuters
Powered by NewsLook.com
Navy Unveils Robot Fish

Navy Unveils Robot Fish

Reuters - Light News Video Online (Dec. 18, 2014) The U.S. Navy unveils an underwater device that mimics the movement of a fish. Tara Cleary reports. Video provided by Reuters
Powered by NewsLook.com
How 2014 Shaped The Future Of The Internet

How 2014 Shaped The Future Of The Internet

Newsy (Dec. 18, 2014) It has been a long, busy year for Net Neutrality. The stage is set for an expected landmark FCC decision sometime in 2015. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:

Strange & Offbeat Stories


Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins