Featured Research

from universities, journals, and other organizations

Are we there yet? How the brain keeps eyes on the prize

Date:
August 4, 2013
Source:
Massachusetts Institute of Technology
Summary:
Researchers reveal how the brain remains focused on long-term goals. "Are we there yet?" As anyone who has traveled with young children knows, maintaining focus on distant goals can be a challenge. A new study suggests how the brain achieves this task, and indicates that the neurotransmitter dopamine may signal the value of long-term rewards. The findings may also explain why patients with Parkinson's disease -- in which dopamine signaling is impaired -- often have difficulty in sustaining motivation to finish tasks.

"Are we there yet?"

As anyone who has traveled with young children knows, maintaining focus on distant goals can be a challenge. A new study from MIT suggests how the brain achieves this task, and indicates that the neurotransmitter dopamine may signal the value of long-term rewards. The findings may also explain why patients with Parkinson's disease -- in which dopamine signaling is impaired -- often have difficulty in sustaining motivation to finish tasks.

The work is described this week in the journal Nature.

Previous studies have linked dopamine to rewards, and have shown that dopamine neurons show brief bursts of activity when animals receive an unexpected reward. These dopamine signals are believed to be important for reinforcement learning, the process by which an animal learns to perform actions that lead to reward.

Taking the long view

In most studies, that reward has been delivered within a few seconds. In real life, though, gratification is not always immediate: Animals must often travel in search of food, and must maintain motivation for a distant goal while also responding to more immediate cues. The same is true for humans: A driver on a long road trip must remain focused on reaching a final destination while also reacting to traffic, stopping for snacks, and entertaining children in the back seat.

The MIT team, led by Institute Professor Ann Graybiel -- who is also an investigator at MIT's McGovern Institute for Brain Research -- decided to study how dopamine changes during a maze task approximating work for delayed gratification. The researchers trained rats to navigate a maze to reach a reward. During each trial a rat would hear a tone instructing it to turn either right or left at an intersection to find a chocolate milk reward.

Rather than simply measuring the activity of dopamine-containing neurons, the MIT researchers wanted to measure how much dopamine was released in the striatum, a brain structure known to be important in reinforcement learning. They teamed up with Paul Phillips of the University of Washington, who has developed a technology called fast-scan cyclic voltammetry (FSCV) in which tiny, implanted, carbon-fiber electrodes allow continuous measurements of dopamine concentration based on its electrochemical fingerprint.

"We adapted the FSCV method so that we could measure dopamine at up to four different sites in the brain simultaneously, as animals moved freely through the maze," explains first author Mark Howe, a former graduate student with Graybiel who is now a postdoc in the Department of Neurobiology at Northwestern University. "Each probe measures the concentration of extracellular dopamine within a tiny volume of brain tissue, and probably reflects the activity of thousands of nerve terminals."

Gradual increase in dopamine

From previous work, the researchers expected that they might see pulses of dopamine released at different times in the trial, "but in fact we found something much more surprising," Graybiel says: The level of dopamine increased steadily throughout each trial, peaking as the animal approached its goal -- as if in anticipation of a reward.

The rats' behavior varied from trial to trial -- some runs were faster than others, and sometimes the animals would stop briefly -- but the dopamine signal did not vary with running speed or trial duration. Nor did it depend on the probability of getting a reward, something that had been suggested by previous studies.

"Instead, the dopamine signal seems to reflect how far away the rat is from its goal," Graybiel explains. "The closer it gets, the stronger the signal becomes." The researchers also found that the size of the signal was related to the size of the expected reward: When rats were trained to anticipate a larger gulp of chocolate milk, the dopamine signal rose more steeply to a higher final concentration.

In some trials the T-shaped maze was extended to a more complex shape, requiring animals to run further and to make extra turns before reaching a reward. During these trials, the dopamine signal ramped up more gradually, eventually reaching the same level as in the shorter maze. "It's as if the animal were adjusting its expectations, knowing that it had further to go," Graybiel says.

An 'internal guidance system'

"This means that dopamine levels could be used to help an animal make choices on the way to the goal and to estimate the distance to the goal," says Terrence Sejnowski of the Salk Institute, a computational neuroscientist who is familiar with the findings but who was not involved with the study. "This 'internal guidance system' could also be useful for humans, who also have to make choices along the way to what may be a distant goal."

One question that Graybiel hopes to examine in future research is how the signal arises within the brain. Rats and other animals form cognitive maps of their spatial environment, with so-called "place cells" that are active when the animal is in a specific location. "As our rats run the maze repeatedly," she says, "we suspect they learn to associate each point in the maze with its distance from the reward that they experienced on previous runs."

As for the relevance of this research to humans, Graybiel says, "I'd be shocked if something similar were not happening in our own brains." It's known that Parkinson's patients, in whom dopamine signaling is impaired, often appear to be apathetic, and have difficulty in sustaining motivation to complete a long task. "Maybe that's because they can't produce this slow ramping dopamine signal," Graybiel says.

Patrick Tierney at MIT and Stefan Sandberg at the University of Washington also contributed to the study, which was funded by the National Institutes of Health, the National Parkinson Foundation, the CHDI Foundation, the Sydney family and Mark Gorenberg.


Story Source:

The above story is based on materials provided by Massachusetts Institute of Technology. Note: Materials may be edited for content and length.


Journal Reference:

  1. Mark W. Howe, Patrick L. Tierney, Stefan G. Sandberg, Paul E. M. Phillips, Ann M. Graybiel. Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature, 2013; DOI: 10.1038/nature12475

Cite This Page:

Massachusetts Institute of Technology. "Are we there yet? How the brain keeps eyes on the prize." ScienceDaily. ScienceDaily, 4 August 2013. <www.sciencedaily.com/releases/2013/08/130804144505.htm>.
Massachusetts Institute of Technology. (2013, August 4). Are we there yet? How the brain keeps eyes on the prize. ScienceDaily. Retrieved August 1, 2014 from www.sciencedaily.com/releases/2013/08/130804144505.htm
Massachusetts Institute of Technology. "Are we there yet? How the brain keeps eyes on the prize." ScienceDaily. www.sciencedaily.com/releases/2013/08/130804144505.htm (accessed August 1, 2014).

Share This




More Mind & Brain News

Friday, August 1, 2014

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

Google (Kind Of) Complies With 'Right To Be Forgotten Law'

Google (Kind Of) Complies With 'Right To Be Forgotten Law'

Newsy (July 31, 2014) Google says it is following Europe's new "Right To Be Forgotten Law," which eliminates user information upon request, but only to a certain degree. Video provided by Newsy
Powered by NewsLook.com
Stroke Signs: Three Hour Deadline

Stroke Signs: Three Hour Deadline

Ivanhoe (July 31, 2014) Sometimes the signs of a stroke are far from easy to recognize. Learn from one young father’s story on the signs of a stroke. Video provided by Ivanhoe
Powered by NewsLook.com
Grain Brain May Be Harming Us

Grain Brain May Be Harming Us

Ivanhoe (July 31, 2014) Could eating carbohydrates be harmful to our brain health? Find out what one neurologist says about changing our diets. Video provided by Ivanhoe
Powered by NewsLook.com
Playground Tales: Learning to Socialize With Autism

Playground Tales: Learning to Socialize With Autism

Ivanhoe (July 31, 2014) Playgrounds are typically great places where kids can have fun while learning how to interact with other kids, but for some kids with autism, they can have the reverse effect. Hear how researchers are trying to change that. Video provided by Ivanhoe
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:

Breaking News:
from the past week

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile: iPhone Android Web
Follow: Facebook Twitter Google+
Subscribe: RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins