Massachusetts Institute of Technology
Sign in | Create Account

Monitoring Dopamine Release During Reward Learning

05/07/2009 3:30 PM 46"3002
Paul Phillips, University of Washington, Seattle

Description: In the process of learning, we "sometimes make more deliberative choices, and sometimes make more visceral ones," says Paul Phillips. These are "semantic terms we intuitively know," and scientists have become well"versed in creating tasks for animals and humans that demonstrate how these different kinds of learning (analytical" reflective vs. impulsive "reflexive) play out. Phillips has been trying to track dopamine release (a neurotransmitter linked to learning) in such divergent learning processes.

The model"based learning system pairs a stimulus with a reward, and after training, a subject creates a "model representation of the world" that allows it to predict the appearance of the reward after the stimulus. In contrast, the model"free system of learning "uses a one dimensional value that gets updated" as the subject accumulates experience and begins to weigh the difference between expectation and the reward that's actually delivered.

One of Phillips' studies involved implanting electrodes for measuring dopamine release in the striatum of rats participating in different types of learning tasks. Phillips work shows time"dependent changes in the release of dopamine during classic conditioning tasks. At first the dopamine spikes only after the reward, but over time, the animal learns it will receive the reward after the stimulus (a light cue), and soon, the cue alone elicits the dopamine response. Phillips has also found that two distinct parts of the striatum register increased dopamine at different points in the training. "This is quite interesting in terms of thinking about what these brain regions have been implicated in, and specifically the idea of habits in the dorsal striatum."



The results of some research suggest that during these learning processes, all the dopamine neurons should be firing. But Phillips says this doesn't explain why "we're getting signals in (one) part of the brain but not in the other." Phillips speculates that dopamine's "arch nemesis acetylcholine" might be inhibiting dopamine release in certain parts of the striatum during specific phases of reinforcement learning.

Phillips has also been working with selectively bred lines of rats, which seem to exhibit behaviors, and dopamine release patterns, suggestive of two distinct learning strategies. He concludes that "associations between stimuli and rewards can be learned through multiple strategies with different computational demands," and he doesn't believe that animals "are locked into one strategy or another."

About the Speaker(s): Paul E.M. Phillips graduated in Physiology from the University of Liverpool in 1993. He then joined the Neurotransmission Research Group in the Academic Department of Anaesthesia and Intensive Care at St Bartholomew's and the Royal London School of Medicine and Dentistry (University of London) where he completed his Ph.D. in Neuroscience. In 1999 he moved to the University of North Carolina at Chapel Hill to take up a postdoctoral position in the Department of Chemistry. In 2003, he was appointed to Research Assistant Professor in that department. Phillips joined the faculty at the University of Washington in 2004.

Host(s): School of Science, McGovern Institute for Brain Research at MIT

Comments (0)

It looks like no one has posted a comment yet. You can be the first!

You need to log in, in order to post comments. If you don’t have an account yet, sign up now!

MIT World — special events and lectures

MIT World — special events and lectures

Category: Events | Updated over 2 years ago

Created
December 19, 2011 13:28
Category
Tags
License
All Rights Reserved (What is this?)
Additional Files


Viewed
2505 times

More from MIT World — special events and lectures

Forecasting Markets: The Capital Update for 2005

Forecasting Markets: The Capital Up...

Added over 2 years ago | 01:28:00 | 1354 views

20"Ton Canaries: The Great Whales of the North Atlantic  (panel)

20"Ton Canaries: The Great Whales o...

Added over 2 years ago | 01:06:00 | 2736 views

Physical Sciences and Engineering

Physical Sciences and Engineering

Added over 2 years ago | 00:56:49 | 1627 views

The Power of the Network to Change the Way We Work, Live, Play, and Learn

The Power of the Network to Change ...

Added over 2 years ago | 01:03:00 | 1871 views

Housing the Lowest Income Americans: The Past, Present and Future of Public Housing

Housing the Lowest Income Americans...

Added over 2 years ago | 00:43:58 | 1437 views

The Last Time I Saw Bali

The Last Time I Saw Bali

Added over 2 years ago | 01:20:00 | 1689 views