TY - JOUR
T1 - Individual differences in reinforcement learning
T2 - Behavioral, electrophysiological, and neuroimaging correlates
AU - Santesso, Diane L.
AU - Dillon, Daniel G.
AU - Birk, Jeffrey L.
AU - Holmes, Avram J.
AU - Goetz, Elena
AU - Bogdan, Ryan
AU - Pizzagalli, Diego A.
N1 - Funding Information:
This work was supported by NIH grants (NIMH R01 MH68376 and NCCAM R21 AT002974) awarded to DAP. The authors would like to thank Allison Jahn, Kyle Ratner, and James O'Shea for their contribution at early stages of this research, to Decklin Foster for technical support, and to Nancy Brooks and Christen Deveney for their role in the recruitment of this sample.
PY - 2008/8/15
Y1 - 2008/8/15
N2 - During reinforcement learning, phasic modulations of activity in midbrain dopamine neurons are conveyed to the dorsal anterior cingulate cortex (dACC) and basal ganglia (BG) and serve to guide adaptive responding. While the animal literature supports a role for the dACC in integrating reward history over time, most human electrophysiological studies of dACC function have focused on responses to single positive and negative outcomes. The present electrophysiological study investigated the role of the dACC in probabilistic reward learning in healthy subjects using a task that required integration of reinforcement history over time. We recorded the feedback-related negativity (FRN) to reward feedback in subjects who developed a response bias toward a more frequently rewarded ("rich") stimulus ("learners") versus subjects who did not ("non-learners"). Compared to non-learners, learners showed more positive (i.e., smaller) FRNs and greater dACC activation upon receiving reward for correct identification of the rich stimulus. In addition, dACC activation and a bias to select the rich stimulus were positively correlated. The same participants also completed a monetary incentive delay (MID) task administered during functional magnetic resonance imaging. Compared to non-learners, learners displayed stronger BG responses to reward in the MID task. These findings raise the possibility that learners in the probabilistic reinforcement task were characterized by stronger dACC and BG responses to rewarding outcomes. Furthermore, these results highlight the importance of the dACC to probabilistic reward learning in humans.
AB - During reinforcement learning, phasic modulations of activity in midbrain dopamine neurons are conveyed to the dorsal anterior cingulate cortex (dACC) and basal ganglia (BG) and serve to guide adaptive responding. While the animal literature supports a role for the dACC in integrating reward history over time, most human electrophysiological studies of dACC function have focused on responses to single positive and negative outcomes. The present electrophysiological study investigated the role of the dACC in probabilistic reward learning in healthy subjects using a task that required integration of reinforcement history over time. We recorded the feedback-related negativity (FRN) to reward feedback in subjects who developed a response bias toward a more frequently rewarded ("rich") stimulus ("learners") versus subjects who did not ("non-learners"). Compared to non-learners, learners showed more positive (i.e., smaller) FRNs and greater dACC activation upon receiving reward for correct identification of the rich stimulus. In addition, dACC activation and a bias to select the rich stimulus were positively correlated. The same participants also completed a monetary incentive delay (MID) task administered during functional magnetic resonance imaging. Compared to non-learners, learners displayed stronger BG responses to reward in the MID task. These findings raise the possibility that learners in the probabilistic reinforcement task were characterized by stronger dACC and BG responses to rewarding outcomes. Furthermore, these results highlight the importance of the dACC to probabilistic reward learning in humans.
KW - Anterior cingulate cortex
KW - Basal ganglia
KW - Feedback-related negativity
KW - Probabilistic learning
KW - Reinforcement learning
KW - Reward
UR - http://www.scopus.com/inward/record.url?scp=48049092007&partnerID=8YFLogxK
U2 - 10.1016/j.neuroimage.2008.05.032
DO - 10.1016/j.neuroimage.2008.05.032
M3 - Article
C2 - 18595740
AN - SCOPUS:48049092007
SN - 1053-8119
VL - 42
SP - 807
EP - 816
JO - NeuroImage
JF - NeuroImage
IS - 2
ER -