TY - JOUR
T1 - Incentives Boost Model-Based Control Across a Range of Severity on Several Psychiatric Constructs
AU - Patzelt, Edward H.
AU - Kool, Wouter
AU - Millner, Alexander J.
AU - Gershman, Samuel J.
N1 - Publisher Copyright:
© 2018 Society of Biological Psychiatry
PY - 2019/3/1
Y1 - 2019/3/1
N2 - Background: Human decision making exhibits a mixture of model-based and model-free control. Recent evidence indicates that arbitration between these two modes of control (“metacontrol”) is based on their relative costs and benefits. While model-based control may increase accuracy, it requires greater computational resources, so people invoke model-based control only when potential rewards exceed those of model-free control. We used a sequential decision task, while concurrently manipulating performance incentives, to ask if symptoms and traits of psychopathology decrease or increase model-based control in response to incentives. Methods: We recruited a nonpatient population of 839 online participants using Amazon Mechanical Turk who completed transdiagnostic self-report measures encompassing symptoms, traits, and factors. We fit a dual-controller reinforcement learning model and obtained a computational measure of model-based control separately for small incentives and large incentives. Results: None of the constructs were related to a failure of large incentives to boost model-based control. In fact, for the sensation seeking trait and anxious-depression factor, higher scores were associated with a larger incentive effect, whereby greater levels of these constructs were associated with larger increases in model-based control. Many constructs showed decreases in model-based control as a function of severity, but a social withdrawal factor was positively correlated; alcohol use and social anxiety were unrelated to model-based control. Conclusions: Our results demonstrate that model-based control can reliably be improved independent of construct severity for most measures. This suggests that incentives may be a useful intervention for boosting model-based control across a range of symptom and trait severity.
AB - Background: Human decision making exhibits a mixture of model-based and model-free control. Recent evidence indicates that arbitration between these two modes of control (“metacontrol”) is based on their relative costs and benefits. While model-based control may increase accuracy, it requires greater computational resources, so people invoke model-based control only when potential rewards exceed those of model-free control. We used a sequential decision task, while concurrently manipulating performance incentives, to ask if symptoms and traits of psychopathology decrease or increase model-based control in response to incentives. Methods: We recruited a nonpatient population of 839 online participants using Amazon Mechanical Turk who completed transdiagnostic self-report measures encompassing symptoms, traits, and factors. We fit a dual-controller reinforcement learning model and obtained a computational measure of model-based control separately for small incentives and large incentives. Results: None of the constructs were related to a failure of large incentives to boost model-based control. In fact, for the sensation seeking trait and anxious-depression factor, higher scores were associated with a larger incentive effect, whereby greater levels of these constructs were associated with larger increases in model-based control. Many constructs showed decreases in model-based control as a function of severity, but a social withdrawal factor was positively correlated; alcohol use and social anxiety were unrelated to model-based control. Conclusions: Our results demonstrate that model-based control can reliably be improved independent of construct severity for most measures. This suggests that incentives may be a useful intervention for boosting model-based control across a range of symptom and trait severity.
KW - Computational psychiatry
KW - Habits and goals
KW - Incentives
KW - Model-based control
KW - Psychiatric constructs
KW - Reinforcement learning
UR - https://www.scopus.com/pages/publications/85050803247
U2 - 10.1016/j.biopsych.2018.06.018
DO - 10.1016/j.biopsych.2018.06.018
M3 - Article
C2 - 30077331
AN - SCOPUS:85050803247
SN - 0006-3223
VL - 85
SP - 425
EP - 433
JO - Biological Psychiatry
JF - Biological Psychiatry
IS - 5
ER -