TY - JOUR
T1 - Using Computational Modeling to Capture Schizophrenia-Specific Reinforcement Learning Differences and Their Implications on Patient Classification
AU - Geana, Andra
AU - Barch, Deanna M.
AU - Gold, James M.
AU - Carter, Cameron S.
AU - MacDonald, Angus W.
AU - Ragland, J. Daniel
AU - Silverstein, Steven M.
AU - Frank, Michael J.
N1 - Publisher Copyright:
© 2021 Society of Biological Psychiatry
PY - 2022/10
Y1 - 2022/10
N2 - Background: Psychiatric diagnosis and treatment have historically taken a symptom-based approach, with less attention on identifying underlying symptom-producing mechanisms. Recent efforts have illuminated the extent to which different underlying circuitry can produce phenotypically similar symptomatology (e.g., psychosis in bipolar disorder vs. schizophrenia). Computational modeling makes it possible to identify and mathematically differentiate behaviorally unobservable, specific reinforcement learning differences in patients with schizophrenia versus other disorders, likely owing to a higher reliance on prediction error–driven learning associated with basal ganglia and underreliance on explicit value representations associated with orbitofrontal cortex. Methods: We used a well-established probabilistic reinforcement learning task to replicate those findings in individuals with schizophrenia both on (n = 120) and off (n = 44) antipsychotic medications and included a patient comparison group of bipolar patients with psychosis (n = 60) and healthy control subjects (n = 72). Results: Using accuracy, there was a main effect of group (F3,279 = 7.87, p < .001), such that all patient groups were less accurate than control subjects. Using computationally derived parameters, both medicated and unmediated individuals with schizophrenia, but not patients with bipolar disorder, demonstrated a reduced mixing parameter (F3,295 = 13.91, p < .001), indicating less dependence on learning explicit value representations as well as greater learning decay between training and test (F1,289 = 12.81, p < .001). Unmedicated patients with schizophrenia also showed greater decision noise (F3,295 = 2.67, p = .04). Conclusions: Both medicated and unmedicated patients showed overreliance on prediction error–driven learning as well as significantly higher noise and value-related memory decay, compared with the healthy control subjects and the patients with bipolar disorder. Additionally, the computational model parameters capturing these processes can significantly improve patient/control classification, potentially providing useful diagnosis insight.
AB - Background: Psychiatric diagnosis and treatment have historically taken a symptom-based approach, with less attention on identifying underlying symptom-producing mechanisms. Recent efforts have illuminated the extent to which different underlying circuitry can produce phenotypically similar symptomatology (e.g., psychosis in bipolar disorder vs. schizophrenia). Computational modeling makes it possible to identify and mathematically differentiate behaviorally unobservable, specific reinforcement learning differences in patients with schizophrenia versus other disorders, likely owing to a higher reliance on prediction error–driven learning associated with basal ganglia and underreliance on explicit value representations associated with orbitofrontal cortex. Methods: We used a well-established probabilistic reinforcement learning task to replicate those findings in individuals with schizophrenia both on (n = 120) and off (n = 44) antipsychotic medications and included a patient comparison group of bipolar patients with psychosis (n = 60) and healthy control subjects (n = 72). Results: Using accuracy, there was a main effect of group (F3,279 = 7.87, p < .001), such that all patient groups were less accurate than control subjects. Using computationally derived parameters, both medicated and unmediated individuals with schizophrenia, but not patients with bipolar disorder, demonstrated a reduced mixing parameter (F3,295 = 13.91, p < .001), indicating less dependence on learning explicit value representations as well as greater learning decay between training and test (F1,289 = 12.81, p < .001). Unmedicated patients with schizophrenia also showed greater decision noise (F3,295 = 2.67, p = .04). Conclusions: Both medicated and unmedicated patients showed overreliance on prediction error–driven learning as well as significantly higher noise and value-related memory decay, compared with the healthy control subjects and the patients with bipolar disorder. Additionally, the computational model parameters capturing these processes can significantly improve patient/control classification, potentially providing useful diagnosis insight.
KW - Classification
KW - Computational psychiatry
KW - Modeling
KW - Reinforcement learning
KW - Schizophrenia
UR - http://www.scopus.com/inward/record.url?scp=85111256004&partnerID=8YFLogxK
U2 - 10.1016/j.bpsc.2021.03.017
DO - 10.1016/j.bpsc.2021.03.017
M3 - Article
C2 - 33878489
AN - SCOPUS:85111256004
SN - 2451-9022
VL - 7
SP - 1035
EP - 1046
JO - Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
JF - Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
IS - 10
ER -