TY - JOUR
T1 - Recognition Receiver Operating Characteristic Asymmetry
T2 - Increased Noise or Information?
AU - Dobbins, Ian G.
N1 - Publisher Copyright:
© 2023 American Psychological Association
PY - 2023
Y1 - 2023
N2 - The recognition memory receiver operating characteristic (ROC) is typically asymmetric with a characteristic elevation of the left-hand portion. Whereas the unequal variance signal detection model (uvsd) assumes the asymmetry results because old item evidence is noisier than new item evidence, the dual process signal detection model (dpsd) assumes it results because old items convey more useful information than new items. To test these assumptions, the models were fit to old/new recognition data and their evidence parameters were used to predict performance on a novelty, three-alternative forced-choice (N3AFC) recognition task. Critically, under the uvsd model, increased old item variance (sigma) predicts poorer N3AFC performance, whereas under the dpsd model, increased recollection rates (Ro) predict better N3AFC performance. Hence, the asymmetry parameters of the two models make divergent predictions. In two experiments the dpsd model’s predictions were supported, whereas the uvsd model yielded unpredicted (from that model’s perspective) patterns. Through simulation it was also shown that the dpsd model predicted the uvsd model’s mispredictions, which resulted because increases in old item noise markedly depress the upper portion of the ROC. Overall, the data demonstrate that increasing ROC asymmetry is not a function of increasingly noisier target evidence, but instead increasingly informative target evidence. These findings invalidate the uvsd model, which heretofore has been primarily supported by its post-hoc fitting ability, not its construct validity.
AB - The recognition memory receiver operating characteristic (ROC) is typically asymmetric with a characteristic elevation of the left-hand portion. Whereas the unequal variance signal detection model (uvsd) assumes the asymmetry results because old item evidence is noisier than new item evidence, the dual process signal detection model (dpsd) assumes it results because old items convey more useful information than new items. To test these assumptions, the models were fit to old/new recognition data and their evidence parameters were used to predict performance on a novelty, three-alternative forced-choice (N3AFC) recognition task. Critically, under the uvsd model, increased old item variance (sigma) predicts poorer N3AFC performance, whereas under the dpsd model, increased recollection rates (Ro) predict better N3AFC performance. Hence, the asymmetry parameters of the two models make divergent predictions. In two experiments the dpsd model’s predictions were supported, whereas the uvsd model yielded unpredicted (from that model’s perspective) patterns. Through simulation it was also shown that the dpsd model predicted the uvsd model’s mispredictions, which resulted because increases in old item noise markedly depress the upper portion of the ROC. Overall, the data demonstrate that increasing ROC asymmetry is not a function of increasingly noisier target evidence, but instead increasingly informative target evidence. These findings invalidate the uvsd model, which heretofore has been primarily supported by its post-hoc fitting ability, not its construct validity.
KW - confidence
KW - dual process
KW - receiver operating characteristic
KW - recognition
KW - signal detection
UR - http://www.scopus.com/inward/record.url?scp=85151315970&partnerID=8YFLogxK
U2 - 10.1037/xlm0001224
DO - 10.1037/xlm0001224
M3 - Article
C2 - 36996188
AN - SCOPUS:85151315970
SN - 0278-7393
VL - 49
SP - 216
EP - 229
JO - Journal of Experimental Psychology: Learning Memory and Cognition
JF - Journal of Experimental Psychology: Learning Memory and Cognition
IS - 2
ER -