Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups

Research output: Contribution to journalArticlepeer-review

64 Scopus citations

Abstract

This article studies the problem of measuring and estimating the diagnostic accuracy when there are three ordinal diagnostic groups. We use a receiver operating characteristic (ROC) surface to describe the probabilities of correct classifications into three diagnostic groups based on various sets of diagnostic thresholds of a test and propose to use the entire and the partial volume under the surface to measure the diagnostic accuracy. Mathematical properties and probabilistic interpretations of the proposed measure of diagnostic accuracy are discussed. Under the assumption of normal distributions of the diagnostic test from three diagnostic groups, we present the maximum likelihood estimate to the volume under the ROC surface and give the asymptotic variance to the estimate. We further propose several asymptotic confidence interval estimates to the volume under the ROC surface. The performance of these confidence interval estimates is evaluated in terms of attaining the nominal coverage probability based on a simulation study. In addition, we develop a method of sample size determination to achieve an adequate accuracy of the confidence interval estimate. Finally, we demonstrate the proposed methodology by applying it to the clinical diagnosis of early stage Alzheimer's disease based on the neuropsychological database of the Washington University Alzheimer's Disease Research Center.

Original languageEnglish
Pages (from-to)1251-1273
Number of pages23
JournalStatistics in medicine
Volume25
Issue number7
DOIs
StatePublished - Apr 15 2006

Keywords

  • Alzheimer's disease (AD)
  • Confidence interval estimate
  • Diagnostic accuracy
  • Maximum likelihood estimate
  • Partial volume under a ROC surface
  • Z-transformation

Fingerprint Dive into the research topics of 'Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups'. Together they form a unique fingerprint.

Cite this