Task-based evaluation of deep image super-resolution in medical imaging

Varun A. Kelkar, Xiaohui Zhang, Jason Granstedt, Hua Li, Mark A. Anastasio

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

7 Scopus citations


In medical imaging, it is sometimes desirable to acquire high resolution images that reveal anatomical and physiological information to support clinical practice such as diagnosis and image-guided therapies. However, for certain imaging modalities (i.e., magnetic resonance imaging (MRI)), acquiring high resolution images can be a very time-consuming and resource-intensive process. One popular solution recently developed is to create a high resolution version of the acquired low-resolution image by use of deep image super-resolution (DL-SR) methods. It has been demonstrated in literature that deep super-resolution networks can improve the image quality measured by traditional physical metrics such as mean square error (MSE), structural similarity index metric (SSIM) and peak signal-to-noise ratio (PSNR). However, it is not clear how well these metrics quantify the diagnostic value of the generated SR images. Here, a task-based super-resolution (SR) image quality assessment is conducted to quantitatively evaluate the efficiency and performance of DL-SR methods. A Rayleigh task is designed to investigate the impact of signal length and super-resolution network complexity on s binary detection performance. Numerical observers (NOs) including the regularized Hotelling Observer (RHO), the anthropomorphic Gabor channelized observers (Gabor CHO) and the ResNet-approximated ideal observer (ResNet-IO) are implemented to assess the Rayleigh task performance. For the datasets considered in this study, little to no improvement in task performance of the considered NOs due to the considered DL-SR SR networks, despite substantial improvement in traditional IQ metrics.

Original languageEnglish
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage Perception, Observer Performance, and Technology Assessment
EditorsFrank W. Samuelson, Sian Taylor-Phillips
ISBN (Electronic)9781510640276
StatePublished - 2021
EventMedical Imaging 2021: Image Perception, Observer Performance, and Technology Assessment - Virtual, Online
Duration: Feb 15 2021Feb 19 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceMedical Imaging 2021: Image Perception, Observer Performance, and Technology Assessment
CityVirtual, Online


  • Deep image super-resolution
  • image quality
  • numerical observers
  • Rayleigh detection task
  • task-based evaluation


Dive into the research topics of 'Task-based evaluation of deep image super-resolution in medical imaging'. Together they form a unique fingerprint.

Cite this