A novel MRI segmentation method using CNN-based correction network for MRI-guided adaptive radiotherapy

Yabo Fu, Thomas R. Mazur, Xue Wu, Shi Liu, Xiao Chang, Yonggang Lu, H. Harold Li, Hyun Kim, Michael C. Roach, Lauren Henke, Deshan Yang

Research output: Contribution to journalArticlepeer-review

121 Scopus citations


Purpose: The purpose of this study was to expedite the contouring process for MRI-guided adaptive radiotherapy (MR-IGART), a convolutional neural network (CNN) deep-learning (DL) model is proposed to accurately segment the liver, kidneys, stomach, bowel and duodenum in 3D MR images. Methods: Images and structure contours for 120 patients were collected retrospectively. Treatment sites included pancreas, liver, stomach, adrenal gland, and prostate. The proposed DL model contains a voxel-wise label prediction CNN and a correction network which consists of two sub-networks. The prediction CNN and sub-networks in the correction network each includes a dense block which consists of twelve densely connected convolutional layers. The correction network was designed to improve the voxel-wise labeling accuracy of a CNN by learning and enforcing implicit anatomical constraints in the segmentation process. Its sub-networks learn to fix the erroneous classification of its previous network by taking as input both the original images and the softmax probability maps generated from its previous sub-network. The parameters of each sub-network were trained independently using piecewise training. The model was trained on 100 datasets, validated on 10 datasets and tested on the remaining 10 datasets. Dice coefficient, Hausdorff distance (HD) were calculated to evaluate the segmentation accuracy. Results: The proposed DL model was able to segment the organs with good accuracy. The correction network outperformed the conditional random field (CRF), a most comparable method that is usually applied as a post-processing step. For the 10 testing patients, the average Dice coefficients were 95.3 ± 0.73, 93.1 ± 2.22, 85.0 ± 3.75, 86.6 ± 2.69, and 65.5 ± 8.90 for liver, kidneys, stomach, bowel, and duodenum, respectively. The mean Hausdorff Distance (HD) were 5.41 ± 2.34, 6.23 ± 4.59, 6.88 ± 4.89, 5.90 ± 4.05, and 7.99 ± 6.84 mm, respectively. Manual contouring, as to correct the automatic segmentation results, was four times as fast as manual contouring from scratch. Conclusion: The proposed method can automatically segment the liver, kidneys, stomach, bowel, and duodenum in 3D MR images with good accuracy. It is useful to expedite the manual contouring for MR-IGART.

Original languageEnglish
Pages (from-to)5129-5137
Number of pages9
JournalMedical physics
Issue number11
StatePublished - Nov 2018


  • MRI
  • deep learning
  • image segmentation
  • image-guided radiation therapy


Dive into the research topics of 'A novel MRI segmentation method using CNN-based correction network for MRI-guided adaptive radiotherapy'. Together they form a unique fingerprint.

Cite this