TY - JOUR
T1 - Computational segmentation and classification of diabetic glomerulosclerosis
AU - Ginley, Brandon
AU - Lutnick, Brendon
AU - Jen, Kuang Yu
AU - Fogo, Agnes B.
AU - Jain, Sanjay
AU - Rosenberg, Avi
AU - Walavalkar, Vighnesh
AU - Wilding, Gregory
AU - Tomaszewski, John E.
AU - Yacoub, Rabi
AU - Rossi, Giovanni Maria
AU - Sarder, Pinaki
N1 - Funding Information:
The project was supported by the faculty startup funds from the Jacobs School of Medicine and Biomedical Sciences, University at Buffalo; the Innovative Micro-Programs Accelerating Collaboration in Themes (IMPACT) award; National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) Diabetic Complications Consortium grant DK076169; and NIDDK grant R01 DK114485.
Funding Information:
Prof. Sarder, Dr. Tomaszewski, Mr. Ginley, and Mr. Lutnick report Diabetic Complications Consortium grant DK076169 and grant R01DK114485 from the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), during the conduct of the study. Dr. Tomaszewski reports a grant from Neurovascular Diagnostics Inc. and from Inspirata Inc., outside the submitted work. In addition, Dr. Tomaszewski has a patent (1) “Malignancy Diagnosis Using Content-Based Image Retrieval of Tissue Histopathology,” Anant Madabhushi, Michael D. Feldman, John Tomaszewski, Scott Doyle, International Publication Number: WO 2009/017483 A1 issued; a patent (2) “Systems and Methods for Automated Detection of Cancer,” Anant Madabhushi, Michael D. Feldman, Jianbo Shi, Mark Rosen, John Tomaszewski, United States Serial Number (USSN): 60/852,516 issued; a patent (3) “System and Method for Image Registration,” Anant Madabhushi, Jonathan Chappelow, Mark Rosen, Michael Feldman, John Tomaszewski, USSN: 60/921 issued; and a patent (4) “Computer Assisted Diagnosis (CAD) of cancer using Multi-Functional Multi-Modal in vivo Magnetic Resonance Spectroscopy (MRS) and Imaging (MRI),” by Anant Madabhushi, Satish Viswanath, Pallavi Tiwari, Robert Toth, Mark Rosen, John Tomaszewski, Michael D. Feldman, PCT/US08/81656, Oct 2008 issued.
Publisher Copyright:
© 2019 by the American Society of Nephrology.
PY - 2019
Y1 - 2019
N2 - Background Pathologists use visual classification of glomerular lesions to assess samples from patients with diabetic nephropathy (DN). The results may vary among pathologists. Digital algorithms may reduce this variability and provide more consistent image structure interpretation. Methods We developed a digital pipeline to classify renal biopsies from patients with DN. We combined traditional image analysis with modern machine learning to efficiently capture important structures, minimize manual effort and supervision, and enforce biologic prior information onto our model. To computationally quantify glomerular structure despite its complexity, we simplified it to three components consisting of nuclei, capillary lumina and Bowman spaces; and Periodic Acid-Schiff positive structures.We detected glomerular boundaries and nuclei from whole slide images using convolutional neural networks, and the remaining glomerular structures using an unsupervised technique developed expressly for this purpose. We defined a set of digital features which quantify the structural progression of DN, and a recurrent network architecture which processes these features into a classification. Results Our digital classification agreed with a senior pathologist whose classifications were used as ground truth with moderate Cohen's kappa k = 0.55 and 95% confidence interval [0.50, 0.60]. Two other renal pathologists agreed with the digital classification with k150.68, 95% interval [0.50, 0.86] and k2=0.48, 95%interval [0.32, 0.64]. Our results suggest computational approaches are comparable to human visual classificationmethods, and can offer improved precision in clinical decision workflows. We detected glomerular boundaries from whole slide images with 0.9360.04 balanced accuracy, glomerular nuclei with 0.94 sensitivity and 0.93 specificity, and glomerular structural components with 0.95 sensitivity and 0.99 specificity. Conclusions Computationally derived, histologic image features hold significant diagnostic information that may augment clinical diagnostics.
AB - Background Pathologists use visual classification of glomerular lesions to assess samples from patients with diabetic nephropathy (DN). The results may vary among pathologists. Digital algorithms may reduce this variability and provide more consistent image structure interpretation. Methods We developed a digital pipeline to classify renal biopsies from patients with DN. We combined traditional image analysis with modern machine learning to efficiently capture important structures, minimize manual effort and supervision, and enforce biologic prior information onto our model. To computationally quantify glomerular structure despite its complexity, we simplified it to three components consisting of nuclei, capillary lumina and Bowman spaces; and Periodic Acid-Schiff positive structures.We detected glomerular boundaries and nuclei from whole slide images using convolutional neural networks, and the remaining glomerular structures using an unsupervised technique developed expressly for this purpose. We defined a set of digital features which quantify the structural progression of DN, and a recurrent network architecture which processes these features into a classification. Results Our digital classification agreed with a senior pathologist whose classifications were used as ground truth with moderate Cohen's kappa k = 0.55 and 95% confidence interval [0.50, 0.60]. Two other renal pathologists agreed with the digital classification with k150.68, 95% interval [0.50, 0.86] and k2=0.48, 95%interval [0.32, 0.64]. Our results suggest computational approaches are comparable to human visual classificationmethods, and can offer improved precision in clinical decision workflows. We detected glomerular boundaries from whole slide images with 0.9360.04 balanced accuracy, glomerular nuclei with 0.94 sensitivity and 0.93 specificity, and glomerular structural components with 0.95 sensitivity and 0.99 specificity. Conclusions Computationally derived, histologic image features hold significant diagnostic information that may augment clinical diagnostics.
UR - http://www.scopus.com/inward/record.url?scp=85072791378&partnerID=8YFLogxK
U2 - 10.1681/ASN.2018121259
DO - 10.1681/ASN.2018121259
M3 - Article
C2 - 31488606
AN - SCOPUS:85072791378
SN - 1046-6673
VL - 30
SP - 1953
EP - 1967
JO - Journal of the American Society of Nephrology
JF - Journal of the American Society of Nephrology
IS - 10
ER -