Development of a mixed reality platform for lateral skull base anatomy

Jonathan L. McJunkin, Pawina Jiramongkolchai, Woenho Chung, Michael Southworth, Nedim Durakovic, Craig A. Buchman, Jonathan R. Silva

Research output: Contribution to journalArticle

12 Scopus citations

Abstract

Objectives: A mixed reality (MR) headset that enables three-dimensional (3D) visualization of interactive holograms anchored to specific points in physical space was developed for use with lateral skull base anatomy. The objectives of this study are to: 1) develop an augmented reality platform using the headset for visualization of temporal bone structures, and 2) measure the accuracy of the platform as an image guidance system. Methods: A combination of semiautomatic and manual segmentation was used to generate 3D reconstructions of soft tissue and bony anatomy of cadaver heads and temporal bones from 2D computed tomography images. A Mixed-Reality platform was developed using C# programming to generate interactive 3D holograms that could be displayed in the HoloLens headset. Accuracy of visual surface registration was determined by target registration error between seven predefined points on a 3D holographic skull and 3D printed model. Results: Interactive 3D holograms of soft tissue, bony anatomy, and internal ear structures of cadaveric models were generated and visualized in the MR headset. Software user interface was developed to allow for user control of the virtual images through gaze, voice, and gesture commands. Visual surface point matching registration was used to align and anchor holograms to physical objects. The average target registration error of our system was 5.76 mm ± 0.54. Conclusion: In this article, we demonstrate that an MR headset can be applied to display interactive 3D anatomic structures of the temporal bone that can be overlaid on physical models. This technology has the potential to be used as an image guidance tool during anatomic dissection and lateral skull base surgery.

Original languageEnglish
Pages (from-to)e1137-e1142
JournalOtology and Neurotology
Volume39
Issue number10
DOIs
StatePublished - Jan 1 2018

Keywords

  • Augmented reality
  • Hololens
  • Image-guided surgery
  • Mixed reality
  • Temporal bone
  • Virtual reality

Fingerprint Dive into the research topics of 'Development of a mixed reality platform for lateral skull base anatomy'. Together they form a unique fingerprint.

  • Cite this