Mixed Reality Support for Orthopaedic Surgery

Lee SC, Fuerst B, Fotouhi J, Johnson A, Tateno K, Tombari F, Osgood G, Navab N (2017)

Publication Type: Conference contribution

Publication year: 2017

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 204-205

Conference Proceedings Title: Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017

Event location: Nantes, FRA

ISBN: 9780769563275

DOI: 10.1109/ISMAR-Adjunct.2017.67

Abstract

This work presents a mixed reality environment for orthopaedic interventions that provides a 3D overlay of Cone-beam CT images, surgical site, and real-time tool tracking. The system uses an RGBD camera attached to the detector plane of a mobile C-arm, which is a typical device to acquire X-Ray images during surgery. Calibration of the two devices is done by acquiring simultaneous CBCT and RGBD scans of a calibration phantom and computing the rigid transformation between them. The markerless tracking of the surgical tool is computed in the RGBD view using real-time segmentation and Simultaneous Localization And Mapping. The RGBD view is then overlaid to the CBCT data with real-time point clouds of the surgical site. This visualization provides multiple desired views of the medical data, surgical site, and the tracking of surgical tools, which could be used to provide intuitive visualization for orthopedic procedures to place instrumentation and to assist surgeons with their localization and coordination. Our proposed opto-X-ray system can lead to x-ray radiation dose reduction as well as improved safety in minimally invasive orthopaedic procedures.

Involved external institutions

Johns Hopkins University (JHU) US United States (USA) (US) Johns Hopkins Hospital US United States (USA) (US) Technische Universität München (TUM) DE Germany (DE)

How to cite

APA:

Lee, S.C., Fuerst, B., Fotouhi, J., Johnson, A., Tateno, K., Tombari, F.,... Navab, N. (2017). Mixed Reality Support for Orthopaedic Surgery. In Wolfgang Broll, Holger Regenbrecht, Gerd Bruder, Myriam Servieres, Maki Sugimoto, J Edward Swan (Eds.), Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017 (pp. 204-205). Nantes, FRA: Institute of Electrical and Electronics Engineers Inc..

MLA:

Lee, Sing Chun, et al. "Mixed Reality Support for Orthopaedic Surgery." Proceedings of the 16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017, Nantes, FRA Ed. Wolfgang Broll, Holger Regenbrecht, Gerd Bruder, Myriam Servieres, Maki Sugimoto, J Edward Swan, Institute of Electrical and Electronics Engineers Inc., 2017. 204-205.

BibTeX: Download