How a surgeon becomes superman by visualization of intelligently fused multi-modalities

Erat O, Pauly O, Weidert S, Thaller P, Euler E, Mutschler W, Navab N, Fallavollita P (2013)


Publication Type: Conference contribution

Publication year: 2013

Journal

Book Volume: 8671

Conference Proceedings Title: Proceedings of SPIE - The International Society for Optical Engineering

Event location: USA

ISBN: 9780819494450

DOI: 10.1117/12.2006766

Abstract

Motivation: The existing visualization of the Camera augmented mobile C-arm (CamC) system does not have enough cues for depth information and presents the anatomical information in a confusing way to surgeons. Methods: We propose a method that segments anatomical information from X-ray and then augment it on the video images. To provide depth cues, pixels belonging to video images are classified as skin and object classes. The augmentation of anatomical information from X-ray is performed only when pixels have a larger probability of belonging to skin class. Results: We tested our algorithm by displaying the new visualization to 2 expert surgeons and 1 medical student during three surgical workflow sequences of the interlocking of intramedullary nail procedure, namely: skin incision, center punching, and drilling. Via a survey questionnaire, they were asked to assess the new visualization when compared to the current alphablending overlay image displayed by CamC. The participants all agreed (100%) that occlusion and instrument tip position detection were immediately improved with our technique. When asked if our visualization has potential to replace the existing alpha-blending overlay during interlocking procedures, all participants did not hesitate to suggest an immediate integration of the visualization for the correct navigation and guidance of the procedure. Conclusion: Current alpha blending visualizations lack proper depth cues and can be a source of confusion for the surgeons when performing surgery. Our visualization concept shows great potential in alleviating occlusion and facilitating clinician understanding during specific workflow steps of the intramedullary nailing procedure. © 2013 SPIE.

Involved external institutions

How to cite

APA:

Erat, O., Pauly, O., Weidert, S., Thaller, P., Euler, E., Mutschler, W.,... Fallavollita, P. (2013). How a surgeon becomes superman by visualization of intelligently fused multi-modalities. In Proceedings of SPIE - The International Society for Optical Engineering. USA.

MLA:

Erat, Okan, et al. "How a surgeon becomes superman by visualization of intelligently fused multi-modalities." Proceedings of the Medical Imaging 2013: Image-Guided Procedures, Robotic Interventions, and Modeling, USA 2013.

BibTeX: Download