[POSTER] Augmenting mobile C-arm fluoroscopes via stereo-RGBD sensors for multimodal visualization
Habert S, Meng M, Kehl W, Wang X, Tombari F, Fallavollita P, Navab N (2015)
Publication Type: Conference contribution
Publication year: 2015
Publisher: Institute of Electrical and Electronics Engineers Inc.
Pages Range: 72-75
Conference Proceedings Title: Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015
Event location: Fukuoka, JPN
ISBN: 9781467376600
Abstract
Fusing intraoperative X-ray data with real-time video in a common reference frame is not trivial since both modalities have to be acquired from the same viewpoint. The goal of this work is to design a flexible system comprising two RGBD sensors that can be attached to any mobile C-arm, with the objective of synthesizing projective color images from the X-ray source viewpoint. To achieve this, we calibrate the RGBD sensors to the X-ray source with a 3D calibration object. Then, we synthesize the projective color image from the X-ray viewpoint by applying a volumetric-based rendering method. Finally, the X-ray image is overlaid on the projective image without any further registration, offering a multimodal visualization of X-ray and color images. In this paper we present the different steps of development (i.e. hardware setup, calibration and rendering algorithm) and discuss clinical applications for the new video augmented C-arm. By placing X-ray markers on a hand patient and a spine model, we show that the overlay accuracy between the X-ray image and the synthetized image is in average 1.7 mm.
Involved external institutions
Germany (DE)How to cite
APA:
Habert, S., Meng, M., Kehl, W., Wang, X., Tombari, F., Fallavollita, P., & Navab, N. (2015). [POSTER] Augmenting mobile C-arm fluoroscopes via stereo-RGBD sensors for multimodal visualization. In Nobuchika Sakata, Richard Newcombe, Robert Lindeman, Christian Sandor, Walterio Mayol-Cuevas, Veronica Teichrieb (Eds.), Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015 (pp. 72-75). Fukuoka, JPN: Institute of Electrical and Electronics Engineers Inc..
MLA:
Habert, Severine, et al. "[POSTER] Augmenting mobile C-arm fluoroscopes via stereo-RGBD sensors for multimodal visualization." Proceedings of the 14th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2015, Fukuoka, JPN Ed. Nobuchika Sakata, Richard Newcombe, Robert Lindeman, Christian Sandor, Walterio Mayol-Cuevas, Veronica Teichrieb, Institute of Electrical and Electronics Engineers Inc., 2015. 72-75.
BibTeX: Download