A tool-free neuronavigation method based on single-view hand tracking

Koegl FV, Leger E, Haouchine N, Torio E, Juvekar P, Navab N, Kapur T, Pieper S, Golby A, Frisken S (2022)

Publication Type: Journal article

Publication year: 2022

Journal

Computer Methods in Biomechanics and Biomedical Engineering : Imaging & Visualization Taylor & Francis

DOI: 10.1080/21681163.2022.2163428

Abstract

This work presents a novel tool-free neuronavigation method that can be used with a single RGB commodity camera. Compared with freehand craniotomy placement methods, the proposed system is more intuitive and less error prone. The proposed method also has several advantages over standard neuronavigation platforms. First, it has a much lower cost, since it does not require the use of an optical tracking camera or electromagnetic field generator, which are typically the most expensive parts of a neuronavigation system, making it much more accessible. Second, it requires minimal setup, meaning that it can be performed at the bedside and in circumstances where using a standard neuronavigation system is impractical. Our system relies on machine-learning-based hand pose estimation that acts as a proxy for optical tool tracking, enabling a 3D-3D pre-operative to intra-operative registration. Qualitative assessment from clinical users showed that the concept is clinically relevant. Quantitative assessment showed that on average a target registration error (TRE) of 1.3 cm can be achieved. Furthermore, the system is framework-agnostic, meaning that future improvements to hand-tracking frameworks would directly translate to a higher accuracy.

Involved external institutions

Brigham and Women's Hospital (BWH) US United States (USA) (US) Technische Universität München (TUM) DE Germany (DE)

How to cite

APA:

Koegl, F.V., Leger, E., Haouchine, N., Torio, E., Juvekar, P., Navab, N.,... Frisken, S. (2022). A tool-free neuronavigation method based on single-view hand tracking. Computer Methods in Biomechanics and Biomedical Engineering : Imaging & Visualization. https://doi.org/10.1080/21681163.2022.2163428

MLA:

Koegl, Fryderyk Victor, et al. "A tool-free neuronavigation method based on single-view hand tracking." Computer Methods in Biomechanics and Biomedical Engineering : Imaging & Visualization (2022).

BibTeX: Download