Neural Radiance Fields for 3D Reconstruction in Monoscopic Laryngeal Endoscopy

Lojo Rodríguez MB, Lopes Borges G, López-Brea García M, Schützenberger A, Kist A (2024)

Publication Language: English

Publication Type: Conference contribution

Publication year: 2024

Publisher: Institute of Electrical and Electronics Engineers, Inc.

Conference Proceedings Title: 2024 IEEE International Symposium on Biomedical Imaging (ISBI)

Event location: Athen GR

ISBN: 979-8-3503-1333-8

DOI: 10.1109/ISBI56570.2024.10635332

Abstract

We explore Neural Radiance Fields (NeRFs) for 3D reconstruction in monoscopic laryngeal endoscopy. Integrating 3D imaging technology is important in otorhinolaryngology where complex anatomical variations often demand precise and personalized surgical interventions. However, the intricate nature of the vocal tract, compounded by the limited field of view, variable illumination conditions, and the dynamic behavior of vocal folds imposes challenging barriers to accurate 3D reconstruction. Typically, monoscopic footage is available limiting 3D reconstruction. We propose the use of NeRFs to address these challenges and improve the accuracy of 3D reconstruction in laryngeal endoscopy. We show that pre-processing is crucial, including the estimation of depth maps and camera poses, as well as the implementation of a NeRF that yields the final 3D reconstruction. Our findings suggest that tailored NeRFs can allow 3D reconstruction in monoscopic laryngeal endoscopy potentially improving patient-specific diagnosis and therapy. To the best of our knowledge, this is the first work leveraging NeRFs for 3D reconstruction from non-stereo laryngeal endoscopy.

Authors with CRIS profile

Anne Schützenberger Professur für Phoniatrie und Pädaudiologie Andreas Kist Juniorprofessur für Artificial Intelligence in Communication Disorders

How to cite

APA:

Lojo Rodríguez, M.B., Lopes Borges, G., López-Brea García, M., Schützenberger, A., & Kist, A. (2024). Neural Radiance Fields for 3D Reconstruction in Monoscopic Laryngeal Endoscopy. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI). Athen, GR: Institute of Electrical and Electronics Engineers, Inc..

MLA:

Lojo Rodríguez, María Belén, et al. "Neural Radiance Fields for 3D Reconstruction in Monoscopic Laryngeal Endoscopy." Proceedings of the IEEE International Symposium on Biomedical Imaging - ISBI 2024, Athen Institute of Electrical and Electronics Engineers, Inc., 2024.

BibTeX: Download