Feature-based image registration in structured light endoscopy

Kist A, Zilker J, Döllinger M, Semmler M (2021)

Publication Language: English

Publication Type: Conference contribution, Original article

Publication year: 2021

Series: Medical Imaging with Deep Learning (MIDL 2021)

Book Volume: 143

Pages Range: 369-383

Conference Proceedings Title: Proceedings of Machine Learning Research

Event location: Lübeck

Abstract

Images offer a two-dimensional (2D) representation of a three-dimensional (3D) environment. However, in many biomedical tasks, a 3D view is crucial for diagnosis. Projecting structured light, such as a regular laser grid, onto the surface of interest allows to reconstruct its 3D structure. For reconstruction, it is crucial to correctly identify and assign each laser ray to its respective position in the laser grid. Current methods for this task use semi-automatic, yet highly manual annotations. Hence, a fully automatic, reliable method is desired. Here, we show that this assignment can be approached as an image registration. We first separate the laser rays from the background using semantic segmentation. We found that registration of the extracted laser rays directly to the fixed laser grid image fails, when we use state-of-the-art intensity-based image registration techniques, such as ANTs. Using our feature-based custom loss and a deep neural network, we are able to use a U-Net-like architecture to compute deformation fields to successfully register the laser rays onto the fixed image accompanied with a custom post-processing sorting step. Using synthetic data, we show that the network is in general able to learn affine and non-linear transformations. Our method is also robust to missing or occluded rays. Using an ex vivo dataset, we achieved an registration accuracy of 91%. In summary, we provide a new platform to perform feature-based registration and showcase this on a biomedical dataset. In future, we will evaluate different architectural designs and more complex datasets.

Authors with CRIS profile

How to cite

APA:

Kist, A., Zilker, J., Döllinger, M., & Semmler, M. (2021). Feature-based image registration in structured light endoscopy. In Proceedings of Machine Learning Research (pp. 369-383). Lübeck, DE.

MLA:

Kist, Andreas, et al. "Feature-based image registration in structured light endoscopy." Proceedings of the Medical Imaging with Deep Learning (MIDL), Lübeck 2021. 369-383.

BibTeX: Download