Deep Multi-Modal Encoder-Decoder Networks for Shape Constrained Segmentation and Joint Representation Learning

Bouteldja N, Merhof D, Ehrhardt J, Heinrich MP (2019)

Publication Type: Conference contribution

Publication year: 2019

Journal

Informatik aktuell Gesellschaft für Informatik (GI)

Publisher: Springer Berlin Heidelberg

Pages Range: 23-28

Conference Proceedings Title: Informatik aktuell

Event location: Lübeck, DEU

ISBN: 9783658253257

DOI: 10.1007/978-3-658-25326-4_8

Abstract

Deep learning approaches have been very successful in segmenting cardiac structures from CT and MR volumes. Despite continuous progress, automated segmentation of these structures remains challenging due to highly complex regional characteristics (e.g. homogeneous gray-level transitions) and large anatomical shape variability. To cope with these challenges, the incorporation of shape priors into neural networks for robust segmentation is an important area of current research. We propose a novel approach that leverages shared information across imaging modalities and shape segmentations within a unified multi-modal encoder-decoder network. This jointly end-to-end trainable architecture is advantageous in improving robustness due to strong shape constraints and enables further applications due to smooth transitions in the learned shape space. Despite no skip connections are used and all shape information is encoded in a low-dimensional representation, our approach achieves high-accuracy segmentation and consistent shape interpolation results on the multi-modal whole heart segmentation dataset.

Involved external institutions

Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen DE Germany (DE) Universität zu Lübeck DE Germany (DE)

How to cite

APA:

Bouteldja, N., Merhof, D., Ehrhardt, J., & Heinrich, M.P. (2019). Deep Multi-Modal Encoder-Decoder Networks for Shape Constrained Segmentation and Joint Representation Learning. In Thomas Tolxdorff, Klaus H. Maier-Hein, Thomas M. Deserno, Christoph Palm, Andreas Maier, Heinz Handels (Eds.), Informatik aktuell (pp. 23-28). Lübeck, DEU: Springer Berlin Heidelberg.

MLA:

Bouteldja, Nassim, et al. "Deep Multi-Modal Encoder-Decoder Networks for Shape Constrained Segmentation and Joint Representation Learning." Proceedings of the Workshop on Bildverarbeitung fur die Medizin, 2019, Lübeck, DEU Ed. Thomas Tolxdorff, Klaus H. Maier-Hein, Thomas M. Deserno, Christoph Palm, Andreas Maier, Heinz Handels, Springer Berlin Heidelberg, 2019. 23-28.

BibTeX: Download