Butterfly-Net: Spatial-temporal architecture for medical image segmentation

Klymenko T, Kim ST, Lauber K, Kurz C, Landry G, Navab N, Albarqouni S (2021)


Publication Type: Conference contribution

Publication year: 2021

Journal

Publisher: IEEE Computer Society

Book Volume: 2021-April

Pages Range: 616-620

Conference Proceedings Title: Proceedings - International Symposium on Biomedical Imaging

Event location: Nice, FRA

ISBN: 9781665412469

DOI: 10.1109/ISBI48211.2021.9433939

Abstract

Radiation therapy tries to maximize the effect of radiation on the tumor and minimize its influence on adjacent tissues. However, it highly depends on the accuracy of the tumor segmentation on the planning radiography images. Tumor contouring today is carried out exclusively with the significant contribution of medical specialists which is a tedious, time-demanding, and expensive task. Further, it is prone to the inter-/intra-observer variation that can affect the reliability of the outcome. Existing methods for automatic tumor segmentation can reduce the influence of these factors, but are not completely reliable and leave a lot of room for improvement. In this work, we exploit Spatio-temporal information from the longitudinal CT scans to improve the deep neural network for tumor segmentation. For this purpose, we devise a novel volumetric Spatio-temporal memory network, Butterfly-Net, which stores the previous scan information and reads for the segmentation at the target time point. Moreover, the effect of clinical factors is investigated in the framework of our volumetric Spatio-temporal memory network. Experimental results on our longitudinal CT scans show that our model could effectively utilize temporal information and clinical factors for tumor segmentation. The code is made publicly available 1

Involved external institutions

How to cite

APA:

Klymenko, T., Kim, S.T., Lauber, K., Kurz, C., Landry, G., Navab, N., & Albarqouni, S. (2021). Butterfly-Net: Spatial-temporal architecture for medical image segmentation. In Proceedings - International Symposium on Biomedical Imaging (pp. 616-620). Nice, FRA: IEEE Computer Society.

MLA:

Klymenko, Tetiana, et al. "Butterfly-Net: Spatial-temporal architecture for medical image segmentation." Proceedings of the 18th IEEE International Symposium on Biomedical Imaging, ISBI 2021, Nice, FRA IEEE Computer Society, 2021. 616-620.

BibTeX: Download