Image Reconstruction in a Manifold of Image Patches: Application to Whole-Fetus Ultrasound Imaging
Gomez A, Zimmer V, Toussaint N, Wright R, Clough JR, Khanal B, Van Poppel MPM, Skelton E, Matthews J, Schnabel JA (2019)
Publication Type: Conference contribution
Publication year: 2019
Journal
Publisher: Springer
Book Volume: 11905 LNCS
Pages Range: 226-235
Conference Proceedings Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Event location: Shenzhen, CHN
ISBN: 9783030338428
DOI: 10.1007/978-3-030-33843-5_21
Abstract
We propose an image reconstruction framework to combine a large number of overlapping image patches into a fused reconstruction of the object of interest, that is robust to inconsistencies between patches (e.g. motion artefacts) without explicitly modelling them. This is achieved through two mechanisms: first, manifold embedding, where patches are distributed on a manifold with similar patches (where similarity is defined only in the region where they overlap) closer to each other. As a result, inconsistent patches are set far apart in the manifold. Second, fusion, where a sample in the manifold is mapped back to image space, combining features from all patches in the region of the sample. For the manifold embedding mechanism, a new method based on a Convolutional Variational Autoencoder (β -VAE) is proposed, and compared to classical manifold embedding techniques: linear (Multi Dimensional Scaling) and non-linear (Laplacian Eigenmaps). Experiments using synthetic data and on real fetal ultrasound images yield fused images of the whole fetus where, in average, β -VAE outperforms all the other methods in terms of preservation of patch information and overall image quality.
Involved external institutions
United Kingdom (GB)How to cite
APA:
Gomez, A., Zimmer, V., Toussaint, N., Wright, R., Clough, J.R., Khanal, B.,... Schnabel, J.A. (2019). Image Reconstruction in a Manifold of Image Patches: Application to Whole-Fetus Ultrasound Imaging. In Florian Knoll, Andreas Maier, Daniel Rueckert, Jong Chul Ye (Eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 226-235). Shenzhen, CHN: Springer.
MLA:
Gomez, Alberto, et al. "Image Reconstruction in a Manifold of Image Patches: Application to Whole-Fetus Ultrasound Imaging." Proceedings of the 2nd International Workshop on Machine Learning for Medical Image Reconstruction, MLMIR 2019 held in Conjunction with 22nd International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2019, Shenzhen, CHN Ed. Florian Knoll, Andreas Maier, Daniel Rueckert, Jong Chul Ye, Springer, 2019. 226-235.
BibTeX: Download