Syn-Net for Synergistic Deep-Learned PET-MR Reconstruction
Corda-D'Incan G, Schnabel JA, Reader AJ (2020)
Publication Type: Conference contribution
Publication year: 2020
Publisher: Institute of Electrical and Electronics Engineers Inc.
Conference Proceedings Title: 2020 IEEE Nuclear Science Symposium and Medical Imaging Conference, NSS/MIC 2020
Event location: Boston, MA, USA
ISBN: 9781728176932
DOI: 10.1109/NSS/MIC42677.2020.9508086
Abstract
We present in this work the first framework for synergistic PET-MR reconstruction using deep learning. The proposed network named Syn-Net is based on two interconnected unrolled regularised model-based image reconstruction algorithms. The maximum a posteriori expectation-maximisation algorithm is used for PET reconstruction and the regularised Landweber algorithm is used for MR reconstruction. Rather than using handcrafted regularisations, the gradient of the priors for MR and the entire regularisation step for PET are replaced by a neural network whose parameters are learnt from training data pairs. The regularisation strength for PET and MR are also learnt such that no hyperparameters are set by the user. The results on 2D simulated data showed that Syn-Net outperforms conventional independent PET and MR reconstruction algorithms by reducing noise and enhancing edges. The proposed network also removes aliasing artifacts in the reconstructed MR. Although Syn-Net is not the best deep learned method in terms of NRMSE on entire images, it outperforms conventional and independent deep learned MR-guided methods locally for regions of interest with mismatches between PET and MR. Future work will focus on comparing Syn-Net to conventional synergistic reconstruction methods, further exploring the benefits of the PET guidance for MR reconstruction in extreme cases of undersampling, investigating various interconnection strategies as well as network architectures and assessment for real data.
Involved external institutions
United Kingdom (GB)How to cite
APA:
Corda-D'Incan, G., Schnabel, J.A., & Reader, A.J. (2020). Syn-Net for Synergistic Deep-Learned PET-MR Reconstruction. In 2020 IEEE Nuclear Science Symposium and Medical Imaging Conference, NSS/MIC 2020. Boston, MA, USA: Institute of Electrical and Electronics Engineers Inc..
MLA:
Corda-D'Incan, Guillaume, Julia A. Schnabel, and Andrew J. Reader. "Syn-Net for Synergistic Deep-Learned PET-MR Reconstruction." Proceedings of the 2020 IEEE Nuclear Science Symposium and Medical Imaging Conference, NSS/MIC 2020, Boston, MA, USA Institute of Electrical and Electronics Engineers Inc., 2020.
BibTeX: Download