Joint Deep Multi-Graph Matching and 3D Geometry Learning from Inhomogeneous 2D Image Collections
Ye Z, Yenamandra T, Bernard F, Cremers D (2022)
Publication Type: Conference contribution
Publication year: 2022
Publisher: Association for the Advancement of Artificial Intelligence
Book Volume: 36
Pages Range: 3125-3133
Conference Proceedings Title: Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022
Event location: Virtual, Online
ISBN: 1577358767
Abstract
Graph matching aims to establish correspondences between vertices of graphs such that both the node and edge attributes agree. Various learning-based methods were recently proposed for finding correspondences between image key points based on deep graph matching formulations. While these approaches mainly focus on learning node and edge attributes, they completely ignore the 3D geometry of the underlying 3D objects depicted in the 2D images. We fill this gap by proposing a trainable framework that takes advantage of graph neural networks for learning a deformable 3D geometry model from inhomogeneous image collections, i.e., a set of images that depict different instances of objects from the same category. Experimentally, we demonstrate that our method outperforms recent learning-based approaches for graph matching considering both accuracy and cycle-consistency error, while we in addition obtain the underlying 3D geometry of the objects depicted in the 2D images.
Involved external institutions
Germany (DE)How to cite
APA:
Ye, Z., Yenamandra, T., Bernard, F., & Cremers, D. (2022). Joint Deep Multi-Graph Matching and 3D Geometry Learning from Inhomogeneous 2D Image Collections. In Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022 (pp. 3125-3133). Virtual, Online: Association for the Advancement of Artificial Intelligence.
MLA:
Ye, Zhenzhang, et al. "Joint Deep Multi-Graph Matching and 3D Geometry Learning from Inhomogeneous 2D Image Collections." Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022, Virtual, Online Association for the Advancement of Artificial Intelligence, 2022. 3125-3133.
BibTeX: Download