An efficient background term for 3D reconstruction and tracking with smooth surface models
Jaimez M, Cashman TJ, Fitzgibbon A, Gonzalez-Jimenez J, Cremers D (2017)
Publication Type: Conference contribution
Publication year: 2017
Publisher: Institute of Electrical and Electronics Engineers Inc.
Book Volume: 2017-January
Pages Range: 2575-2583
Conference Proceedings Title: Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017
Event location: Honolulu, HI, USA
ISBN: 9781538604571
Abstract
We present a novel strategy to shrink and constrain a 3D model, represented as a smooth spline-like surface, within the visual hull of an object observed from one or multiple views. This new 'background' or 'silhouette' term combines the efficiency of previous approaches based on an imageplane distance transform with the accuracy of formulations based on raycasting or ray potentials. The overall formulation is solved by alternating an inner nonlinear minimization (raycasting) with a joint optimization of the surface geometry, the camera poses and the data correspondences. Experiments on 3D reconstruction and object tracking show that the new formulation corrects several deficiencies of existing approaches, for instance when modelling non-convex shapes. Moreover, our proposal is more robust against defects in the object segmentation and inherently handles the presence of uncertainty in the measurements (e.g. null depth values in images provided by RGB-D cameras).
Involved external institutions
Universidad de Málaga / University of Malaga
Spain (ES)
Microsoft Corporation
United States (USA) (US)
Technische Universität München (TUM)
Germany (DE)
Spain (ES)
Microsoft Corporation
United States (USA) (US)
Technische Universität München (TUM)
Germany (DE)
How to cite
APA:
Jaimez, M., Cashman, T.J., Fitzgibbon, A., Gonzalez-Jimenez, J., & Cremers, D. (2017). An efficient background term for 3D reconstruction and tracking with smooth surface models. In Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017 (pp. 2575-2583). Honolulu, HI, USA: Institute of Electrical and Electronics Engineers Inc..
MLA:
Jaimez, Mariano, et al. "An efficient background term for 3D reconstruction and tracking with smooth surface models." Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA Institute of Electrical and Electronics Engineers Inc., 2017. 2575-2583.
BibTeX: Download