High-Quality RGB-D Reconstruction via Multi-View Uncalibrated Photometric Stereo and Gradient-SDF

Sang L, Hafner B, Zuo X, Cremers D (2023)

Publication Type: Conference contribution

Publication year: 2023

Publisher: Institute of Electrical and Electronics Engineers Inc.

Pages Range: 3105-3114

Conference Proceedings Title: Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023

Event location: Waikoloa, HI, USA

ISBN: 9781665493468

DOI: 10.1109/WACV56688.2023.00312

Abstract

Fine-detailed reconstructions are in high demand in many applications. However, most of the existing RGB-D reconstruction methods rely on pre-calculated accurate camera poses to recover the detailed surface geometry, where the representation of a surface needs to be adapted when optimizing different quantities. In this paper, we present a novel multi-view RGB-D based reconstruction method that tackles camera pose, lighting, albedo, and surface normal estimation via the utilization of a gradient signed distance field (gradient-SDF). The proposed method formulates the image rendering process using specific physically-based model(s) and optimizes the surface's quantities on the actual surface using its volumetric representation, as opposed to other works which estimate surface quantities only near the actual surface. To validate our method, we investigate two physically-based image formation models for natural light and point light source applications. The experimental results on synthetic and real-world datasets demonstrate that the proposed method can recover high-quality geometry of the surface more faithfully than the state-of-the-art and further improves the accuracy of estimated camera poses1.

Involved external institutions

LMU Klinikum DE Germany (DE)

How to cite

APA:

Sang, L., Hafner, B., Zuo, X., & Cremers, D. (2023). High-Quality RGB-D Reconstruction via Multi-View Uncalibrated Photometric Stereo and Gradient-SDF. In Proceedings - 2023 IEEE Winter Conference on Applications of Computer Vision, WACV 2023 (pp. 3105-3114). Waikoloa, HI, USA: Institute of Electrical and Electronics Engineers Inc..

MLA:

Sang, Lu, et al. "High-Quality RGB-D Reconstruction via Multi-View Uncalibrated Photometric Stereo and Gradient-SDF." Proceedings of the 23rd IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2023, Waikoloa, HI, USA Institute of Electrical and Electronics Engineers Inc., 2023. 3105-3114.

BibTeX: Download