DeepWrinkles: Accurate and Realistic Clothing Modeling
Laehner Z, Cremers D, Tung T (2018)
Publication Type: Conference contribution
Publication year: 2018
Journal
Publisher: Springer Verlag
Book Volume: 11208 LNCS
Pages Range: 698-715
Conference Proceedings Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Event location: Munich, DEU
ISBN: 9783030012243
DOI: 10.1007/978-3-030-01225-0_41
Abstract
We present a novel method to generate accurate and realistic clothing deformation from real data capture. Previous methods for realistic cloth modeling mainly rely on intensive computation of physics-based simulation (with numerous heuristic parameters), while models reconstructed from visual observations typically suffer from lack of geometric details. Here, we propose an original framework consisting of two modules that work jointly to represent global shape deformation as well as surface details with high fidelity. Global shape deformations are recovered from a subspace model learned from 3D data of clothed people in motion, while high frequency details are added to normal maps created using a conditional Generative Adversarial Network whose architecture is designed to enforce realism and temporal consistency. This leads to unprecedented high-quality rendering of clothing deformation sequences, where fine wrinkles from (real) high resolution observations can be recovered. In addition, as the model is learned independently from body shape and pose, the framework is suitable for applications that require retargeting (e.g., body animation). Our experiments show original high quality results with a flexible model. We claim an entirely data-driven approach to realistic cloth wrinkle generation is possible.
Involved external institutions
United States (USA) (US)
Germany (DE)How to cite
APA:
Laehner, Z., Cremers, D., & Tung, T. (2018). DeepWrinkles: Accurate and Realistic Clothing Modeling. In Vittorio Ferrari, Cristian Sminchisescu, Yair Weiss, Martial Hebert (Eds.), Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (pp. 698-715). Munich, DEU: Springer Verlag.
MLA:
Laehner, Zorah, Daniel Cremers, and Tony Tung. "DeepWrinkles: Accurate and Realistic Clothing Modeling." Proceedings of the 15th European Conference on Computer Vision, ECCV 2018, Munich, DEU Ed. Vittorio Ferrari, Cristian Sminchisescu, Yair Weiss, Martial Hebert, Springer Verlag, 2018. 698-715.
BibTeX: Download