Morphable face models - An open framework
Gerig T, Morel-Forster A, Blumer C, Egger B, Luthi M, Schonborn S, Vetter T (2018)
Publication Type: Conference contribution, Conference Contribution
Publication year: 2018
Publisher: Institute of Electrical and Electronics Engineers Inc.
Pages Range: 75-82
Conference Proceedings Title: Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018
Event location: Xi'an
ISBN: 9781538623350
Abstract
In this paper, we present a novel open-source pipeline for face registration based on Gaussian processes as well as an application to face image analysis. Non-rigid registration of faces is significant for many applications in computer vision, such as the construction of 3D Morphable face models (3DMMs). Gaussian Process Morphable Models (GPMMs) unify a variety of non-rigid deformation models with B-splines and PCA models as examples. GPMM separate problem specific requirements from the registration algorithm by incorporating domain-specific adaptions as a prior model. The novelties of this paper are the following: (i) We present a strategy and modeling technique for face registration that considers symmetry, multi-scale and spatially-varying details. The registration is applied to neutral faces and facial expressions. (ii) We release an open-source software framework for registration model-building demonstrated on the publicly available BU3D-FE database. The released pipeline also contains an implementation of an Analysis-by-Synthesis model adaption of 2D face images, tested on the Multi-PIE and LFW database. This enables the community to reproduce, evaluate and compare the individual steps of registration to model-building and 3D/2D model fitting. (iii) Along with the framework release, we publish a new version of the Basel Face Model (BFM-2017) with an improved age distribution and an additional facial expression model.
Authors with CRIS profile
Involved external institutions
Switzerland (CH)How to cite
APA:
Gerig, T., Morel-Forster, A., Blumer, C., Egger, B., Luthi, M., Schonborn, S., & Vetter, T. (2018). Morphable face models - An open framework. In Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 (pp. 75-82). Xi'an, CN: Institute of Electrical and Electronics Engineers Inc..
MLA:
Gerig, Thomas, et al. "Morphable face models - An open framework." Proceedings of the 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018, Xi'an Institute of Electrical and Electronics Engineers Inc., 2018. 75-82.
BibTeX: Download