Occlusion-aware 3D morphable face models

Schneider A, Blumer C, Morel-Forster A, Schönborn S, Vetter T, Egger B (2016)

Publication Type: Conference contribution

Publication year: 2016

Publisher: British Machine Vision Conference, BMVC

Book Volume: 2016-September

Pages Range: 64.1-64.11

Conference Proceedings Title: British Machine Vision Conference 2016, BMVC 2016

Event location: York GB

DOI: 10.5244/C.30.64

Abstract

We propose a probabilistic occlusion-aware 3D Morphable Face Model adaptation framework for face image analysis based on the Analysis-by-Synthesis setup. In natural images, parts of the face are often occluded by a variety of objects. Such occlusions are a challenge for face model adaptation. We propose to segment the image into face and non-face regions and model them separately. The segmentation and the face model parameters are not known in advance and have to be adapted to the target image. A good segmentation is necessary to obtain a good face model fit and vice-versa. Therefore, face model adaptation and segmentation are solved together using an EM-like procedure. We use a stochastic sampling strategy based on the Metropolis-Hastings algorithm for face model parameter adaptation and a modified Chan-Vese segmentation for face region segmentation. Previous robust methods are limited to homogeneous, controlled illumination settings and tend to fail for important regions such as the eyes or mouth. We propose a RANSAC-based robust illumination estimation technique to handle complex illumination conditions. We do not use any manual annotation and the algorithm is not optimised to any specific kind of occlusion or database. We evaluate our method on a controlled and an “in the wild” database.

Authors with CRIS profile

Bernhard Egger

Involved external institutions

Universität Basel CH Switzerland (CH)

How to cite

APA:

Schneider, A., Blumer, C., Morel-Forster, A., Schönborn, S., Vetter, T., & Egger, B. (2016). Occlusion-aware 3D morphable face models. In British Machine Vision Conference 2016, BMVC 2016 (pp. 64.1-64.11). York, GB: British Machine Vision Conference, BMVC.

MLA:

Schneider, Andreas, et al. "Occlusion-aware 3D morphable face models." Proceedings of the 27th British Machine Vision Conference, BMVC 2016, York British Machine Vision Conference, BMVC, 2016. 64.1-64.11.

BibTeX: Download