Markov Chain Monte Carlo for Automated Face Image Analysis

Schonborn S, Egger B, Morel-Forster A, Vetter T (2017)


Publication Type: Journal article

Publication year: 2017

Journal

Book Volume: 123

Pages Range: 160-183

Journal Issue: 2

DOI: 10.1007/s11263-016-0967-5

Abstract

We present a novel fully probabilistic method to interpret a single face image with the 3D Morphable Model. The new method is based on Bayesian inference and makes use of unreliable image-based information. Rather than searching a single optimal solution, we infer the posterior distribution of the model parameters given the target image. The method is a stochastic sampling algorithm with a propose-and-verify architecture based on the Metropolis–Hastings algorithm. The stochastic method can robustly integrate unreliable information and therefore does not rely on feed-forward initialization. The integrative concept is based on two ideas, a separation of proposal moves and their verification with the model (Data-Driven Markov Chain Monte Carlo), and filtering with the Metropolis acceptance rule. It does not need gradients and is less prone to local optima than standard fitters. We also introduce a new collective likelihood which models the average difference between the model and the target image rather than individual pixel differences. The average value shows a natural tendency towards a normal distribution, even when the individual pixel-wise difference is not Gaussian. We employ the new fitting method to calculate posterior models of 3D face reconstructions from single real-world images. A direct application of the algorithm with the 3D Morphable Model leads us to a fully automatic face recognition system with competitive performance on the Multi-PIE database without any database adaptation.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Schonborn, S., Egger, B., Morel-Forster, A., & Vetter, T. (2017). Markov Chain Monte Carlo for Automated Face Image Analysis. International Journal of Computer Vision, 123(2), 160-183. https://doi.org/10.1007/s11263-016-0967-5

MLA:

Schonborn, Sandro, et al. "Markov Chain Monte Carlo for Automated Face Image Analysis." International Journal of Computer Vision 123.2 (2017): 160-183.

BibTeX: Download