Background modeling for generative image models

Schoenborn S, Egger B, Forster A, Vetter T (2015)


Publication Type: Journal article

Publication year: 2015

Journal

Book Volume: 136

Pages Range: 117-127

DOI: 10.1016/j.cviu.2015.01.008

Abstract

Face image interpretation with generative models is done by reconstructing the input image as well as possible. A comparison between the target and the model-generated image is complicated by the fact that faces are surrounded by background. The standard likelihood formulation only compares within the modeled face region. Through this restriction an unwanted but unavoidable background model appears in the likelihood. This implicitly present model is inappropriate for most backgrounds and leads to artifacts in the reconstruction, ranging from pose misalignment to shrinking of the face. We discuss the problem in detail for a probabilistic 3D Morphable Model and propose to use explicit image-based background models as a simple but fundamental solution. We also discuss common practical strategies which deal with the problem but suffer from a limited applicability which inhibits the fully automatic adaption of such models. We integrate the explicit background model through a likelihood ratio correction of the face model and thereby remove the need to evaluate the complete image. The background models are generic and do not need to model background specifics. The corrected 3D Morphable Model directly leads to more accurate pose estimation and image interpretations at large yaw angles with strong self-occlusion.

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Schoenborn, S., Egger, B., Forster, A., & Vetter, T. (2015). Background modeling for generative image models. Computer Vision and Image Understanding, 136, 117-127. https://dx.doi.org/10.1016/j.cviu.2015.01.008

MLA:

Schoenborn, Sandro, et al. "Background modeling for generative image models." Computer Vision and Image Understanding 136 (2015): 117-127.

BibTeX: Download