Recent advances in facial appearance capture Journal Article

Author(s): Klehm, Oliver; Rousselle, Fabrice; Papas, Marios; Bradley, Derek J; Hery, Christophe; Bickel, Bernd; Jarosz, Wojciech; Beeler, Thabo
Article Title: Recent advances in facial appearance capture
Affiliation IST Austria
Abstract: Facial appearance capture is now firmly established within academic research and used extensively across various application domains, perhaps most prominently in the entertainment industry through the design of virtual characters in video games and films. While significant progress has occurred over the last two decades, no single survey currently exists that discusses the similarities, differences, and practical considerations of the available appearance capture techniques as applied to human faces. A central difficulty of facial appearance capture is the way light interacts with skin-which has a complex multi-layered structure-and the interactions that occur below the skin surface can, by definition, only be observed indirectly. In this report, we distinguish between two broad strategies for dealing with this complexity. "Image-based methods" try to exhaustively capture the exact face appearance under different lighting and viewing conditions, and then render the face through weighted image combinations. "Parametric methods" instead fit the captured reflectance data to some parametric appearance model used during rendering, allowing for a more lightweight and flexible representation but at the cost of potentially increased rendering complexity or inexact reproduction. The goal of this report is to provide an overview that can guide practitioners and researchers in assessing the tradeoffs between current approaches and identifying directions for future advances in facial appearance capture.
Keywords: Computer graphics; Academic research; Appearance modeling; Entertainment industry; Facial appearance; Image-based methods; Multi-layered structure; Parametric method; Viewing conditions
Journal Title: Computer Graphics Forum
Volume: 34
Issue 2
ISSN: 1467-8659
Publisher: Wiley  
Date Published: 2015-05-01
Start Page: 709
End Page: 733
DOI: 10.1111/cgf.12594
Open access: no
IST Austria Authors
Related IST Austria Work