High-quality single-shot capture of facial geometry Journal Article

Author(s): Beeler, Thabo; Bickel, Bernd; Beardsley, Paul A; Sumner, Bob; Groß, Markus S
Article Title: High-quality single-shot capture of facial geometry
Abstract: This paper describes a passive stereo system for capturing the 3D geometry of a face in a single-shot under standard light sources. The system is low-cost and easy to deploy. Results are submillimeter accurate and commensurate with those from state-ofthe-art systems based on active lighting, and the models meet the quality requirements of a demanding domain like the movie industry. Recovered models are shown for captures from both high-end cameras in a studio setting and from a consumer binocular-stereo camera, demonstrating scalability across a spectrum of camera deployments, and showing the potential for 3D face modeling to move beyond the professional arena and into the emerging consumer market in stereoscopic photography. Our primary technical contribution is a modification of standard stereo refinement methods to capture pore-scale geometry, using a qualitative approach that produces visually realistic results. The second technical contribution is a calibration method suited to face capture systems. The systemic contribution includes multiple demonstrations of system robustness and quality. These include capture in a studio setup, capture off a consumer binocular-stereo camera, scanning of faces of varying gender and ethnicity and age, capture of highly-transient facial expression, and scanning a physical mask to provide ground-truth validation.
Keywords: 3D face modeling; 3D geometry; Active lighting; Calibration method; Capture system; Consumer market; Facial Expressions; Facial geometry; High quality; Movie industry; Passive stereo; Pore-scale geometry; Qualitative approach; Quality requirements; Refinement methods; Single-shot; Stereo cameras; Submillimeters; System robustness; Technical contribution
Journal Title: ACM Transactions on Graphics
Volume: 29
Issue 4
ISSN: 1557-7368
Publisher: ACM  
Date Published: 2010-01-01
Start Page: Article number: 40
DOI: 10.1145/1778765.1778777
Open access: yes (repository)
IST Austria Authors
Related IST Austria Work