3D Facial Pose Tracking in Uncalibrated Videos

Title3D Facial Pose Tracking in Uncalibrated Videos
Publication TypeBook Chapters
Year of Publication2005
AuthorsAggarwal G, Veeraraghavan A, Chellappa R
EditorPal S, Bandyopadhyay S, Biswas S
Book TitlePattern Recognition and Machine IntelligencePattern Recognition and Machine Intelligence
Series TitleLecture Notes in Computer Science
Pagination515 - 520
PublisherSpringer Berlin / Heidelberg
ISBN Number978-3-540-30506-4

This paper presents a method to recover the 3D configuration of a face in each frame of a video. The 3D configuration consists of the 3 translational parameters and the 3 orientation parameters which correspond to the yaw, pitch and roll of the face, which is important for applications like face modeling, recognition, expression analysis, etc. The approach combines the structural advantages of geometric modeling with the statistical advantages of a particle-filter based inference. The face is modeled as the curved surface of a cylinder which is free to translate and rotate arbitrarily. The geometric modeling takes care of pose and self-occlusion while the statistical modeling handles moderate occlusion and illumination variations. Experimental results on multiple datasets are provided to show the efficacy of the approach. The insensitivity of our approach to calibration parameters (focal length) is also shown.