Using Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose

TitleUsing Stereo Matching with General Epipolar Geometry for 2D Face Recognition across Pose
Publication TypeJournal Articles
Year of Publication2009
AuthorsCastillo CD, Jacobs DW
JournalPattern Analysis and Machine Intelligence, IEEE Transactions on
Pagination2298 - 2304
Date Published2009/12//
ISBN Number0162-8828
Keywords2D face recognition;CMU PIE data set;computer vision;continuous correspondences;general epipolar geometry;lighting variation;pose variation;stereo matching;computer vision;face recognition;geometry;image matching;pose estimation;stereo image processing;Al, Automated;, Computer-Assisted;Pattern Recognition

Face recognition across pose is a problem of fundamental importance in computer vision. We propose to address this problem by using stereo matching to judge the similarity of two, 2D images of faces seen from different poses. Stereo matching allows for arbitrary, physically valid, continuous correspondences. We show that the stereo matching cost provides a very robust measure of similarity of faces that is insensitive to pose variations. To enable this, we show that, for conditions common in face recognition, the epipolar geometry of face images can be computed using either four or three feature points. We also provide a straightforward adaptation of a stereo matching algorithm to compute the similarity between faces. The proposed approach has been tested on the CMU PIE data set and demonstrates superior performance compared to existing methods in the presence of pose variation. It also shows robustness to lighting variation.