Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch

TitleBypassing synthesis: PLS for face recognition with pose, low-resolution and sketch
Publication TypeConference Papers
Year of Publication2011
AuthorsSharma A, Jacobs DW
Conference NameComputer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on
Date Published2011/06//
Keywordsapproximations;pose, COMPARISON, estimation;, extraction;image, framework;face, intensities;subspace, least, PLS;bypassing, recognition;feature, recognition;partial, resolution;least, selection;multimodal, squares, squares;pixel, synthesis;face

This paper presents a novel way to perform multi-modal face recognition. We use Partial Least Squares (PLS) to linearly map images in different modalities to a common linear subspace in which they are highly correlated. PLS has been previously used effectively for feature selection in face recognition. We show both theoretically and experimentally that PLS can be used effectively across modalities. We also formulate a generic intermediate subspace comparison framework for multi-modal recognition. Surprisingly, we achieve high performance using only pixel intensities as features. We experimentally demonstrate the highest published recognition rates on the pose variations in the PIE data set, and also show that PLS can be used to compare sketches to photos, and to compare images taken at different resolutions.