Surface Dependent Representations for Illumination Insensitive Image Comparison

TitleSurface Dependent Representations for Illumination Insensitive Image Comparison
Publication TypeJournal Articles
Year of Publication2007
AuthorsOsadchy M, Jacobs DW, Lindenbaum M
JournalPattern Analysis and Machine Intelligence, IEEE Transactions on
Pagination98 - 111
Date Published2007/01//
ISBN Number0162-8828
KeywordsAutomated;Reproducibility of Results;Sensitivity and Specificity;Subtraction Technique;, Computer-Assisted;Imaging, Gabor jets;Gaussian random surface;filter whitening;illumination;image comparison;image matching;lighting condition;multiscale oriented filter;surface dependent representation;image matching;image representation;Algorithms;Artificial Intelligence;Image En, Three-Dimensional;Information Storage and Retrieval;Lighting;Pattern Recognition

We consider the problem of matching images to tell whether they come from the same scene viewed under different lighting conditions. We show that the surface characteristics determine the type of image comparison method that should be used. Previous work has shown the effectiveness of comparing the image gradient direction for surfaces with material properties that change rapidly in one direction. We show analytically that two other widely used methods, normalized correlation of small windows and comparison of multiscale oriented filters, essentially compute the same thing. Then, we show that for surfaces whose properties change more slowly, comparison of the output of whitening filters is most effective. This suggests that a combination of these strategies should be employed to compare general objects. We discuss indications that Gabor jets use such a mixed strategy effectively, and we propose a new mixed strategy. We validate our results on synthetic and real images