%0 Journal Article %J Pattern Analysis and Machine Intelligence, IEEE Transactions on %D 2007 %T Surface Dependent Representations for Illumination Insensitive Image Comparison %A Osadchy,M. %A Jacobs, David W. %A Lindenbaum,M. %K Automated;Reproducibility of Results;Sensitivity and Specificity;Subtraction Technique; %K Computer-Assisted;Imaging %K Gabor jets;Gaussian random surface;filter whitening;illumination;image comparison;image matching;lighting condition;multiscale oriented filter;surface dependent representation;image matching;image representation;Algorithms;Artificial Intelligence;Image En %K Three-Dimensional;Information Storage and Retrieval;Lighting;Pattern Recognition %X We consider the problem of matching images to tell whether they come from the same scene viewed under different lighting conditions. We show that the surface characteristics determine the type of image comparison method that should be used. Previous work has shown the effectiveness of comparing the image gradient direction for surfaces with material properties that change rapidly in one direction. We show analytically that two other widely used methods, normalized correlation of small windows and comparison of multiscale oriented filters, essentially compute the same thing. Then, we show that for surfaces whose properties change more slowly, comparison of the output of whitening filters is most effective. This suggests that a combination of these strategies should be employed to compare general objects. We discuss indications that Gabor jets use such a mixed strategy effectively, and we propose a new mixed strategy. We validate our results on synthetic and real images %B Pattern Analysis and Machine Intelligence, IEEE Transactions on %V 29 %P 98 - 111 %8 2007/01// %@ 0162-8828 %G eng %N 1 %R 10.1109/TPAMI.2007.250602