%0 Conference Paper %B 2011 IEEE International Conference on Computer Vision (ICCV) %D 2011 %T Active scene recognition with vision and language %A Yu,Xiaodong %A Fermüller, Cornelia %A Ching Lik Teo %A Yezhou Yang %A Aloimonos, J. %K accuracy %K active scene recognition %K classification performance %K Cognition %K Computer vision %K Detectors %K Equations %K high level knowledge utilization %K HUMANS %K image classification %K inference mechanisms %K object detectors %K Object recognition %K reasoning module %K sensing process %K sensory module %K support vector machines %K Training %X This paper presents a novel approach to utilizing high level knowledge for the problem of scene recognition in an active vision framework, which we call active scene recognition. In traditional approaches, high level knowledge is used in the post-processing to combine the outputs of the object detectors to achieve better classification performance. In contrast, the proposed approach employs high level knowledge actively by implementing an interaction between a reasoning module and a sensory module (Figure 1). Following this paradigm, we implemented an active scene recognizer and evaluated it with a dataset of 20 scenes and 100+ objects. We also extended it to the analysis of dynamic scenes for activity recognition with attributes. Experiments demonstrate the effectiveness of the active paradigm in introducing attention and additional constraints into the sensing process. %B 2011 IEEE International Conference on Computer Vision (ICCV) %I IEEE %P 810 - 817 %8 2011/11/06/13 %@ 978-1-4577-1101-5 %G eng %R 10.1109/ICCV.2011.6126320