IDeixis: image-based Deixis for finding location-based information

TitleIDeixis: image-based Deixis for finding location-based information
Publication TypeConference Papers
Year of Publication2004
AuthorsTom Yeh, Tollmar K, Darrell T
Conference NameCHI '04 extended abstracts on Human factors in computing systems
Date Published2004///
Conference LocationNew York, NY, USA
ISBN Number1-58113-703-6
Keywordscontent-based image retrieval, context-aware computing, location-awareness, Mobile computing

We demonstrate an image-based approach to specifying location and finding location-based information from camera-equipped mobile devices. We introduce a point-by-photograph paradigm, where users can specify a location simply by taking pictures. Our technique uses content-based image retrieval methods to search the web or other databases for matching images and their source pages to find relevant location-based information. In contrast to conventional approaches to location detection, our method can refer to distant locations and does not require any physical infrastructure beyond mobile internet service. We have developed a prototype on a camera phone and conducted user studies to demonstrate the efficacy of our approach compared to other alternatives.