Moving Object Verification in Airborne Video Sequences

TitleMoving Object Verification in Airborne Video Sequences
Publication TypeJournal Articles
Year of Publication2009
AuthorsYue Z, Guarino D, Chellappa R
JournalCircuits and Systems for Video Technology, IEEE Transactions on
Pagination77 - 89
Date Published2009/01//
ISBN Number1051-8215
Keywordsairborne, database;homography-based, databases;, matcher;color, matcher;image, matching;image, method;infrared, object, sequences;color, sequences;distance, sequences;moving, sequences;video, synthesis, system;exemplar, transforms;end-to-end, verification;spatial-feature, video, view

This paper presents an end-to-end system for moving object verification in airborne video sequences. Using a sample selection module, the system first selects frames from a short sequence and stores them in an exemplar database. To handle appearance change due to potentially large aspect angle variations, a homography-based view synthesis method is then used to generate a novel view of each image in the exemplar database at the same pose as the testing object in each frame of a testing video segment. A rotationally invariant color matcher and a spatial-feature matcher based on distance transforms are combined using a weighted average rule to compare the novel view and the testing object. After looping over all testing frames, the set of match scores is passed to a temporal analysis module to examine the behavior of the testing object, and calculate a final likelihood. Very good verification performance is achieved over thousands of trials for both color and infrared video sequences using the proposed system.