Robust Wavelet-Based Super-Resolution Reconstruction: Theory and Algorithm

TitleRobust Wavelet-Based Super-Resolution Reconstruction: Theory and Algorithm
Publication TypeJournal Articles
Year of Publication2009
AuthorsJi H, Fermüller C
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Pagination649 - 660
Date Published2009/04//
ISBN Number0162-8828
Keywordsbatch algorithm, better-conditioned iterative back projection scheme, Enhancement, homography estimation, image denoising, image denoising scheme, image frame alignment, Image processing software, Image reconstruction, image resolution, image sequence, Image sequences, iterative methods, regularization criteria, robust wavelet-based iterative super-resolution reconstruction, surface normal vector, video formation analysis, video sequence, video signal processing, Wavelet transforms

We present an analysis and algorithm for the problem of super-resolution imaging, that is the reconstruction of HR (high-resolution) images from a sequence of LR (low-resolution) images. Super-resolution reconstruction entails solutions to two problems. One is the alignment of image frames. The other is the reconstruction of a HR image from multiple aligned LR images. Both are important for the performance of super-resolution imaging. Image alignment is addressed with a new batch algorithm, which simultaneously estimates the homographies between multiple image frames by enforcing the surface normal vectors to be the same. This approach can handle longer video sequences quite well. Reconstruction is addressed with a wavelet-based iterative reconstruction algorithm with an efficient de-noising scheme. The technique is based on a new analysis of video formation. At a high level our method could be described as a better-conditioned iterative back projection scheme with an efficient regularization criteria in each iteration step. Experiments with both simulated and real data demonstrate that our approach has better performance than existing super-resolution methods. It can remove even large amounts of mixed noise without creating artifacts.