Previous [ 1] [ 2] [ 3] [ 4] [ 5] [ 6] [ 7] [ 8] [ 9] [ 10] [ 11] [ 12] [ 13] [ 14] [ 15] [ 16] [ 17] [ 18] [ 19] [ 20] [ 21] [ 22] [ 23] [ 24]

@

Journal of Information Science and Engineering, Vol. 27 No. 3, pp. 1107-1122 (May 2011)

Video Super-Resolution by Motion Compensated Iterative Back-Projection Approach*

CHEN-CHIUNG HSIEH1, YO-PING HUANG2, YU-YI CHEN1 AND CHIOU-SHANN FUH3
1Department of Computer Science and Engineering
Tatung University
Taipei, 104 Taiwan
E-mail: cchsieh@ttu.edu.tw
2Department of Electrical Engineering
National Taipei University of Technology
Taipei, 106 Taiwan
E-mail: yphuang@ntut.edu.tw
3Department of Computer Science and Information Engineering
National Taiwan University
Taipei, 106 Taiwan
E-mail: fuh@csie.ntu.edu.tw

Traditionally, uniform interpolation based approach is adopted to enhance the image resolution from a single image. Due to the one and only one image, the quality of the reconstructed image is thus constrained. Multiple frames as additional information are utilized to do super-resolution for higher-resolution image. If we have enough low-resolution images with observed sub-pixels, the high-resolution image can be reconstructed. To deal with general cases, we adopted non-uniform interpolation by iterative back-projection to estimate the high resolution image. Motion compensation is used to accurately back-project the kernel and make the process converge efficiently. Motion masks are produced for useful images/regions selection and sub-pixel blocks matching are used to do motion estimation. Objects are assumed to move slightly between two consecutive images. Thus, erroneous motion vectors could be corrected by the center of motion vector clusters. From experimental results, the PSNRs of proposed method were higher than the others, ranging from 0.5 to 1.6 dB. The difference values of the high frequency parts were also greater from 0.63% to 4.86%. It demonstrated the feasibility of the proposed method.

Keywords: super-resolution, image enlargement, motion compensation, iterative back projection, k-means clustering

Full Text () Retrieve PDF document (201105_19.pdf)

Received July 28, 2009; revised November 11, 2009; accepted January 19, 2010.
Communicated by Tyng-Luh Liu.
* This paper was supported by the Institute for Information Industry, R.O.C., under project "High quality display adaptation technique for mobile video device," 2006.