Video Super-Resolution(SR) reconstruction produces video sequences with High Resolution(HR) via the fusion of several Low-Resolution(LR) video frames.Traditional methods rely on the accurate estimation of subpixel mot...Video Super-Resolution(SR) reconstruction produces video sequences with High Resolution(HR) via the fusion of several Low-Resolution(LR) video frames.Traditional methods rely on the accurate estimation of subpixel motion,which constrains their applicability to video sequences with relatively simple motions such as global translation.We propose an efficient iterative spatio-temporal adaptive SR reconstruction model based on Zernike Moment(ZM),which is effective for spatial video sequences with arbitrary motion.The model uses region correlation judgment and self-adaptive threshold strategies to improve the effect and time efficiency of the ZM-based SR method.This leads to better mining of non-local selfsimilarity and local structural regularity,and is robust to noise and rotation.An efficient iterative curvature-based interpolation scheme is introduced to obtain the initial HR estimation of each LR video frame.Experimental results both on spatial and standard video sequences demonstrate that the proposed method outperforms existing methods in terms of both subjective visual and objective quantitative evaluations,and greatly improves the time efficiency.展开更多
Existing learning-based super-resolution （SR） reconstruction algorithms are mainly designed for single image, which ignore the spatio-temporal relationship between video frames. Aiming at applying the advantages of ...Existing learning-based super-resolution （SR） reconstruction algorithms are mainly designed for single image, which ignore the spatio-temporal relationship between video frames. Aiming at applying the advantages of learning-based algorithms to video SR field, a novel video SR reconstruction algorithm based on deep convolutional neural network （CNN） and spatio-temporal similarity （STCNN-SR） was proposed in this paper. It is a deep learning method for video SR reconstruction, which considers not onlv the mapping relationship among associated low-resolution （LR） and high-resolution （HR） image blocks, but also the spatio-temporal non-local complementary and redundant information between adjacent low-resolution video frames. The reconstruction speed can be improved obviously with the pre-trained end-to-end reconstructed coefficients. Moreover, the performance of video SR will be further improved by the optimization process with spatio-temporal similarity. Experimental results demonstrated that the proposed algorithm achieves a competitive SR quality on both subjective and objective evaluations, when compared to other state-of-the-art algorithms.展开更多
基金the National Basic Research Program of China (973 Program) under Grant No.2012CB821200，the National Natural Science Foundation of China under Grants No.91024001,No.61070142，the Beijing Natural Science Foundation under Grant No.4111002
文摘Video Super-Resolution(SR) reconstruction produces video sequences with High Resolution(HR) via the fusion of several Low-Resolution(LR) video frames.Traditional methods rely on the accurate estimation of subpixel motion,which constrains their applicability to video sequences with relatively simple motions such as global translation.We propose an efficient iterative spatio-temporal adaptive SR reconstruction model based on Zernike Moment(ZM),which is effective for spatial video sequences with arbitrary motion.The model uses region correlation judgment and self-adaptive threshold strategies to improve the effect and time efficiency of the ZM-based SR method.This leads to better mining of non-local selfsimilarity and local structural regularity,and is robust to noise and rotation.An efficient iterative curvature-based interpolation scheme is introduced to obtain the initial HR estimation of each LR video frame.Experimental results both on spatial and standard video sequences demonstrate that the proposed method outperforms existing methods in terms of both subjective visual and objective quantitative evaluations,and greatly improves the time efficiency.
基金supported by the National Natural Science Foundation of China (61320106006, 61532006, 61502042)
文摘Existing learning-based super-resolution （SR） reconstruction algorithms are mainly designed for single image, which ignore the spatio-temporal relationship between video frames. Aiming at applying the advantages of learning-based algorithms to video SR field, a novel video SR reconstruction algorithm based on deep convolutional neural network （CNN） and spatio-temporal similarity （STCNN-SR） was proposed in this paper. It is a deep learning method for video SR reconstruction, which considers not onlv the mapping relationship among associated low-resolution （LR） and high-resolution （HR） image blocks, but also the spatio-temporal non-local complementary and redundant information between adjacent low-resolution video frames. The reconstruction speed can be improved obviously with the pre-trained end-to-end reconstructed coefficients. Moreover, the performance of video SR will be further improved by the optimization process with spatio-temporal similarity. Experimental results demonstrated that the proposed algorithm achieves a competitive SR quality on both subjective and objective evaluations, when compared to other state-of-the-art algorithms.
