In this paper, multiresolution critical-point filters （CPFs） are employed to image matching for frame rate up-conversion （FRUC）. By CPF matching, the dense motion field can be obtained for representing object moti...In this paper, multiresolution critical-point filters （CPFs） are employed to image matching for frame rate up-conversion （FRUC）. By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation （ORCMI）. In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Ex- perimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCM1 can achieve 1-2 dB PSNR gain for standard video sequences.展开更多
Geometry based block partitioning （GBP） has been shown to achieve better performance than the tree structure based block partitioning （TSBP） of H.264. However, the residual blocks of GBP mode after motion compensa...Geometry based block partitioning （GBP） has been shown to achieve better performance than the tree structure based block partitioning （TSBP） of H.264. However, the residual blocks of GBP mode after motion compensation still present some non-vertical/non-horizontal orientations, and the conventional discrete cosine transform （DCT） may generate many high-frequency coefficients. To solve this problem, in this paper we propose a video coding approach by using GBP and reordering DCT （RDCT） techniques. In the proposed approach, GBP is first applied to partition the macroblocks. Then, before performing DCT, a reordering operation is used to adjust the pixel positions of the residual macroblocks based on the partition information. In this way, the partition information of GBP can be used to represent the reordering information of RDCT, and the bitrate can be reduced. Experimental results show that, compared to H.264/AVC, the proposed method achieves on average 6.38% and 5.69% bitrate reductions at low and high bitrates, respectively.展开更多
基金Project (No. 2004C21052) supported by the Key Program of the Science and Technology Commission Foundation of Zhejiang Province, China
文摘In this paper, multiresolution critical-point filters （CPFs） are employed to image matching for frame rate up-conversion （FRUC）. By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation （ORCMI）. In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Ex- perimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCM1 can achieve 1-2 dB PSNR gain for standard video sequences.
基金Project supported by the National Natural Science Foundation of China （No. 61102135）, the Fundamental Research Funds for the Central Universities, China （No. 2010121063）, and the Science and Technique Commission Foundation of Fujian Province, China （No. 2011 H6028）
文摘Geometry based block partitioning （GBP） has been shown to achieve better performance than the tree structure based block partitioning （TSBP） of H.264. However, the residual blocks of GBP mode after motion compensation still present some non-vertical/non-horizontal orientations, and the conventional discrete cosine transform （DCT） may generate many high-frequency coefficients. To solve this problem, in this paper we propose a video coding approach by using GBP and reordering DCT （RDCT） techniques. In the proposed approach, GBP is first applied to partition the macroblocks. Then, before performing DCT, a reordering operation is used to adjust the pixel positions of the residual macroblocks based on the partition information. In this way, the partition information of GBP can be used to represent the reordering information of RDCT, and the bitrate can be reduced. Experimental results show that, compared to H.264/AVC, the proposed method achieves on average 6.38% and 5.69% bitrate reductions at low and high bitrates, respectively.
