This paper proposes a new adaptive post-filtering algorithm to remove coding artifacts in block-based video coder. The proposed method concentrates on blocking and ringing artifacts removal. For de-blocking, the block...This paper proposes a new adaptive post-filtering algorithm to remove coding artifacts in block-based video coder. The proposed method concentrates on blocking and ringing artifacts removal. For de-blocking, the blocking strength is identified to determine the filtering range, and the maximum quantization parameter of the image is used to adapt the 1D fuzzy filter. For de-ringing, besides the edge detection, a complementary ringing detection method is proposed to locate the neglected ringing blocks, and the gradient threshold is adopted to adjust the parameter of 2D fuzzy filter. Experiments are performed on the MPEG-4 sequences. Compared with other methods, the proposed one achieves better detail preservation and artifacts removal performance with lower computational cost.展开更多
The growing number of mobile users, as well as the diversification in types of services have resulted in increasing demands for wireless network bandwidth in recent years. Although evolving transmission techniques are...The growing number of mobile users, as well as the diversification in types of services have resulted in increasing demands for wireless network bandwidth in recent years. Although evolving transmission techniques are able to enlarge the network capacity to some degree, they still cannot satisfy the requirements of mobile users. Meanwhile, following Moore's Law, the data processing capabilities of mobile user terminals are continuously improving. In this paper, we explore possible methods of trading strong computational power at wireless terminals for transmission efficiency of communications. Taking the specific scenario of wireless video conversation, we propose a model-based video coding scheme by learning the structures in multimedia contents. Benefiting from both strong computing capability and pre-learned model priors, only low-dimensional parameters need to be transmitted; and the intact multimedia contents can also be reconstructed at the receivers in real-time. Experiment results indicate that, compared to conventional video codecs, the proposed scheme significantly reduces the data rate with the aid of computational capability at wireless terminals.展开更多
Rate control plays an important role in video coding. An algorithm is proposed by Tsai et al in which macroblock’s coding order is rearranged to improve the coding quality. However, the complexity is very high due to...Rate control plays an important role in video coding. An algorithm is proposed by Tsai et al in which macroblock’s coding order is rearranged to improve the coding quality. However, the complexity is very high due to the change of macroblock’s coding order. In this paper, a macroblocl-level rate control algorithm is proposed which recalculates the quantization parameter of each macroblock based on its significance. Simulation results show that the proposed algorithm not only achieves 0.1-0.6 dB in peak signal-to-noise ratio (PSNR) but also reduces 33%-55% total encoding time compared to Tsai’s algorithm.展开更多
The Wyner-Ziv distributed video coding scheme is characterized for its intraframe encoder and interframe decoder which can also approach the efficiency of an interframe encoder-decoder system. In Wyner-Ziv residual co...The Wyner-Ziv distributed video coding scheme is characterized for its intraframe encoder and interframe decoder which can also approach the efficiency of an interframe encoder-decoder system. In Wyner-Ziv residual coding of video, the residual of a frame with respect to a reference frame is Wyner-Ziv encoded, which can reduces the input entropy and leads to a higher coding efficiency than directly encoding the original frame. In this paper, we propose a new approach of residual coding combined with Region Of Interest (ROI) extraction. Experimental results show that, the proposed scheme achieves better rate-distortion performance compared to conventional Wyner-Ziv coding scheme.展开更多
Image sequences processing and video encoding are extremely time consuming problems. The time complexity of them depends on image contents. This paper presents an estimation of a block motion method for video coding w...Image sequences processing and video encoding are extremely time consuming problems. The time complexity of them depends on image contents. This paper presents an estimation of a block motion method for video coding with edge alignment. This method uses blocks of size 4 × 4 and its basic idea is to find motion vector using the edge position in each video coding block. The method finds the motion vectors more accurately and faster than any known classical method that calculates all the possibilities. Our presented algorithm is compared with known classical algorithms using the evaluation function of the peak signal-to-noise ratio. For comparison of the methods we are using parameters such as time, CPU usage, and size of compressed data. The comparison is made on benchmark data in color format YUV. Results of our proposed method are comparable and in some cases better than results of standard classical algorithms.展开更多
The new MPEG-4 video coding standard enables content-based functions. In order to support the new standard, frames should be decomposed into Video Object Planes （VOP）, each VOP representing a moving object. This pap...The new MPEG-4 video coding standard enables content-based functions. In order to support the new standard, frames should be decomposed into Video Object Planes （VOP）, each VOP representing a moving object. This paper proposes an image segmentation method to separate moving objects from image sequences. The proposed method utilizes the spatial-temporal information. Spatial segmentation is applied to divide each image into connected areas and to find pre~：ise object boundaries of moving objects. To locate moving objects in image sequences, two consecutive image frames in the temporal direction are examined and a hypothesis testing is performed with Neyman-Pearson criterion. Spatial segmentation produces a spatial segmentation mask, and temporal segmentation yields a change detection mask that indicates moving objects and the background. Then spatial-temporal merging can be used to get the final results. This method has been tested on several images. Experimental results show that this segmentation method is efficient.展开更多
Side information （SI） is one of the key issues in distributed video coding （DVC） and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv （WZ...Side information （SI） is one of the key issues in distributed video coding （DVC） and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv （WZ） frame is split into two parts based on checkerboard pattern, and the two parts are encoded independently but decoded sequentially. In the decoding process, the part 1 is first decoded with the initial SI and partially decoded part （PDP） 1 is used to improve the motion vectors （MVs） and SI of both parts. At the next stage, the part 2 is decoded with the improved SI and PDP 2 is used to further refine MVs of the part 2. Then, SI of both parts are further refined. Simulation results show that the proposed algorithm can improve the peak signal to noise ratio （PSNR） by up to 1.43 dB when compared with traditional DVC codec.展开更多
文摘This paper proposes a new adaptive post-filtering algorithm to remove coding artifacts in block-based video coder. The proposed method concentrates on blocking and ringing artifacts removal. For de-blocking, the blocking strength is identified to determine the filtering range, and the maximum quantization parameter of the image is used to adapt the 1D fuzzy filter. For de-ringing, besides the edge detection, a complementary ringing detection method is proposed to locate the neglected ringing blocks, and the gradient threshold is adopted to adjust the parameter of 2D fuzzy filter. Experiments are performed on the MPEG-4 sequences. Compared with other methods, the proposed one achieves better detail preservation and artifacts removal performance with lower computational cost.
基金supported by the National Basic Research Project of China (973) (2013CB329006)National Natural Science Foundation of China (NSFC, 61101071,61471220, 61021001)Tsinghua University Initiative Scientific Research Program
文摘The growing number of mobile users, as well as the diversification in types of services have resulted in increasing demands for wireless network bandwidth in recent years. Although evolving transmission techniques are able to enlarge the network capacity to some degree, they still cannot satisfy the requirements of mobile users. Meanwhile, following Moore's Law, the data processing capabilities of mobile user terminals are continuously improving. In this paper, we explore possible methods of trading strong computational power at wireless terminals for transmission efficiency of communications. Taking the specific scenario of wireless video conversation, we propose a model-based video coding scheme by learning the structures in multimedia contents. Benefiting from both strong computing capability and pre-learned model priors, only low-dimensional parameters need to be transmitted; and the intact multimedia contents can also be reconstructed at the receivers in real-time. Experiment results indicate that, compared to conventional video codecs, the proposed scheme significantly reduces the data rate with the aid of computational capability at wireless terminals.
文摘Rate control plays an important role in video coding. An algorithm is proposed by Tsai et al in which macroblock’s coding order is rearranged to improve the coding quality. However, the complexity is very high due to the change of macroblock’s coding order. In this paper, a macroblocl-level rate control algorithm is proposed which recalculates the quantization parameter of each macroblock based on its significance. Simulation results show that the proposed algorithm not only achieves 0.1-0.6 dB in peak signal-to-noise ratio (PSNR) but also reduces 33%-55% total encoding time compared to Tsai’s algorithm.
基金Supported by the National Natural Science Foundation of China (No.61003236, 61171053, 61170065)the Doctoral Fund of Ministry of Education of China (No.20113223110002)the Natural Science Major Program for Colleges and Universities in Jiangsu Province(No.11KJA520001)
文摘The Wyner-Ziv distributed video coding scheme is characterized for its intraframe encoder and interframe decoder which can also approach the efficiency of an interframe encoder-decoder system. In Wyner-Ziv residual coding of video, the residual of a frame with respect to a reference frame is Wyner-Ziv encoded, which can reduces the input entropy and leads to a higher coding efficiency than directly encoding the original frame. In this paper, we propose a new approach of residual coding combined with Region Of Interest (ROI) extraction. Experimental results show that, the proposed scheme achieves better rate-distortion performance compared to conventional Wyner-Ziv coding scheme.
文摘Image sequences processing and video encoding are extremely time consuming problems. The time complexity of them depends on image contents. This paper presents an estimation of a block motion method for video coding with edge alignment. This method uses blocks of size 4 × 4 and its basic idea is to find motion vector using the edge position in each video coding block. The method finds the motion vectors more accurately and faster than any known classical method that calculates all the possibilities. Our presented algorithm is compared with known classical algorithms using the evaluation function of the peak signal-to-noise ratio. For comparison of the methods we are using parameters such as time, CPU usage, and size of compressed data. The comparison is made on benchmark data in color format YUV. Results of our proposed method are comparable and in some cases better than results of standard classical algorithms.
文摘The new MPEG-4 video coding standard enables content-based functions. In order to support the new standard, frames should be decomposed into Video Object Planes （VOP）, each VOP representing a moving object. This paper proposes an image segmentation method to separate moving objects from image sequences. The proposed method utilizes the spatial-temporal information. Spatial segmentation is applied to divide each image into connected areas and to find pre~：ise object boundaries of moving objects. To locate moving objects in image sequences, two consecutive image frames in the temporal direction are examined and a hypothesis testing is performed with Neyman-Pearson criterion. Spatial segmentation produces a spatial segmentation mask, and temporal segmentation yields a change detection mask that indicates moving objects and the background. Then spatial-temporal merging can be used to get the final results. This method has been tested on several images. Experimental results show that this segmentation method is efficient.
基金Supported by the National Natural Science Foundation of China （ No. 60736043, 60672088） and the National Basic Research Program of China （No. 2009CB32005）.
文摘Side information （SI） is one of the key issues in distributed video coding （DVC） and affects the compression performance of DVC largely. This paper proposes an SI refinement algorithm, in which the Wyner-Ziv （WZ） frame is split into two parts based on checkerboard pattern, and the two parts are encoded independently but decoded sequentially. In the decoding process, the part 1 is first decoded with the initial SI and partially decoded part （PDP） 1 is used to improve the motion vectors （MVs） and SI of both parts. At the next stage, the part 2 is decoded with the improved SI and PDP 2 is used to further refine MVs of the part 2. Then, SI of both parts are further refined. Simulation results show that the proposed algorithm can improve the peak signal to noise ratio （PSNR） by up to 1.43 dB when compared with traditional DVC codec.
