This paper presented an object-based fast motion estimation (ME) algorithm for object-based texture coding in moving picture experts group four (MPEG-4), which takes full advantage of the shape information of video ob...This paper presented an object-based fast motion estimation (ME) algorithm for object-based texture coding in moving picture experts group four (MPEG-4), which takes full advantage of the shape information of video object. Compared with the full search (FS) algorithm, the proposed algorithm can significantly speed the ME process. The speed of ME using the proposed algorithm is faster than that using new three-step search (NTSS), four-step search (4SS), diamond search (DS), and block-based gradient descent search (BBGDS) algorithms with similar motion compensation (MC) errors. The proposed algorithm can be combined with other fast ME algorithm to make the ME process faster.展开更多
Frame skipping in low bit video coding could significantly reduce the visual quality of reconstructed video. At the same time, if the complexity of the video sequence remains high for a long period, then driving up th...Frame skipping in low bit video coding could significantly reduce the visual quality of reconstructed video. At the same time, if the complexity of the video sequence remains high for a long period, then driving up the long term average bit rate, the only resort of MPEG-4 Q2 rate control algorithm results in using a high quantization scale, which shows a poor visual quality of the reconstructed video. This paper analyzes the main causes of frame skipping in current MPEG-4 frame rate control scheme, and presents a new rate control algorithm based on the quadratic R-D model over a CBR channel. Key features of the present work are: 1) the bits allocated to each P-frame or B-frame are in proportion to its distance from the end of this GOP, i.e. more bits are allocated to the frames that are nearer to their reference Ⅰ-frame; 2) the target buffer level is changeable in the GOP, at the end of each GOP(five P-frames or B-frames), the target buffer level is linearly reduced from 1/2 to 1/4 of buffer size, to other frames, the target buffer level is set to 1/2 of buffer size; 3) a selective and judicious use of the reduced resolution mode, in addition to a modulation of the quantization scale parameter, is to control the average long term bit rate. Experimental results with different video sequences of varied complexity, encoded at low bit rates show better efficacy of the proposed algorithm than MPEG-4 Q2 rate control scheme, and the experimental results also show that the improved algorithm has significantly reduced the number of frame skipping, increased the overall PSNR, and improved the perceptual quality.展开更多
The new MPEG-4 video coding standard enables content-based functions. In order to support the new standard, frames should be decomposed into Video Object Planes （VOP）, each VOP representing a moving object. This pap...The new MPEG-4 video coding standard enables content-based functions. In order to support the new standard, frames should be decomposed into Video Object Planes （VOP）, each VOP representing a moving object. This paper proposes an image segmentation method to separate moving objects from image sequences. The proposed method utilizes the spatial-temporal information. Spatial segmentation is applied to divide each image into connected areas and to find pre~：ise object boundaries of moving objects. To locate moving objects in image sequences, two consecutive image frames in the temporal direction are examined and a hypothesis testing is performed with Neyman-Pearson criterion. Spatial segmentation produces a spatial segmentation mask, and temporal segmentation yields a change detection mask that indicates moving objects and the background. Then spatial-temporal merging can be used to get the final results. This method has been tested on several images. Experimental results show that this segmentation method is efficient.展开更多
基金National High Technology Research and De-velopment Program of China (863 Program)(No.2003AA103810)
文摘This paper presented an object-based fast motion estimation (ME) algorithm for object-based texture coding in moving picture experts group four (MPEG-4), which takes full advantage of the shape information of video object. Compared with the full search (FS) algorithm, the proposed algorithm can significantly speed the ME process. The speed of ME using the proposed algorithm is faster than that using new three-step search (NTSS), four-step search (4SS), diamond search (DS), and block-based gradient descent search (BBGDS) algorithms with similar motion compensation (MC) errors. The proposed algorithm can be combined with other fast ME algorithm to make the ME process faster.
文摘Frame skipping in low bit video coding could significantly reduce the visual quality of reconstructed video. At the same time, if the complexity of the video sequence remains high for a long period, then driving up the long term average bit rate, the only resort of MPEG-4 Q2 rate control algorithm results in using a high quantization scale, which shows a poor visual quality of the reconstructed video. This paper analyzes the main causes of frame skipping in current MPEG-4 frame rate control scheme, and presents a new rate control algorithm based on the quadratic R-D model over a CBR channel. Key features of the present work are: 1) the bits allocated to each P-frame or B-frame are in proportion to its distance from the end of this GOP, i.e. more bits are allocated to the frames that are nearer to their reference Ⅰ-frame; 2) the target buffer level is changeable in the GOP, at the end of each GOP(five P-frames or B-frames), the target buffer level is linearly reduced from 1/2 to 1/4 of buffer size, to other frames, the target buffer level is set to 1/2 of buffer size; 3) a selective and judicious use of the reduced resolution mode, in addition to a modulation of the quantization scale parameter, is to control the average long term bit rate. Experimental results with different video sequences of varied complexity, encoded at low bit rates show better efficacy of the proposed algorithm than MPEG-4 Q2 rate control scheme, and the experimental results also show that the improved algorithm has significantly reduced the number of frame skipping, increased the overall PSNR, and improved the perceptual quality.
文摘The new MPEG-4 video coding standard enables content-based functions. In order to support the new standard, frames should be decomposed into Video Object Planes （VOP）, each VOP representing a moving object. This paper proposes an image segmentation method to separate moving objects from image sequences. The proposed method utilizes the spatial-temporal information. Spatial segmentation is applied to divide each image into connected areas and to find pre~：ise object boundaries of moving objects. To locate moving objects in image sequences, two consecutive image frames in the temporal direction are examined and a hypothesis testing is performed with Neyman-Pearson criterion. Spatial segmentation produces a spatial segmentation mask, and temporal segmentation yields a change detection mask that indicates moving objects and the background. Then spatial-temporal merging can be used to get the final results. This method has been tested on several images. Experimental results show that this segmentation method is efficient.
