The burst error of wireless channels and the two-state Markov wireless model are analyzed. Based on this model and the coding modes of the video encoder,the channel distortion of inter-coding and intra-coding due to b...The burst error of wireless channels and the two-state Markov wireless model are analyzed. Based on this model and the coding modes of the video encoder,the channel distortion of inter-coding and intra-coding due to burst error is deduced. Then we propose a novel intra refresh scheme in rate-distortion (R-D) framework. This scheme optimizes the error resilience and coding efficiency of wireless video transmission system. It can also stop error propagation and reduce channel distortion effectively. Simulations under different channel conditions verify the improvements of the proposed scheme with respect to error resilience for wireless video communication.展开更多
For video streaming over lossy channels, intra refresh can mitigate the error-propagation effect caused by packet losses Besides some intra-mode macroblocks (MBs) generated by the "Lagrangian rate-distortion" or ...For video streaming over lossy channels, intra refresh can mitigate the error-propagation effect caused by packet losses Besides some intra-mode macroblocks (MBs) generated by the "Lagrangian rate-distortion" or "Sum of absolute difference" mode decision, the encoder or transcoder possibly needs to increase some "forced" intra-mode MBs for robust video streaming. Based on the error-propagation analysis in a group of pictures (GOP), we propose an unequal Forced-Intra-Refresh (FIR) scheme to improve packet loss resilience of video streaming. According to a GOP-level error-propagation model, the proposed unequal FIR scheme can optimally increase the unequal number of forced intra-mode MBs for different frames in a GOP. Simulation results showed that the proposed scheme can effectively enhance the robustness of video streaming under different channel conditions, and achieve about 0. 1-0.9 dB gains over the average FIR scheme in H.264/AVC tools.展开更多
We propose a novel prioritized intra refresh method for the wireless video communication.The proposed method considers the characteristics of the human visual system,the error-sensitivity of the bitstream,and the stat...We propose a novel prioritized intra refresh method for the wireless video communication.The proposed method considers the characteristics of the human visual system,the error-sensitivity of the bitstream,and the state of the time-varying wireless channel jointly.An expected perceptual distortion model was used to adjust the intra refresh rate adaptively.This model consists of the perceptual weight map based on an attention model,the bit error probability map based on bitstream size,and the dynamic channel state information(CSI).Experimental results indicate that,compared with other intra refresh methods that consider only the content of the video or the CSI,the proposed method improves the average peak signal-to-noise ratio(PSNR) of the whole frame by about 0.5 dB,and improves the average PSNR of the attention-area by about 0.8 dB.展开更多
Intra refresh is an efficient and simple technique for suppressing temporal error propagation in video transmission over error-prone networks. However, most existing intra refresh algorithms do not make good use of th...Intra refresh is an efficient and simple technique for suppressing temporal error propagation in video transmission over error-prone networks. However, most existing intra refresh algorithms do not make good use of the visual perceptual mechanism of the Human Visual System (HVS). This paper presents an intra refresh algorithm based on an attention model and a loss impact model. Intra refresh rates are allowed to vary for different image regions according to the HVS characteristic and the channel conditions to protect the most important macro-blocks against packet loss. A joint source-channel rate-distortion model was de- veloped taking into account the HVS characteristic to achieve an optimal end-to-end distortion for a better subjective quality. Tests demonstrate that, for the same bit rate and packet loss rate, this method provides a much better subjective feeling than existing intra refresh methods.展开更多
This paper focuses on the mechanism underlying the overall delay of a real-time video communication system from the time of capture at the encoder to the time of display at the decoder. A detailed analysis is presente...This paper focuses on the mechanism underlying the overall delay of a real-time video communication system from the time of capture at the encoder to the time of display at the decoder. A detailed analysis is presented to illustrate the delay problem. We then describe a statistically uniform intra-block refresh scheme for very low delay video communication. By scattering intra-blocks uniformly into continuous frames, the overall delay is significantly decreased, and object changes in the scene could be presented to the end user instantly. For comparison, the overall delay and the peak signal-to-noise ratio (PSNR) performance are tested. The experiment results show that an average of approximately 0.1 dB PSNR gain on average is obtained relative to random intra-macroblock refresh algorithm in H.264 JM, and the end-to-end delay performance is significantly improved.展开更多
文摘The burst error of wireless channels and the two-state Markov wireless model are analyzed. Based on this model and the coding modes of the video encoder,the channel distortion of inter-coding and intra-coding due to burst error is deduced. Then we propose a novel intra refresh scheme in rate-distortion (R-D) framework. This scheme optimizes the error resilience and coding efficiency of wireless video transmission system. It can also stop error propagation and reduce channel distortion effectively. Simulations under different channel conditions verify the improvements of the proposed scheme with respect to error resilience for wireless video communication.
基金Project (No. 60332030) supported by the National Natural ScienceFoundation of China
文摘For video streaming over lossy channels, intra refresh can mitigate the error-propagation effect caused by packet losses Besides some intra-mode macroblocks (MBs) generated by the "Lagrangian rate-distortion" or "Sum of absolute difference" mode decision, the encoder or transcoder possibly needs to increase some "forced" intra-mode MBs for robust video streaming. Based on the error-propagation analysis in a group of pictures (GOP), we propose an unequal Forced-Intra-Refresh (FIR) scheme to improve packet loss resilience of video streaming. According to a GOP-level error-propagation model, the proposed unequal FIR scheme can optimally increase the unequal number of forced intra-mode MBs for different frames in a GOP. Simulation results showed that the proposed scheme can effectively enhance the robustness of video streaming under different channel conditions, and achieve about 0. 1-0.9 dB gains over the average FIR scheme in H.264/AVC tools.
文摘We propose a novel prioritized intra refresh method for the wireless video communication.The proposed method considers the characteristics of the human visual system,the error-sensitivity of the bitstream,and the state of the time-varying wireless channel jointly.An expected perceptual distortion model was used to adjust the intra refresh rate adaptively.This model consists of the perceptual weight map based on an attention model,the bit error probability map based on bitstream size,and the dynamic channel state information(CSI).Experimental results indicate that,compared with other intra refresh methods that consider only the content of the video or the CSI,the proposed method improves the average peak signal-to-noise ratio(PSNR) of the whole frame by about 0.5 dB,and improves the average PSNR of the attention-area by about 0.8 dB.
基金Supported by the National Natural Science Foundation of China(No. 60572081)
文摘Intra refresh is an efficient and simple technique for suppressing temporal error propagation in video transmission over error-prone networks. However, most existing intra refresh algorithms do not make good use of the visual perceptual mechanism of the Human Visual System (HVS). This paper presents an intra refresh algorithm based on an attention model and a loss impact model. Intra refresh rates are allowed to vary for different image regions according to the HVS characteristic and the channel conditions to protect the most important macro-blocks against packet loss. A joint source-channel rate-distortion model was de- veloped taking into account the HVS characteristic to achieve an optimal end-to-end distortion for a better subjective quality. Tests demonstrate that, for the same bit rate and packet loss rate, this method provides a much better subjective feeling than existing intra refresh methods.
基金Project partially supported by the Fundamental Research Funds for the Central Universitiesthe 111 Project Program for Changjiang Scholars and Innovative Research Team in University (No. B08038),China
文摘This paper focuses on the mechanism underlying the overall delay of a real-time video communication system from the time of capture at the encoder to the time of display at the decoder. A detailed analysis is presented to illustrate the delay problem. We then describe a statistically uniform intra-block refresh scheme for very low delay video communication. By scattering intra-blocks uniformly into continuous frames, the overall delay is significantly decreased, and object changes in the scene could be presented to the end user instantly. For comparison, the overall delay and the peak signal-to-noise ratio (PSNR) performance are tested. The experiment results show that an average of approximately 0.1 dB PSNR gain on average is obtained relative to random intra-macroblock refresh algorithm in H.264 JM, and the end-to-end delay performance is significantly improved.