Technique of Error Concealment for Block-Based Image Coding Using Genetic Algorithm

Since real world communication channels are not error free, the coded data transmitted on them may be corrupted, and block based image coding systems are vulnerable to transmission impairment. So the best neighborhood match method using genetic algorithm is used to conceal the error blocks. Experimental results show that the searching space can be greatly reduced by using genetic algorithm compared with exhaustive searching method, and good image quality is achieved. The peak signal noise ratios(PSNRs) of the restored images are increased greatly.

An error resilient scheme for H.264 video coding based on distortion estimated mode decision and nearest neighbor error concealment

Although H.264 video coding standard provides several error resilience tools, the damage caused by error propagation may still be tremendous. This work is aimed at developing a robust and standard-compliant error resilient coding scheme for H.264and uses techniques of mode decision, data hiding, and error concealment to reduce the damage from error propagation. This paper proposes a system with two error resilience techniques that can improve the robustness of H.264 in noisy channels. The first technique is Nearest Neighbor motion compensated Error Concealment (NNEC) that chooses the nearest neighbors in the reference frames for error concealment. The second technique is Distortion Estimated Mode Decision (DEMD) that selects an optimal mode based on stochastically distorted frames. Observed simulation results showed that the rate-distortion performances of the proposed algorithms are better than those of the compared algorithms.

Analysis and application of error concealment tools in AVS-M decoder

Audio Video coding Standard (AVS) is the latest audio and video coding standard of China. AVS Part 7 (also known as AVS-M) targets mobility applications where error concealment is of great importance. This paper first briefly introduces the general concept of error concealment. Then two error concealment schemes are proposed and implemented on AVS-M decoder under different test conditions. Simulation results of the schemes and suggestions on how to use these tools are also provided.

Temporal Shape Error Concealment for Video Objects

A novel temporal shape error concealment technique is proposed, which can he used in the context of object-based video coding schemes. In order to reduce the effect of the shape variations of a video object, the curvature scale space （CSS） technique is adopted to extract features, and then these features are used for boundary matching between the current frame and the previous frame. Because the temporal, spatial and sta- tistical video contour information are all considered, the proposed method can find the optimal matching, which is used to replace the damaged contours. The simulation results show that the proposed algorithm achieves better subjective, objective qualities and higher efficiency than those previously developed methods.

Temporal Error Concealment Technique for MPEG-4 Video Streams

Concerning inter4v mode employed widely in MPEG-4 video, a new temporal error concealment scheme for MPEG-4 video sequences is proposed, which can selectively interpolate one or four motion vectors （MVs） for the missing macroblock （ MB ） according to the estimated MB coding mode. Performance of the proposed scheme is compared with the existing schemes with multiple testing sequences at different bit error rates. Experimental results show that the proposed algorithm can mask the impairments caused by transmission errors more efficiently than 0 MV and average MV methods by consuming more time for different bit error rates. It has an acceptable image quality close to that obtained by the selective motion vector matching （ SMVM ） algorithm, while taking less than half of cycles of operations. The proposed concealment scheme is suitable for low complexity video real-time implementations.

A MODIFIED EDGE-ORIENTED SPATIAL INTERPOLATION ALGORITHM FOR CONSECUTIVE BLOCKS ERROR CONCEALMENT

This paper proposes a low-complexity spatial-domain Error Concealment (EC) algorithm for recovering consecutive blocks error in still images or Intra-coded (I) frames of video sequences. The proposed algorithm works with the following steps. Firstly the Sobel operator is performed on the top and bottom adjacent pixels to detect the most likely edge direction of current block area. After that one-Dimensional (1D) matching is used on the available block boundaries. Displacement between edge direction candidate and most likely edge direction is taken into consideration as an important factor to improve stability of 1D boundary matching. Then the corrupted pixels are recovered by linear weighting interpolation along the estimated edge direction. Finally the interpolated values are merged to get last recovered picture. Simulation results demonstrate that the proposed algorithms obtain good subjective quality and higher Peak Signal-to-Noise Ratio (PSNR) than the methods in literatures for most images.

Frame loss error concealment for SVC

Scalable video coding (SVC), as the Scalable Extension of H.264/AVC, is an ongoing international video coding standard designed for network adaptive or device adaptive applications and also offers high coding efficiency. However, packet losses often occur over unreliable networks even for base layer of SVC and have severe impact on the playback quality of compressed video. Until now, no literature has discussed error concealment support for standard SVC bit-stream. In this paper, we provide robust and effective error concealment techniques for SVC with spatial scalability. Experimental results showed that the proposed methods provide substantial improvement, both subjectively and objectively, without a significant complexity overhead.

Error concealment in pixel based Wyner-Ziv video coding

In the Wyner-Ziv(WZ) video coding paradigm, a virtual correlation channel is assumed between the quantized source and the side information(SI) at the decoder, and channel coding is applied to achieve compression. In this paper, errors caused by the virtual correlation channel are addressed and an error concealment approach is proposed for pixel-based WZ video coding. In the approach, errors after decoding are classified into two types. Type 1 errors are caused by residual bit errors after channel decoding, while type 2 errors are due to low quality of SI in part of a frame which causes SI not lying within the quantization bin of a decoded quantized pixel value. Two separate strategies are respectively designed to detect and conceal the two types of errors. Simulations are carried out and results are presented to demonstrate the effectiveness of the proposed approach.

Content-adaptive robust error concealment for packet-lossy H.264 video streaming

In this paper, we present a spatio-temporal post-processing error concealment (EC) algorithm designed initially for a H.264 video-streaming scheme over packet-lossy networks. It aims at optimizing the subjective quality of the restored video under the constraints of low delay and computational complexity, which are critical to real-time applications and portable devices having limited resources. Specifically, it takes into consideration the physical property of motion field in order to achieve more meaningful perceptual video quality, in addition to the improved objective PSNR. Further, a simple bilinear spatial interpolation approach is combined with the improved boundary-match (B-M) based temporal EC approach according to texture and motion activity analysis. Finally, we propose a low complexity temporal EC method based on motion vector interpolation as a replacement of the B-M based approach in the scheme under low-computation requirement, or as a complement to further improve the scheme's performance in applications having enough computation resources. Extensive experiments demonstrated that the proposal features not only better reconstruction, objectively and subjectively, than JM benchmark, but also robustness to different video sequences.

A NOVEL TEMPORAL ERROR CONCEALMENT METHOD BASED ON FUZZY REASONING FOR H.264

In this paper,a fuzzy reasoning based temporal error concealment method is proposed. The basic temporal error concealment is implemented by estimating Motion Vector (MV) of the lost MacroBlock (MB) from its neighboring MVs. Which MV is the most proper one is evaluated by some criteria. Generally,two criteria are widely used,namely Side Match Distortion (SMD) and Sum of Absolute Difference (SAD) of corresponding MV. However,each criterion could only partly describe the status of lost block. To accomplish the judgement more accurately,the two measures are considered together. Thus a refined measure based on fuzzy reasoning is adopted to balance the effects of SMD and SAD. Terms SMD and SAD are regarded as fuzzy input and the term ‘similarity’ as output to complete fuzzy reasoning. Result of fuzzy reasoning represents how the tested MV is similar to the original one. And k-means clustering technique is performed to define the membership function of input fuzzy sets adaptively. According to the experimental results,the concealment based on new measure achieves better performance.

Network-aware perceptual error concealment method for H.264 video with side information

In order to improve the video quality of transmission with data loss,a spatial and temporal error concealment method was proposed,which considered both the state information of the network and the perceptual weight of the video content.The proposed method dynamically changed the reliability weight of the neighboring macroblock,which was used to conceal the lost macroblocks according to the packet loss rate of the current channel state.The perceptual weight map was utilized as side information to do weighted pixel interpolation and side-match based motion compensation for spatial and temporal error concealment,respectively.And the perceptual weight of the neighboring macroblocks was adaptively modified according to the perceptual weight of the lost macroblocks.Compared with the method used in H.264 joint model,experiment results show that the proposed method performs well both in subjective video quality and objective video quality,and increases the average peak signal-to-noise ratio(PSNR) of the whole frame by about 0.4 dB when the video bitstreams are transmitted with packets loss.

SPATIAL ERROR CONCEALMENT BASED ON MOJETTE TRANSFORM

This letter presents a novel spatial error concealment algorithm for the H.264 video coding. The error concealment algorithm is based on directional interpolation. Mojette transform is used to estimate the orientation features of the damaged blocks,and the image is interpolated in the appro-priate directions. The proposed method is compared with bilinear interpolation algorithm in the ref-erence implementation of H.264 and all directional interpolation. Experimental results prove that the proposed algorithm has better subjective and objective image reconstruction quality.

基于VMD-ORELM-EC的超短期风速组合预测模型

为提高超短期风速预测的精度,文章提出一种基于变分模态分解(variational mode decomposition,VMD)、离群鲁棒极限学习机(outlier-robust extreme learning machine,ORELM)和误差修正(error correction,EC)的超短期风速组合预测模型VMD-ORELM-EC。首先利用VMD将原始风速序列分解,并对每个分解子序列分别建立ORELM模型,将各子模型预测结果相加得到模型初步预测序列;然后将原始风速序列与初步预测序列相减得到模型的误差序列,并对误差序列进行VMD分解,对分解得到的误差子序列建立ORELM模型,从而得到误差预测序列;最后将模型的初步预测序列与误差预测序列组合得到最终的风速预测序列。利用该文提出的预测模型对北京测风塔实测的风速数据进行分析,结果表明模型可以有效挖掘风速序列特性,在超短期风速预测上具有较高的预测性能。

Edge-Oriented Spatial Interpolation for Error Concealment of Consecutive Blocks

This paper proposes a low-complexity spatial-domain error concealment （EC） algorithm for recovering consecutive blocks error in still images or intra-coded （I） frames of video sequences. The proposed algorithm works with the following steps. Firstly the Sobel operator is performed on the top and bottom adjacent pixels to detect the most probable edge direction of current block area. After that one-dimensional （1-D） matching is used on the available block boundaries. Displacement between edge direction candidate and most probable edge direction is taken into consideration as an important factor to improve stability of 1-D boundary matching. Then the corrupted pixels are recovered by linear weighting interpolation along the estimated edge direction. Finally the interpolated values are merged to get last recovered picture. Simulation results demonstrate that the proposed algorithms obtain good subjective quality and higher PSNR than the methods in literatures for most images.

EC预报数据在中国近海的适用性研究

欧洲中期天气预报中心(简称EC)的10 m风场数据在沿海有较高的参考性和使用频率,但尚未有研究系统地针对不同海域对该数据进行评估。本文利用EC预报的10 m风场数据,与中国近海22个浮标的10 m风场结果进行对比,检验EC 10 m风场预报性能,并挑选3个经过浮标点位的台风和两次典型的冷空气大风过程,检验其在台风和冷空气过程下的预报性能。结果表明:EC预报数据与浮标实测风速的相关性总体较好。在风力小于4级时,EC 10 m风速预报数据偏大,在风力大于4级时,预报数据偏小,在风力等级为3~5级时,预报数据较为准确。在不同风向条件下,EC预报10 m风向的平均误差大部分在0°~20°。风力等级越小,风向预报偏差越大,反之预报偏差越小。EC预报数据对于台风引起的风向变化有较好的反应,且风速较低时,风速预报数据表现较好,而对于台风最大风速值的预报则存在较大误差。EC预报结果能较好地反映两次冷空气过程引起的风向变化。风速越小,EC预报的误差也越小,随着风力等级的增大,预报误差明显增大。EC对大风的风速预报偏小,误差偏大。

An Error Concealment Approach Based on H.263 Video Decoding in Pixel Domain

The video bit stream coded by H.263 recommendation is vulnerable to channel errors. For coded information, bit errors could result in error propagation, loss of synchronization and severe data loss. All of these will lead to the descent of image qualities in the end. In this paper, in order to solve this problem, we present a receiver based error concealment algorithm that uses information in pixel domain to detect errors and resynchronization, identify the location of the affected blocks and estimate erroneous data. The concealment algorithm is kept simple, no additional bit rate is required, and no modification is necessary to an existing encoder, so the real time decoding and concealment are possible. Computer emulation results show that the image quality after error concealment is significantly improved.

Multi-Level Error Detection and Concealment Algorithm to Improve Speech Quality in GSM Full Rate Speech Codecs

Digital mobile telecommunication systems, such as the global system for mobile （GSM） system, want to further improve speech communication quality without changing the channel encoders and decoders. Speech quality is most affected by residual bit errors in received speech frames. Conventional methods use binary decision strategies for error detection and concealment in frames. This paper presents a multi-level error detection and concealment algorithm for GSM full rate speech codec systems. The algorithm uses multi-source knowledge to detect and conceal speech frame errors at the frame, parameter, and even bit levels. Tests show that most corrupted frames can be appropriately concealed by this algorithm, resulting in MOS gains of more than 50% for real-world data tests.

EC细网格产品在复杂海岛地形条件下的大风滚动订正释用

应用EC细网格资料和站点实况资料,结合风速高度订正和分风向误差风速分析,建立考虑地形的PP法模型。释用结果表明:考虑地形的PP法模型能有效提高EC细网格产品大风预报精度,平均绝对误差低至2.57 m/s;应用卡尔曼滤波法实时吸收最新资料,能实现释用模型回归系数的滚动更新,预报风速平均绝对误差由2.91 m/s降至2.66 m/s。

A Novel Frame Error Concealment Scheme Based on Gain Control for TCX Audio Codec

A novel frame error concealment scheme is proposed to improve the decoded audio quality of the receiver for transform coded excitation（TCX）audio codec.This scheme,which is a gain control approach based on the stability of linear predictive coding（LPC）filter,predicts the lost frames by utilizing the linear spectrum frequency and different continuous attenuation factor of different kinds of lost frames.Signal noise ratio（SNR）test and multiple stimuli with hidden reference and anchor（MUSHRA）test are conducted to evaluate the performance of this approach in adaptive multi-rate wideband plus（AMR-WB＋）audio codec.Compared with the original frame error concealment scheme,our scheme achieves better audio recovery quality in AMR-WB＋audio codec.

MOTION VECTOR RECOVERY METHOD BASED ON MEAN SHIFT PROCEDURE

This letter presents a novel Motion Vector (MV) recovery method which is based on Mean Shift (MS) procedure. According to motion continuity, MVs in local area should be similar. If projecting MV into 2-D feature space, local MVs in the feature space tend to cluster closely. To estimate the lost MVs in local area, recovery of lost MVs is modeled as clustering operation. MS procedure is applied to enforce each lost MV in the feature space to shift to the position where dominant MVs are gathered. Meanwhile, bandwidth estimation is statistically characterized by the variation of local standard de-viations; weighted value calculation is determined by estimation of overall standard deviation. Simu-lation results demonstrate their better performance when compared with other MV recovery ap-proaches and low computation cost.