M3FEC:Joint Multiple Description Coding and Forward Error Correction for Interactive Multimedia in Multiple Path Transmission

The best-effort internet has inherent limitations on the end-to-end performance for interactive multimedia communications. This paper presents a multiple description coding （MDC） and forward error correction （FEC） based multiple path transmission schemes for interactive multimedia （M3FEC）, which improves the end users’ experience by maximizing a rate-distortion （R-D） based optimization problem. The proposed model considers both the network diversity and the application’s stringent requirements, and combines the individual merits of the three promising technologies of multiple path overlay routing, MDC and FEC. Extensive numerical analysis and PlanetLab experiments demonstrate that M3FEC successfully combats packet losses, error propagation, and unpredictable network dynamics. This method also significantly increases distortion for interactive multimedia by over 10 dB than traditional IP-layer single path transmission in poor network environments, and outperforms the performance achieved by using MDC or FEC alone.

Improved Multiple Descriptions Sinusoidal Coder Adaptive to Packet Loss Rate

To make the multiple descriptions codec adaptive to the packet loss rate, which can minimize the final distortion, a novel adaptive multiple descriptions sinusoidal coder （AMDSC） is proposed, which is based on a sinusoidal model and a noise model. Firstly, the sinusoidal parameters are extracted in the sinusoidal model, and ordered in a decrease manner. Odd indexed and even indexed parameters are divided into two descriptions. Secondly, the output vector from the noise model is split vector quantized. And the two sub-vectors are placed into two descriptions too. Finally, the number of the extracted parameters and the redundancy between the two descriptions are adjusted according to the packet loss rate of the network. Analytical and experimental resuits show that the proposed AMDSC outperforms existing MD speech coders by taking network loss characteristics into account. Therefore, it is very suitable for unreliable channels

Robust multiple description distributed video coding using optimized zero-padding

Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. In MDDVC, zeros are padded to each frame and the resulting big-size video is divided into multiple descriptions. Then, each description is compressed by s hybrid DVC （HDVC） codec and trans- mitted over different channel. When one channel does not work, the lost HDVC description is estimated by the received from other channel, which guarantees the robustness of the system; MDDVC moves the complex motion estimation totally to the decoder so it features low-complexity encoding. In the pre-processing, an optimized zero-padding is also proposed to improve the performance. Experimental results exhibit that the proposed MDDVC scheme achieves better rate-distortion performance and robustness than the referenced especially when packet-loss rate is high.

Chessboard-interpolation-based multiple description video coding

To enhance the robustness of video transmission over noisy channels, this paper presents a multiple description video coding algorithm based on chessboard-interpolation. In the algorithm, the input image is decomposed according to the chessboard pattern, and then interpolated to produce two approximate images with the same resolution. Consequently, the state-of-the-art DCT+MC (Discrete Cosine Transform + Motion Compensation) video codec is independently applied to the two approximate images to generate two descriptions of the original image. In this framework, a fairely good reconstructed image quality is obtained when two descriptions are received simultaneously, while an acceptable reconstructed image quality could be yielded if only one description is available. Moreover, the mismatch between the encoder and the decoder could be effectively controlled through partial coding of the difference signal between two descriptions. In bidirectional video communications, a drift control scheme is further proposed, in which the error drift could be eliminated after the encoder imitating the error concealment actions of the decoder. Since the inherent correlation among adjacent blocks of DCT+MC video coding is efficiently exploited, this algorithm has a better redundancy-rate-distortion (RRD) performance than other multiple description algorithms. Simulation results show that the proposed algorithm is fairly robust while preserves a high compression rate. A more constant reconstructed image quality is achieved over extremely noisy channels, compared with traditional single description coding. In addition, it is observed that the mismatch and the error drift are effectively controlled.

Multiple description video coding based on residuum compensation

As one of the focus areas of robust video coding and transmission, multiple description video coding has attracted comprehensive attention. The low coding efficiency of multiple description video coding is always the major challenge in this field. In order to improve the performance of multiple description video coding, this paper proposes a scheme based on residuum compensation. In this scheme, each original video frame is encoded with a traditional encoder first to get the first description. Then the error residuum of each coded frame is added up to the corresponding original frame and the resulting compensated frame is encoded by another traditional encoder to generate the second description suc- cessively. This work uses JM10.0 of H.264/AVC as video coding codec to conduct the experiments. The experimental results show that the proposed scheme has good coding performance. Compared to state of art traditional single description encoder, the efficiency can be as high as 90%, he. the redundancy is only 10% to 20%.

Complete Multiple Description Mesh-Based Video Coding Scheme and Its Performance

This paper proposes a multiple description (MD) mesh-based motion coding method, which generates two descriptions for mesh-based motion by subsampling the nodes of a right-angled triangular mesh and dividing them into two groups. Motion vectors associated with the mesh nodes in each group are transmitted over distinct channels. With the nodes in each group, two other regular triangular meshes besides the original one can be constructed, and three different prediction images can be reconstructed according to descriptions available. The proposed MD mesh-based motion coding method is then combined with the pairwise correlating transform (PCT), and a complete MD video coding scheme is proposed. Further measures are taken to reduce the mismatch between the encoder and decoder that occurs when only one description is received and the decoder reconstruction is different from the encoder. The performance of the proposed scheme is evaluated using computer simulations, and the results show, compared to Reibman's MD transform coding (MDTC) method, the proposed scheme achieves better redundancy rate distortion (RRD) performance. In packet loss scenario, the proposed scheme outperforms the MDTC method.

Efficient Multiple Description Scalable Video Coding Scheme Based on Weighted Signal Combinations

A simple, efficient multiple description coding （MDC） algorithm was developed based on weighted signal combinations. The scheme uses the standard video encoder with a pre-processing stage to generate multiple descriptions. The decoder then uses a post-processing algorithm to combine the descriptions to provide better image quality. A scalable codec in the MDC system allows the system to provide multiple descriptions and scalability at the same time. In addition, since the different scalable descriptions may have different qualities, a simple averaging process is not optimal. An optimal weighted combination of the two descriptions was developed based on the signal to noise ratios. Compared with the simple average combination, the algorithm significantly improved the video quality, especially with large quality differences between the two descriptions, with gains of up to 3.56 dB.

Multipath Routing of Multiple Description Coded Images in Wireless Networks

Multiple description coding （MDC） generates multiple decodable bitstreams for a source to combat informa- tion loss. In this paper, multipath routing problem for two-description coded images is investigated for traditional and coded wireless networks without and with coding capability at intermediate nodes, respectively. Firstly, we formulate an interference-aware MDC multipath routing for traditional networks by employing a time-division link scheduling method to eliminate wireless interference, and ultimately obtain an optimal path selection corresponding to the minimum achievable distortion. Secondly, for coded networks, we evaluate practical wireless network coding （NC） in delivering descriptions of multiple unicast sessions. While NC increases maximum supporting flow rate of MDC descriptions in wireless networks, possible undecodability of NC mixed information is alleviated by MDC. To minimize achievable distortion, a proposed interference-and-coding-aware MDC multipath routing strikes a good balance between minimizing side effect of wireless interference avoidance and maximizing NC opportunity. Simulation results validate the effectiveness of the two proposed schemes.

Scalable Compression Algorithm for Video Monitoring System

A layered compression algorithm is presented which delivers spatial scalable encoded bit streams for remote video monitoring system. The complexity of the algorithm is modest and is well suited to real time implementation. Based on the layered compression algorithm, a codec system model is established. High-speed video compression can be realized with parallel data compression in this codec system. For image reconstruction, a prediction method using two nearest pix points is presented.