Multiple description scalable video coding based on 3D lifted wavelet transform

In this work, a new method to deal with the unconnected pixels in motion compensated temporal filtering (MCTF) is presented, which is designed to improve the performance of 3D lifted wavelet coding. Furthermore, multiple description scalable coding (MDSC) is investigated, and novel MDSC schemes based on 3D wavelet coding are proposed, using the lifting imple- mentation of temporal filtering. The proposed MDSC schemes can avoid the mismatch problem in multiple description video coding, and have high scalability and robustness of video transmission. Experimental results showed that the proposed schemes are feasible and adequately effective.

Video over IP using standard-compatible multiple description coding: an IETF proposal

Standard-compatible multiple description coding (MDC) and layered coding (LC) are efficient ways to ensure erasure resilient, scalable transmission of encoded multimedia sources via RTP, allowing a gradual degradation of the application quality with increasing packet loss rate and decreasing bandwidth/throughput on the network. In this paper we review the stan- dard-compatible framework proposed to IETF. Alternative techniques such as robust source coding and channel coding techniques (ARQ: automatic repeat request, FEC: forward error correction) are presented; their integration into the proposed framework is also discussed. The performances of MDC and LC either coupled with channel coding or not, are summarized by reference to current literature. Typical cases and examples are illustrated.

Multiple description coding with spatial-temporal hybrid interpolation for video streaming in peer-to-peer networks

In this paper, we present an innovative design of multiple description coding with spatial-temporal hybrid interpola- tion (MDC-STHI) for peer-to-peer (P2P) video streaming. MDC can be effective in P2P networks because the nature of overlay routing makes path diversity more feasible. However, most MDC schemes require a redesign of video coding systems and are not cost-effective for wide deployment. We base our work on multiple state video coding, a form of MDC that can utilize standard codecs. Two quarter-sized video bit streams are generated as redundancies and embedded in the original-sized streams. With MDC-STHI, the nodes in P2P network can adjust the streaming traffic to satisfy the constraints of their devices and network environment. By design, the redundancies are used to compensate for missing frames, and can also be streamed independently to fulfill certain needs of low rate, low resolution applications. For better error concealment, optimal weights for spatial and temporal interpolation are determined at the source, quantized, and included in redundancies.

Improved Multiple Descriptions Sinusoidal Coder Adaptive to Packet Loss Rate

To make the multiple descriptions codec adaptive to the packet loss rate, which can minimize the final distortion, a novel adaptive multiple descriptions sinusoidal coder （AMDSC） is proposed, which is based on a sinusoidal model and a noise model. Firstly, the sinusoidal parameters are extracted in the sinusoidal model, and ordered in a decrease manner. Odd indexed and even indexed parameters are divided into two descriptions. Secondly, the output vector from the noise model is split vector quantized. And the two sub-vectors are placed into two descriptions too. Finally, the number of the extracted parameters and the redundancy between the two descriptions are adjusted according to the packet loss rate of the network. Analytical and experimental resuits show that the proposed AMDSC outperforms existing MD speech coders by taking network loss characteristics into account. Therefore, it is very suitable for unreliable channels

Iterative Soft Decoding of Multiple Description Image over Wireless Channel

Motivated by recent results in multiple description image coding over wireless networks, we propose a scheme for transmission of multiple descriptions through hybrid packet loss and additive white Gaussian noise channel. Each description is coded into multiple bitstreams by applying SPIHT coding on wavelet trees along spatial orientations and each stream is further compressed using arithmetic code. Use of error resilient entropy coding (EREC) is proposed in literature for synchronization requirement of variable length codes, but EREC is not compatible with iterative soft-in soft-out decoding of arithmetic code at the receiver. We propose the application of EREC assisted by state and tail bits (ERECST) in conjunction with iterative decoding of arithmetic code at receiver for reconstructing the multiple description coded image over packet loss and Gaussian noise channel. Experimental results demonstrate that an additional gain of 7 dB in PSNR is obtained over existing scheme.

LOW-COMPLEXITY REDUNDANCY INSERTION IN MULTIPLE DESCRIPTION CODING

Multiple description coding has recently been proposed as a joint source and channel coding to solve the problem of robust image transmission over unreliable network, and it can offer a variety of tradeoff between signal redundancy and transmission robustness. In this letter, a novel pre- and post-processing method with flexible redundancy insertion for polyphase downsampling multiple de- scription coding is presented. The proposed method can be implemented as pre- and post-processing to all standards for image and video communications, with obvious advantages. Simulation results show that this approach can reduce the computational complexity while provide a flexible redundancy in- sertion to make the system robust for any packet loss situation over different networks.

Robust multiple description distributed video coding using optimized zero-padding

Distributed video coding （DVC） arouses high interests due to its property of low-complexity encoding. This paper proposes a robust multiple description DVC （MDDVC） under the constraint of low-complexity encoding. In MDDVC, zeros are padded to each frame and the resulting big-size video is divided into multiple descriptions. Then, each description is compressed by s hybrid DVC （HDVC） codec and trans- mitted over different channel. When one channel does not work, the lost HDVC description is estimated by the received from other channel, which guarantees the robustness of the system; MDDVC moves the complex motion estimation totally to the decoder so it features low-complexity encoding. In the pre-processing, an optimized zero-padding is also proposed to improve the performance. Experimental results exhibit that the proposed MDDVC scheme achieves better rate-distortion performance and robustness than the referenced especially when packet-loss rate is high.

Chessboard-interpolation-based multiple description video coding

To enhance the robustness of video transmission over noisy channels, this paper presents a multiple description video coding algorithm based on chessboard-interpolation. In the algorithm, the input image is decomposed according to the chessboard pattern, and then interpolated to produce two approximate images with the same resolution. Consequently, the state-of-the-art DCT+MC (Discrete Cosine Transform + Motion Compensation) video codec is independently applied to the two approximate images to generate two descriptions of the original image. In this framework, a fairely good reconstructed image quality is obtained when two descriptions are received simultaneously, while an acceptable reconstructed image quality could be yielded if only one description is available. Moreover, the mismatch between the encoder and the decoder could be effectively controlled through partial coding of the difference signal between two descriptions. In bidirectional video communications, a drift control scheme is further proposed, in which the error drift could be eliminated after the encoder imitating the error concealment actions of the decoder. Since the inherent correlation among adjacent blocks of DCT+MC video coding is efficiently exploited, this algorithm has a better redundancy-rate-distortion (RRD) performance than other multiple description algorithms. Simulation results show that the proposed algorithm is fairly robust while preserves a high compression rate. A more constant reconstructed image quality is achieved over extremely noisy channels, compared with traditional single description coding. In addition, it is observed that the mismatch and the error drift are effectively controlled.

Efficient Multiple Description Scalable Video Coding Scheme Based on Weighted Signal Combinations

A simple, efficient multiple description coding （MDC） algorithm was developed based on weighted signal combinations. The scheme uses the standard video encoder with a pre-processing stage to generate multiple descriptions. The decoder then uses a post-processing algorithm to combine the descriptions to provide better image quality. A scalable codec in the MDC system allows the system to provide multiple descriptions and scalability at the same time. In addition, since the different scalable descriptions may have different qualities, a simple averaging process is not optimal. An optimal weighted combination of the two descriptions was developed based on the signal to noise ratios. Compared with the simple average combination, the algorithm significantly improved the video quality, especially with large quality differences between the two descriptions, with gains of up to 3.56 dB.

Multiple description video coding based on residuum compensation

As one of the focus areas of robust video coding and transmission, multiple description video coding has attracted comprehensive attention. The low coding efficiency of multiple description video coding is always the major challenge in this field. In order to improve the performance of multiple description video coding, this paper proposes a scheme based on residuum compensation. In this scheme, each original video frame is encoded with a traditional encoder first to get the first description. Then the error residuum of each coded frame is added up to the corresponding original frame and the resulting compensated frame is encoded by another traditional encoder to generate the second description suc- cessively. This work uses JM10.0 of H.264/AVC as video coding codec to conduct the experiments. The experimental results show that the proposed scheme has good coding performance. Compared to state of art traditional single description encoder, the efficiency can be as high as 90%, he. the redundancy is only 10% to 20%.

Multipath Routing of Multiple Description Coded Images in Wireless Networks

Multiple description coding （MDC） generates multiple decodable bitstreams for a source to combat informa- tion loss. In this paper, multipath routing problem for two-description coded images is investigated for traditional and coded wireless networks without and with coding capability at intermediate nodes, respectively. Firstly, we formulate an interference-aware MDC multipath routing for traditional networks by employing a time-division link scheduling method to eliminate wireless interference, and ultimately obtain an optimal path selection corresponding to the minimum achievable distortion. Secondly, for coded networks, we evaluate practical wireless network coding （NC） in delivering descriptions of multiple unicast sessions. While NC increases maximum supporting flow rate of MDC descriptions in wireless networks, possible undecodability of NC mixed information is alleviated by MDC. To minimize achievable distortion, a proposed interference-and-coding-aware MDC multipath routing strikes a good balance between minimizing side effect of wireless interference avoidance and maximizing NC opportunity. Simulation results validate the effectiveness of the two proposed schemes.

Complete Multiple Description Mesh-Based Video Coding Scheme and Its Performance

This paper proposes a multiple description (MD) mesh-based motion coding method, which generates two descriptions for mesh-based motion by subsampling the nodes of a right-angled triangular mesh and dividing them into two groups. Motion vectors associated with the mesh nodes in each group are transmitted over distinct channels. With the nodes in each group, two other regular triangular meshes besides the original one can be constructed, and three different prediction images can be reconstructed according to descriptions available. The proposed MD mesh-based motion coding method is then combined with the pairwise correlating transform (PCT), and a complete MD video coding scheme is proposed. Further measures are taken to reduce the mismatch between the encoder and decoder that occurs when only one description is received and the decoder reconstruction is different from the encoder. The performance of the proposed scheme is evaluated using computer simulations, and the results show, compared to Reibman's MD transform coding (MDTC) method, the proposed scheme achieves better redundancy rate distortion (RRD) performance. In packet loss scenario, the proposed scheme outperforms the MDTC method.

M3FEC:Joint Multiple Description Coding and Forward Error Correction for Interactive Multimedia in Multiple Path Transmission

The best-effort internet has inherent limitations on the end-to-end performance for interactive multimedia communications. This paper presents a multiple description coding （MDC） and forward error correction （FEC） based multiple path transmission schemes for interactive multimedia （M3FEC）, which improves the end users’ experience by maximizing a rate-distortion （R-D） based optimization problem. The proposed model considers both the network diversity and the application’s stringent requirements, and combines the individual merits of the three promising technologies of multiple path overlay routing, MDC and FEC. Extensive numerical analysis and PlanetLab experiments demonstrate that M3FEC successfully combats packet losses, error propagation, and unpredictable network dynamics. This method also significantly increases distortion for interactive multimedia by over 10 dB than traditional IP-layer single path transmission in poor network environments, and outperforms the performance achieved by using MDC or FEC alone.

A NEW UEP SCHEME FOR ROBUST VIDEO TRANSMISSION IN LDPC CODED MIMO-OFDM SYSTEM

In order to improve the video transmission performance in Multiple-Input Multiple-Output Orthogonal Frequency Division Multiplexing （MIMO-OFDM） system, a new scheme, which integrates Multiple Description Coding （MDC）, Low Density Parity Check （LDPC） coding and hybrid space time coding, is proposed in this letter. In particular, a hybrid space time coding algorithm is combined with LDPC codes to perform Unequal Error Protection （UEP） of MDC encoded video streams. Comparing with the UEP transmission with only LDPC codes, the proposed scheme achieves more than ldB gain in terms of Signal to Noise Ratio （SNR） when the Peak Signal to Noise Ratio （PSNR） of reconstructed video is above 30dB.

基于Compressed Sensing框架的图像多描述编码方法

基于新兴的压缩感知(Compressed Sensing,CS)理论,提出了一种抗丢包能力强且结构简单易实现的多描述编码方法.首先对变换后的图像进行交织抽取分块,再对各子块进行随机观测、量化、打包形成多个描述子码流.解码端根据接收码流情况通过求解优化问题重建原图像.由于随机观测过程简单易实现,故该方法可以以较低的计算复杂度构造出较多的描述子.实验结果表明,在同样的丢包率下,本文方法的重构质量(PSNR)明显优于SPIHT多描述编码方法,且计算复杂度较低.

一种鲁棒灵活的非平衡多描述视频编码和传输方案

在网络上传输的视频经常因为丢包而影响终端接收到的视频的质量.由于现有的视频编码器通常使用预测编码技术来减少时域冗余提高压缩率,所以一个包的丢失都会引起错误的传播,直到解码器收到帧内编码的帧为止.针对这个问题,文中提出一种灵活鲁棒的非平衡多描述编码和传输方案.其编码器借助不同描述间的"同步帧",能够迅速从包丢失中恢复解码,并保证终端视频的连续播放;同时,该方案能够灵活适应多路径传输和单路径传输两种情况.文中还研究了单路径传输时不同描述间的码率分配问题,并提出一种近似最优的快速码率分配方案.实验结果充分验证了文中提出的非平衡多描述编码和传输方案的有效性、鲁棒性和灵活性.

图像信号的多描述编码方法

鉴于数据在不可靠信道传输时 ,可能会发生数据包丢失或出错的问题 ,因此在图像与视频信号传输中如何解决由此而产生的图像质量严重下降问题已成为近年来的一个重要研究课题 ,而多描述编码作为一种可选的解决方案已开始受到关注。由于多描述编码是将信号分解为多个独立的码流 ,并通过不同的信道进行传输 ,因而可在较高压缩效率下增强信号的稳健性。在对目前的图像多描述编码文献进行分析和综合的基础上 ,首先阐述了多描述编码的历史和信息论背景 ;然后对图像多描述编码方法进行了分类 ,即分为基于量化、基于变换和基于空间扩展的多描述编码等几类 ,并对各种方法的数学模型以及适用情况等进行了讨论 ;

多描述编码研究现状

研究开发实时、鲁棒的流媒体编码与传输技术已成为当前信息技术的一个热点问题.多描述编码作为解决该问题的一种方法,因其在满足数据传输实时性要求的同时可减少数据失真,受到广泛关注.文中首先介绍了多描述编码的历史和评价性能指标,然后详述了多描述编码的研究和进展状况,包括各类多描述编码方法的思想、框架和特点,最后对现有研究中存在的难点问题进行了探讨与展望.

多描述编码的研究现状及其展望

对多描述编码的研究现状进行了分析,介绍了多描述编码的理论研究,概括了现有的多描述编码的构造方法,并对视频中多描述编码技术进行了介绍,最后对多描述编码技术进行了展望。

混合观测压缩感知图像多描述编码

提出一种混合观测压缩感知多描述编码方案,用于提升传统的该类编码系统的编码性能并保留其抗丢包能力。该方案采用二维离散余弦变换(DCT)观测矩阵和高斯矩阵分别对图像信号进行观测,并分别使用哥伦布码(Golomb code)及其改进的编码方案对两种观测系数进行熵编码,得到包含完整码字的二维DCT码流和仅包含部分码字的高斯观测系数码流。在解码端,利用二维DCT系数和高斯观测系数之间的相关性进行最大后验概率估计解码,成功估计出高斯观测系数的缺失码字。最后再将两种观测系数合并,采用1范数优化算法重构出原信号。针对自然图像和遥感图像的实验均表明:不同丢包情况下,用本文提出的编码方案获得的重构图像的峰值信噪比(PSNR)值比传统高斯观测压缩感知编码方案提高了2～4dB,该方案同时还具有鲁棒的抗丢包能力。