Dynamic Reconfigurable Structure with Rate Distortion Optimization

The Rate Distortion Optimization(RDO)algorithm in High Efficiency Video Coding(HEVC)has many iterations and a large number of calculations.In order to decrease the calculation time and meet the requirements of fast switching of RDO algorithms of different scales,an RDO dynamic reconfigurable structure is proposed.First,the Quantization Parameter(QP)and bit rate values were loaded through an H⁃tree Configurable Network(HCN),and the execution status of the array was detected in real time.When the switching request of the RDO algorithm was detected,the corresponding configuration information was delivered.This self⁃reconfiguration implementation method improved the flexibility and utilization of hardware.Experimental results show that when the control bit width was only increased by 31.25%,the designed configuration network could increase the number of controllable processing units by 32 times,and the execution cycle was 50%lower than the same type of design.Compared with previous RDO algorithm,the RDO algorithm implemented on the reconfigurable array based on the configuration network had an average operating frequency increase of 12.5%and an area reduction of 56.4%.

Rate-distortion optimized frame dropping and scheduling for multi-user conversational and streaming video

We propose a Rate-Distortion (RD) optimized strategy for frame-dropping and scheduling of multi-user conversa- tional and streaming videos. We consider a scenario where conversational and streaming videos share the forwarding resources at a network node. Two buffers are setup on the node to temporarily store the packets for these two types of video applications. For streaming video, a big buffer is used as the associated delay constraint of the application is moderate and a very small buffer is used for conversational video to ensure that the forwarding delay of every packet is limited. A scheduler is located behind these two buffers that dynamically assigns transmission slots on the outgoing link to the two buffers. Rate-distortion side information is used to perform RD-optimized frame dropping in case of node overload. Sharing the data rate on the outgoing link between the con- versational and the streaming videos is done either based on the fullness of the two associated buffers or on the mean incoming rates of the respective videos. Simulation results showed that our proposed RD-optimized frame dropping and scheduling ap- proach provides significant improvements in performance over the popular priority-based random dropping (PRD) technique.

PRE-Processing for Video Coduing with Rate-Distortion Optimization Decision

This paper proposes an adaptive video pre-processing algorithm for video coding. This algorithm works on the original image before intraor inter-prediction. It adopts Gaussian filter to remove noise and insignificant features existing in images of video. Detection and restoration of edges are followed to restore the edges which are excessively filtered out in filtered images. Rate-Distortion Optimization （RDO） is employed to decide adaptively whether a processed block or a unprocessed block is coded into bit-streams doe more efficient coding. Our experiment results show that the algorithm achieves good coding performances on both subjective and objective aspects. In addition, the proposed pre-processing algorithm is transparent to decoder, and thus can be compliant with any video coding standards without modifying the decoder.

基于结构相似度的HEVC感知SBAC-RDO算法

HEVC熵编码器采用率失真优化(RDO)技术在码率和图像质量之间达到了较好的平衡。但是HEVC仍然沿用传统的客观失真准则,并不能很好地体现人眼的主观视觉特性。结构相似度SSIM(Structural SIMilarity)在人类视觉特效匹配上具有一定的优越性。将SSIM引入到HEVC熵编码的率失真模式判决中,同时根据图像的运动强度一致性修正拉格朗日因子。实验结果表明:与HM10.0的率失真优化算法相比,所提出的算法取得了2.1%到2.7%的平均增益。

H.264/AVC率失真优化(RDO)策略研究

本文对H.264/AVC中所运用的率失真优化策略进行了深入研究。首先介绍了率失真理论及率失真优化模型,然后参照JM 8.4代码详细分析了H.264/AVC各模块的代价函数,并重点研究了其编码过程中率失真代价函数的运用策略。最后通过对JM 8.4代码的测试,得出率失真优化的性能,并对其优缺点进行了分析,提出进一步改进和优化的方向。

基于Cauchy分布的二次RDO编码码率控制算法

为提高码率控制精度和图像质量,通过基于Cauchy分布源模型的率失真分析,得出了精确的码率(RQ)模型和失真(DQ)模型,在此基础上提出了一种低码率下的宏块层码率控制算法.该算法在宏块层上利用新的RQ模型计算量化参数,并采用率失真优化技术(RDO)对部分宏块进行二次编码,从而进一步优化选择编码模式,提高了编码效率.实验结果表明,与H.264参考软件JM 8.6中采用的码率控制算法相比,该算法得到的平均峰值信噪比最大提高了0.81 dB,而且能显著降低比特数估计偏差,更准确地进行码率控制.

An Improved Rate Control Method Based on Modification at Scene Change for H.264

This paper presents an improved rate control method for H.264. First, the scene changes are detected by the average absolute difference of the brightness histograms between the adjacent frames. Then, the bit allocation and quantization parameters are adjusted, using a certain threshold. In addition, the calculation of the mean absolute difference （MAD） is modified in an alternative way, which makes the rate distortion optimization （RDO） more accurate. Extensive simulation results show that the proposed method, compared with G012, can improve the average peak signal-to-noise ratio （PSNR） and moderate the image quality.

视频编码失真估计综述

编码失真是评价视频算法性能的主要因素之一,如率失真优化、码率控制和最佳量化等算法设计中,在不进行复杂预编码的情况下精确估计编码失真,是达到良好率失真性能的必要途径。虽然部分编码失真估计方法已经被采用并作为编码算法的基础,然而,与对码率估计的关注度不同,失真估计并未引起人们的足够关注。系统地回顾总结了视频编码失真估计方法,实验并给出了一些比较结果。将失真估计方法分为四类:1)基于DCT系数分布的建模;2)ρ域;3)λ域和4)基于失真传播的建模。概述了这些方法的基本原理,并且根据实验结果对模型的精度进行了简要对比分析。

质量一致性限制的编码模型设计

传统编码器虽然具有可控的码率,但却无法有效控制编码视频的质量,存在随图像内容变化而产生抖动的缺陷。针对当前互联网带宽特性,如自适应码率(Adaptive Bitrate,ABR)网络带宽控制技术中带宽固定的限制条件比传统广播网松弛,在以失真为约束的条件下,提出了一种新的率失真优化的失真分配方案,根据每个编码单元的拉格朗日乘子与图像组(Group of Pictures,GOP)级别的乘子之间的相互关系模型,设计了以帧级为单元的失真分配策略。基于高效率视频编码(High Efficiency Video Coding,HEVC)模型随机编码结构的默认配置下,对通用测试条件中规定的标准测试序列,实验结果显示质量一致性限制的编码器率失真性能Bj ntegaard Delta-Peak Signal to Noise Rate(BD-PSNR)提升了0.057 dB,编码后的图像组失真的方差减小了50%,能有效地减少编码视频的质量抖动,具有更加平稳的编码质量。

面向H.266/VVC的R-λ帧内码率控制算法

在R-λ帧内码控中,提出基于卷积神经网络(Convolutional Neural Networks,CNN)的最佳比特分配和最优拉格朗日因子λ选择。首先,探索编码树单元(Coding Tree Unit,CTU)的码率与失真(Rate-Distortion,R-D)及码率与拉格朗日因子λ(Rate-λ,R-λ)的关系特性,设计具有四输出的CNN预测R-D和R-λ曲线的关键参数;然后,建立帧级λ和目标码率的优化方程,反演得到最佳CTU码率分配;最后,根据CTU码率分配和先知的R-λ曲线,得到最优CTU级λ。实验表明,算法在保持4.76%控制精度下,比VTM13.0默认码控算法提高0.31 dB的编码质量。

Improved algorithm for RDO in JPEG2000 encoder and its IC design

An improved rate distortion optimization （RDO） algorithm in JPEG2000 is proposed. The proposed algorithm is suitable for integrated circuit （IC） implementation and can reduce 30% computational cost. A hardware architecture which includes control unit, memory, divider, data converter is also given to implement the algorithm. The circuit based on the improved algorithm is tested on FPGAs and integrated in a JPG2000 chip codec core.

Improved rate-distortion optimized video coding using non-integer bit estimation and multiple Lambda search

Many modern video encoders use the Lagrangian rate-distortion optimization （RDO） algorithm for mode deci- sions during the compression procedure. For each encoding stage, this approach involves minimizing a cost, which is a function of rate, distortion and a multiplier called Lambda. This paper proposes to improve the RDO process by applying two modifications. The first modification is to increase the ac- curacy of rate estimation, which is achieved by computing a non-integer number of bits for arithmetic coding of the syntax elements. This leads to a more accurate cost computation and therefore a better mode decision. The second modification is to search and adjust the value of Lambda based on the char- acteristics of each coding stage. For the encoder used, this paper proposes to search multiple values of Lambda for the intra-4x4 mode decision. Moreover, a simple shift in Lambda value is proposed for motion estimation. Each of these modi- fications offers a certain gain in RDO performance, and, when all are combined, an average bit-rate saving of up to 7.0% can be achieved for the H.264/AVC codec while the same concept is applicable to the H.265/HEVC codec as well. The extra added complexity is contained to a certain level, and is also adjustable according to the processing resources available.

自适应分割的视频点云多模式帧间编码方法

基于视频的点云压缩(Video based point cloud compression, V-PCC)为压缩动态点云提供了高效的解决方案,但V-PCC从三维到二维的投影使得三维帧间运动的相关性被破坏,降低了帧间编码性能.针对这一问题,提出一种基于V-PCC改进的自适应分割的视频点云多模式帧间编码方法,并依此设计了一种新型动态点云帧间编码框架.首先,为实现更精准的块预测,提出区域自适应分割的块匹配方法以寻找最佳匹配块;其次,为进一步提高帧间编码性能,提出基于联合属性率失真优化(Rate distortion optimization, RDO)的多模式帧间编码方法,以更好地提高预测精度和降低码率消耗.实验结果表明,提出的改进算法相较于V-PCC实现了-22.57%的BD-BR (Bjontegaard delta bit rate)增益.该算法特别适用于视频监控和视频会议等帧间变化不大的动态点云场景.

面向语义通信的非线性变换编码

针对经典通信系统模块设计分离、处理范式受限等因素限制了端到端信息传输性能持续提升的问题,提出了面向语义通信的非线性变换编码传输新框架。首先,基于变分理论推导了语义通信端到端率失真优化准则。据此,设计了非线性变换来提取信源数据在语义隐空间的紧致表征,并通过语义变分熵建模引导实现了变速率非线性联合信源信道编码。实验表明,语义非线性变换编码能显著提升端到端数据传输性能及鲁棒性,是实现语义通信的关键技术之一。

低复杂度样点自适应补偿滤波器的优化设计

高效视频编码标准引入了样点自适应补偿(SAO)滤波,可去除由高频信息丢失而产生的振铃效应,但是也极大增加了环路滤波的复杂度。本文提出一种低复杂度的样点自适应补偿滤波器的算法优化和实现方案。对信息统计范围进行区域优化,避免了跨编码树单元边界的复杂逻辑控制,并节省了额外缓存结构;提出一种快速计算率失真代价的三维线性码率估计模型,以此权衡率失真优化中SAO模式决策复杂度和码率模型精确度;最后,基于上述算法改进设计了适用于超高清视频处理的SAO硬件滤波器,该架构仅以85.6 k等效门消耗,支持高达333 MHz主频的超高清视频处理,其逻辑资源消耗相对于传统方案最高可节省71.47%。

基于球域失真空-时依赖的全景视频编码

全景视频平面编码失真和球域感知失真不同域使主客观质量评价不一致,进而损失编码性能。此外,独立率失真优化技术没有考虑球域失真的时域依赖性对编码的影响,编码性能还有提升空间。针对上述问题,提出一种空-时域依赖的球域失真模型以优化全景视频编码。首先,提出一种球域失真到编码失真的空域映射模型,使主客观质量评价趋近一致;然后,提出一种球域失真时域传播模型,以提升传播链上所有编码单元的整体编码性能;最后,计算球域失真空域映射权重和时域传播权重来调整编码参数。实验结果表明,在低延时编码配置下,相较于通用视频编码基准VTM14.0,所提算法有平均7.4%(最高达22.1%)的码率节省和9%的编码时间节省。

量化参数自适应全景视频编码

高效的全景视频压缩对沉浸式、低延时的视觉体验十分重要.服务器端的全景视频通过投影到2D平面,经过编码、传输到客户端后,反投影到球面供用户观看.而全景视频投影过程中会在球面的两极产生拉伸形变,进而产生像素冗余.针对这一问题,提出一种自适应量化参数算法,根据全景视频纬度方位来调整编码参数优化编码.实验结果表明,提出的算法相较于基准VTM14.0能达到1.7%的码率节省,编码时间下降5.56%.

一种快速的H.264/AVC帧内预测模式选择算法

H.264/AVC采用RDO技术选择帧内和帧间预测模式以进一步提高编码的效率,取得显著效果,但同时大幅度增加了预测的复杂度。该文提出一种RDO模式下的快速Intra_4x4模式选择算法,该算法根据SATD特征以及相邻块的预测模式之间的相关性,可以预先排除约50%可能性小的Intra_4x4模式,避免了不必要的代价(RD_Cost)计算,从而大幅度降低帧内预测的复杂度,同时基本保持了H.264/AVC的编码性能。

H.264/AVC帧内预测模式选择算法研究

H.264/AVC采用空间域上的帧内预测技术,进一步提高了编码效率,但由于H.264/AVC支持的帧内预测模式数较多,使预测的复杂度大幅度增加。详细分析了帧内预测模式的选择过程,提出一种快速的率失真优化(RDO)模式下的快速Intra_4×4模式选择算法,该算法根据SATD(SumofAbsoluteTransformedDifference)以及相邻块的预测模式之间的相关性等特征,预先排除了超过65%可能性小的Intra_4×4模式,避免了不必要的计算,从而大幅度降低帧内预测的复杂度,同时基本保持了H.264/AVC的编码性能。

基于方向梯度的H.264帧内预测模式选择算法

率失真优化(RDO)技术的应用大幅提高了H.264的编码性能,但全搜索方式下,每一宏块所有模式都要进行R-D代价计算,复杂度非常大.文中利用参考像素与当前块之间的方向梯度检测预测方向上的纹理方向与边缘强度,预先筛除部分方向梯度较大的预测模式,形成一种基于方向梯度的快速帧内预测模式选择算法,并利用预测模式的空间相关性采用最有可能模式替换直流模式作为缺省候选模式,改进了基本算法.对10个标准序列进行测试,两个算法应用在亮度分量帧内预测模式选择中均比JM18.0全搜索方式减少了50%以上的编码时间,且编码性能损失很小,保持峰值信噪比与JM全搜索方式相同时,基本算法码率平均上升2.361%,改进算法码率平均上升1.477%.