In this paper we present a motion compensation (MC) design for the newest Audio Video coding Standard (AVS) of China. Because of compression-efficient techniques of variable block size (VBS) and sub-pixel interpolatio...In this paper we present a motion compensation (MC) design for the newest Audio Video coding Standard (AVS) of China. Because of compression-efficient techniques of variable block size (VBS) and sub-pixel interpolation, intensive pixel calculation and huge memory access are required. We propose a parallel serial filtering mixed luma interpolation data flow and a three-stage multiplication free chroma interpolation scheme. Compared to the conventional designs, the integrated architecture supports about 2.7 times filtering throughput. The proposed MC design utilizes Vertical Z processing order for reference data re-use and saves up to 30% memory bandwidth. The whole design requires 44.3k gates when synthesized at 108 MHz clock frequency using 0.18-μm CMOS technology and can support up to 1920×1088@30 fps AVS HDTV video decoding.展开更多
Face-centered orthorhombic（FCO） sampling can be implemented more easily on CMOS image sensors than on other video acquisition devices.The sampling efficiency of FCO is the highest among all threedimensional（3D） sa...Face-centered orthorhombic（FCO） sampling can be implemented more easily on CMOS image sensors than on other video acquisition devices.The sampling efficiency of FCO is the highest among all threedimensional（3D） sampling schemes.However,interpolation of FCO-sampled data is inevitable in bridging human perception and machine-vision algorithms.In this letter,the concept of motion compensation is borrowed from deinterlacing,which displays interlaced videos on progressively scanned devices.The combination of motion estimation based on intrafield interpolated frames and motion-compensated interfield interpolation is found to provide the best performance by evaluating different combinations of motion estimation and interpolation.展开更多
现代视频编码标准普遍采用变换与运动补偿预测混合型编码架构,该架构对运动补偿预测后的残差图像和运动矢量等信息进行变换编码,运动补偿预测的准确度对编码性能有显著影响.由于实际对象的运动精度是任意小的,允许运动矢量具有“分像素...现代视频编码标准普遍采用变换与运动补偿预测混合型编码架构,该架构对运动补偿预测后的残差图像和运动矢量等信息进行变换编码,运动补偿预测的准确度对编码性能有显著影响.由于实际对象的运动精度是任意小的,允许运动矢量具有“分像素”精度,可以有效地提高运动补偿预测准确度,为了得到“分像素”位置的像素值,需要参考其周围相邻的像素值进行插值滤波.文中提出了一种低空间复杂度1/4像素插值方法两步四抽头插值法(Two Steps Four Taps Interpolation,TSFT),该方法与目前国际上最先进的视频编码标准H.264/AVC相比,可以降低11%的空间复杂度,计算复杂度和编码效率相当,已经被国内制定的编码标准AVS1.0采纳.另外,分像素插值是解码端主要的访存和计算瓶颈,文中给出了一个基于多级流水线结构的VLSI实现结构,可以降低访存带宽,同时提高插值器的运算速度,满足高清视频实时解码的需要.展开更多
基金(No. Y106574) supported by the Natural Science Foundationof Zhejiang Province, China
文摘In this paper we present a motion compensation (MC) design for the newest Audio Video coding Standard (AVS) of China. Because of compression-efficient techniques of variable block size (VBS) and sub-pixel interpolation, intensive pixel calculation and huge memory access are required. We propose a parallel serial filtering mixed luma interpolation data flow and a three-stage multiplication free chroma interpolation scheme. Compared to the conventional designs, the integrated architecture supports about 2.7 times filtering throughput. The proposed MC design utilizes Vertical Z processing order for reference data re-use and saves up to 30% memory bandwidth. The whole design requires 44.3k gates when synthesized at 108 MHz clock frequency using 0.18-μm CMOS technology and can support up to 1920×1088@30 fps AVS HDTV video decoding.
基金supported by the National Natural Science Foundation of China (Nos. 60877035, 61076023,and 90820002)the National "863" Program of China(Nos. 2011CB933203 and 2011CB933102)
文摘Face-centered orthorhombic（FCO） sampling can be implemented more easily on CMOS image sensors than on other video acquisition devices.The sampling efficiency of FCO is the highest among all threedimensional（3D） sampling schemes.However,interpolation of FCO-sampled data is inevitable in bridging human perception and machine-vision algorithms.In this letter,the concept of motion compensation is borrowed from deinterlacing,which displays interlaced videos on progressively scanned devices.The combination of motion estimation based on intrafield interpolated frames and motion-compensated interfield interpolation is found to provide the best performance by evaluating different combinations of motion estimation and interpolation.
文摘现代视频编码标准普遍采用变换与运动补偿预测混合型编码架构,该架构对运动补偿预测后的残差图像和运动矢量等信息进行变换编码,运动补偿预测的准确度对编码性能有显著影响.由于实际对象的运动精度是任意小的,允许运动矢量具有“分像素”精度,可以有效地提高运动补偿预测准确度,为了得到“分像素”位置的像素值,需要参考其周围相邻的像素值进行插值滤波.文中提出了一种低空间复杂度1/4像素插值方法两步四抽头插值法(Two Steps Four Taps Interpolation,TSFT),该方法与目前国际上最先进的视频编码标准H.264/AVC相比,可以降低11%的空间复杂度,计算复杂度和编码效率相当,已经被国内制定的编码标准AVS1.0采纳.另外,分像素插值是解码端主要的访存和计算瓶颈,文中给出了一个基于多级流水线结构的VLSI实现结构,可以降低访存带宽,同时提高插值器的运算速度,满足高清视频实时解码的需要.
