High-Efficiency Video Coder in Pruned Environment Using Adaptive Quantization Parameter Selection

The high-efficiency video coder(HEVC)is one of the most advanced techniques used in growing real-time multimedia applications today.However,they require large bandwidth for transmission through bandwidth,and bandwidth varies with different video sequences/formats.This paper proposes an adaptive information-based variable quantization matrix(AIVQM)developed for different video formats having variable energy levels.The quantization method is adapted based on video sequence using statistical analysis,improving bit budget,quality and complexity reduction.Further,to have precise control over bit rate and quality,a multi-constraint prune algorithm is proposed in the second stage of the AI-VQM technique for pre-calculating K numbers of paths.The same should be handy to selfadapt and choose one of the K-path automatically in dynamically changing bandwidth availability as per requirement after extensive testing of the proposed algorithm in the multi-constraint environment for multiple paths and evaluating the performance based on peak signal to noise ratio(PSNR),bit-budget and time complexity for different videos a noticeable improvement in rate-distortion(RD)performance is achieved.Using the proposed AIVQM technique,more feasible and efficient video sequences are achieved with less loss in PSNR than the variable quantization method(VQM)algorithm with approximately a rise of 10%–20%based on different video sequences/formats.

Trifocal tensor based side information generation for multi-view distributed video code

Distributed video coding （DVC） is a new video coding approach based on Wyner-Ziv theorem. The novel uplink-friendly DVC, which offers low-complexity, low-power consuming, and low-cost video encoding, has aroused more and more research interests. In this paper a new method based on multiple view geometry is presented for spatial side information generation of uncalibrated video sensor network. Trifocal tensor encapsulates all the geometric relations among three views that are independent of scene structure; it can be computed from image correspondences alone without requiring knowledge of the motion or calibration. Simulation results show that trifocal tensor-based spatial side information improves the rate-distortion performance over motion compensation based interpolation side information by a maximum gap of around 2dB. Then fusion merges the different side information （temporal and spatial） in order to improve the quality of the final one. Simulation results show that the rate-distortion gains about 0.4 dB.

Compression of ECG signal using video codec technology-like scheme

In this paper, we present a method using video codec technology to compress ECG signals. This method exploits both intra-beat and inter-beat correlations of the ECG signals to achieve high compression ratios (CR) and a low percent root mean square difference (PRD). Since ECG signals have both intra-beat and inter-beat redundancies like video signals, which have both intra-frame and inter-frame correlation, video codec technology can be used for ECG compression. In order to do this, some pre-process will be needed. The ECG signals should firstly be segmented and normalized to a sequence of beat cycles with the same length, and then these beat cycles can be treated as picture frames and compressed with video codec technology. We have used records from MIT-BIH arrhythmia database to evaluate our algorithm. Results show that, besides compression efficiently, this algorithm has the advantages of resolution adjustable, random access and flexibility for irregular period and QRS false detection.

Cloud‐based video streaming services:Trends,challenges,and opportunities

Cloud computing has drastically changed the delivery and consumption of live streaming content.The designs,challenges,and possible uses of cloud computing for live streaming are studied.A comprehensive overview of the technical and business issues surrounding cloudbased live streaming is provided,including the benefits of cloud computing,the various live streaming architectures,and the challenges that live streaming service providers face in delivering high‐quality,real‐time services.The different techniques used to improve the performance of video streaming,such as adaptive bit‐rate streaming,multicast distribution,and edge computing are discussed and the necessity of low‐latency and high‐quality video transmission in cloud‐based live streaming is underlined.Issues such as improving user experience and live streaming service performance using cutting‐edge technology,like artificial intelligence and machine learning are discussed.In addition,the legal and regulatory implications of cloud‐based live streaming,including issues with network neutrality,data privacy,and content moderation are addressed.The future of cloud computing for live streaming is examined in the section that follows,and it looks at the most likely new developments in terms of trends and technology.For technology vendors,live streaming service providers,and regulators,the findings have major policy‐relevant implications.Suggestions on how stakeholders should address these concerns and take advantage of the potential presented by this rapidly evolving sector,as well as insights into the key challenges and opportunities associated with cloud‐based live streaming are provided.

Recent Advances in Video Coding for Machines Standard and Technologies

To improve the performance of video compression for machine vision analysis tasks,a video coding for machines(VCM)standard working group was established to promote standardization procedures.In this paper,recent advances in video coding for machine standards are presented and comprehensive introductions to the use cases,requirements,evaluation frameworks and corresponding metrics of the VCM standard are given.Then the existing methods are presented,introducing the existing proposals by category and the research progress of the latest VCM conference.Finally,we give conclusions.

The Confidentiality of Coding Video Games with Cheat Code and Bots for Cheating in a Virtual World

Video games have been around for several decades and have had many advancements from the original start of video games. Video games started as virtual games that were advertised towards children, and these virtual games created a virtual reality of a variety of genres. These genres included sports games, such as tennis, football, baseball, war games, fantasy, puzzles, etc. The start of these games was derived from a sports genre and now has a popularity in multiplayer-online-shooting games. The purpose of this paper is to investigate different types of tools available for cheating in virtual world making players have undue advantage over other players in a competition. With the advancement in technology, these video games have become more expanded in the development aspects of gaming. Video game developers have created long lines of codes to create a new look of video games. As video games have progressed, the coding, bugs, bots, and errors of video games have changed throughout the years. The coding of video games has branched out from the original video games, which have given many benefits to this virtual world, while simultaneously creating more problems such as bots. Analysis of tools available for cheating in a game has disadvantaged normal gamer in a fair contest.

RATE CONTROL ALGORITHM FOR H.264 VIDEO ENCODER

This letter proposes a rate control algorithm for H.264 video encoder, which is based on block activity and buffer state. Experimental results indicate that it has an excellent performance by providing much accurate bit rate and better coding efficiency compared with H.264. The computational complexity of the algorithm is reduced by adopting a novel block activity description method using the Sum of Absolute Difference (SAD) of 16× 16 mode, and its robustness is enhanced by introducing a feedback circuit at frame layer.

A complexity-scalable software-based MPEG-2 video encoder

With the development of general-purpose processors (GPP) and video signal processing algorithms, it is possible to implement a software-based real-time video encoder on GPP, and its low cost and easy upgrade attract developers' interests to transfer video encoding from specialized hardware to more flexible software. In this paper, the encoding structure is set up first to support complexity scalability; then a lot of high performance algorithms are used on the key time-consuming modules in coding process; finally, at programming level, processor characteristics are considered to improve data access efficiency and processing parallelism. Other programming methods such as lookup table are adopted to reduce the computational complexity. Simulation results showed that these ideas could not only improve the global performance of video coding, but also provide great flexibility in complexity regulation.

Stereo Video Transmission Using LDPC Code

Stereo video is widely used because it can provide depth information. However, it is difficult to store and transmit stereo video due to the huge data amount. So, high efficient channel encoding algorithm and proper transmission strategy is needed to deal with the video transmission over limited bandwidth channel. In this paper, unequal error protection (UEP) based on low density parity check (LDPC) code was used to transmit stereo video over wireless channel with limited bandwidth. Different correction level LDPC code was used according to the importance of video stream to reconstruction at the receiver. Simulation result shows that the proposed transmission scheme increases the PSNR of reconstructed image, and improves the subjective effect.

Distributed Video Coding Using LDPC Codes for Wireless Video

Popular video coding standards like H.264 and MPEG working on the principle of motion-compensated pre-dictive coding demand much of the computational resources at the encoder increasing its complexity. Such bulky encoders are not suitable for applications like wireless low power surveillance, multimedia sensor networks, wireless PC cameras, mobile camera phones etc. New video coding scheme based on the principle of distributed source coding is looked upon in this paper. This scheme supports a low complexity encoder, at the same time trying to achieve the rate distortion performance of conventional video codecs. Current im-plementation uses LDPC codes for syndrome coding.

新一代通用视频编码标准H.266/VVC:现状与发展

相比于上一代标准,新一代通用视频编码标准(H.266/VVC)在同等质量下能够节省大约50%的码率,且适用于多种多样的视频应用场景。论文从H.266/VVC的关键技术出发,对标准的现状、实现和应用发展进行深入探讨。H.266/VVC沿用既往标准中的双层码流体系和混合编码框架,针对帧内预测、帧间预测、变换、量化、环路滤波等所有主要编码模块进行了技术革新,并为屏幕内容视频等应用提供了高效的专用编码工具。H.266/VVC标准目前已处于实用化阶段,官方参考软件VTM和开源编解码器VVenC/VVdeC是目前最具代表性的软件编解码实现。对H.266/VVC的性能分析可以看出:H.266/VVC针对高分辨率视频取得的编码增益更为突出;主要编码工具对性能的贡献通常以复杂度为代价,但也有部分编码工具在提升编码性能的同时可降低整体编码复杂度。H.266/VVC的硬件实现面临诸多挑战,发展明显滞后于软件实现,现有研究主要集中在对具体编码模块的硬件加速方面。H.266/VVC标准发布之后,下一代视频编码标准的发展目前仍围绕混合编码框架进行探索,聚焦在两大方向:超越VVC的增强压缩关注更为先进的、非神经网络的编码工具,基于神经网络的视频编码则探索采用神经网络的编码工具。除此之外,部分或完全跳出现有混合编码框架的端到端视频编码也在飞速发展,未来视频编码标准与神经网络结合成为趋势,但面临着计算资源依赖和稳定结构两方面的考验。

沉浸式视频编码技术综述

随着虚拟现实、增强现实等沉浸式媒体技术的发展,沉浸式视频的表示、存储、传输和显示等各个环节都受到了科研及产业界的广泛关注。沉浸式视频更复杂的视频特性和庞大的数据量,对传统视频编码技术提出了挑战,新的编码技术应运而生。该文从视频自由度(DoF)出发,分别从3DoF和6DoF两个方面介绍沉浸式视频编码技术的最新成果。3DoF视频相关编码技术包括投影模型、运动估计模型和3DoF视频编码标准。6DoF视频相关编码技术包括视频表示形式、虚拟视点合成技术、6DoF视频编码技术及运动图像专家组沉浸式视频(MPEG,MIV)编码标准。最后,对沉浸式视频及其编码技术的发展进行总结和展望。

基于NBVTH算法的军用窄带信道视频传输研究

随着信息技术快速发展,音视频传输广泛应用在军民用领域。针对军用环境通信传输带宽窄、电磁干扰强、网络稳定性低等特点,迫切需要对军用窄带信道下音视传输频编码进行优化。介绍了适应军用窄带信道传输的视频编码框架和最新技术,提出了基于HEVC标准优化的窄带视频传输(NBVTH)算法,并在压缩比、压缩图像质量、编码时延等关键技术指标方面,将NBVTH算法与常用的H.264/AVC编码进行了性能对比分析。试验结果表明,NBVTH算法明显提升了编码性能,更加适用于军用窄带信道的视频传输。

基于深度学习的HEVC编码复杂度优化方法

为降低高效率视频编码(HEVC)的计算复杂度,提出一种基于深度学习的复杂度优化方法。构建大规模编码单元(CU)划分数据库,为算法设计和神经网络训练提供数据基础;设计一种适用于HEVC的CU划分图模型,高效表征多个邻近CU的划分模式;在此基础上,提出一种基于稠密网络的分层卷积神经网络结构,准确预测HEVC中的三级CU划分结果。实验结果表明:该方法能够在保证编码效率前提下,平均节省57%的编码时间,有效解决了HEVC编码复杂度过高的瓶颈。

基于视频二维码标签的“互联网+儿童病人教育”新模式的应用研究

目的探讨基于“互联网+儿童病人教育”新模式的可行性,向病儿家长定向提供基于二维码标签的集成化教育短视频,以提高门诊儿童病人教育的覆盖率和教育质量,保障儿童居家用药安全有效。方法选择常州市第一人民医院2021年儿科门诊使用量排名前10且用药错误问题点最多的3种药品作为代表药品,分别制作每个代表药品的病人教育短视频组合,转换成二维码标签,贴于药品包装盒上发放,计算病人教育覆盖率,并通过电话回访比较新型病人教育模式应用前后家长满意度和病儿居家医疗安全KAP(知识-态度-行为)评分进行评价。结果新型病人教育模式下,3种代表药品糠酸莫米松鼻喷剂、奥司他韦颗粒和孟鲁司特钠颗粒的病人教育覆盖率分别为72.4%、67.8%和52.2%。电话回访新型病人教育模式应用前后各120位病儿家长,试验组家长对病人教育形式、内容、可及性和便利度四方面的满意度[76.7%(92/28)、68.3%(82/38)、85.8%(103/17)、82.5%(99/21)]显著高于对照组[61.7%(74/46)、42.5%(51/69)、31.7%(38/82)、36.7%(44/76)](P<0.05),病儿居家医疗安全KAP评分明显升高(P<0.05)。结论基于视频二维码标签的“互联网+儿童病人教育”新模式可为家长提供不受时空限制、多维度、高效率、低成本的线上病人教育,显著提高病人教育覆盖率、满意度和教育质量。该方法可行性强,可推广至更多门诊病人,亦可作为“一站式互联网诊疗”病人的主要教育方式。

一种现代安防远程视频监控系统的设计与验证

分析基于Linux的远程视频监控系统的组成,以基于Linux系统的树莓派3开发板为视频采集端,利用H.264编码对视频进行压缩、TCP网络协议传输数据,在Windows客户端对接收到的视频流进行解码并播放。系统测试和分析表明:视频流输出比特率越低,压缩率越大;相同输出比特率,B帧为1时,压缩率较大。

多基站无线非正交多址接入的平滑视频流传输算法

视频服务需求的快速增长对于视频流畅播放提出了巨大挑战,从用户体验角度分析,视频播放中的卡顿时间可能是最重要指标之一。随着5G网络技术的发展,非正交多址接入(NOMA)技术被重点关注,NOMA技术具有叠加编码和连续干扰消除2个特点,根据这2个特点实现数据的并行传输。利用NOMA技术的并行传输能力来提高基站为用户提供视频的实时性。在用户需求视频名称和视频分辨率给定的情况下,通过联合基站-用户配对方式和基站功率分配来降低视频播放时的卡顿时间。通过对问题进行建模,并提出1个两步启发式算法对问题进行求解,第1步为确定基站与用户的配对方式,第2步为分配基站的发射功率。实验结果表明,基于NOMA的传输调度方案与传统的传输调度方案相比,用户需求的平均卡顿时间有明显的下降,相对于在不采用NOMA机制时,在2-SIC接收机情况下,用户平均卡顿时间减少了55.56%。

面向360°全景视频的帧内预测编码的快速算法

为了节省360°全景视频的编码时间,对通用视频编码标准中的编码单元划分决策过程进行了研究,提出了一种面向360°全景视频的帧内预测编码的快速算法。通过优化编码树单元(Coding Tree Unit,CTU)的编码深度范围和编码单元的划分模式的选择过程,减少编码时间。实验结果表明,在全帧内模式下,所提算法比原始算法平均可以节省34.33%的时间复杂度,同时带来的BDBR平均增量仅为1.665%,BDPSNR的平均降低量仅为0.076 dB。

基于CU特征差异的VVC帧内快速划分算法

针对通用视频编码(versatile video coding,VVC)在编码单元(coding unit,CU)划分中引入了多类型树划分结构导致编码复杂度增加的问题,提出了一种基于CU子块方向特性与空间复杂度的快速划分算法。首先利用CU整体的纹理复杂度对当前CU进行分类,筛选出不划分CU;然后利用子块不同划分方向的特性差异提前决策CU划分方向;最后利用CU中间区域与边缘区域的复杂度差异特征判断是否跳过三叉树(ternary tree,TT)划分,进一步减少候选列表划分模式数量。实验结果表明,与官方测试平台VTM10.0相比,编码器在平均输出比特率增加1.12%的代价下,编码时间减少了40.25%,说明该算法在通用视频编码中能以较小的质量损失实现更短的编码时间。

基于H.265编码的多路视频编解码采集单元设计

近年来,遥测数字视频广泛地应用在海军舰船上的各个场景,而传统视频监测设备存在图像资源占用过高导致的实时视频图像质量降低的问题。为了实现舰船上多个监测设备实时码流传输、码流显示和易于管理的需求,论文设计和实现了一种视频编解码系统。该系统包括视频采集压缩、视频传输、视频显示和指令配置等功能模块。通过千兆以太网接入视频服务器,按照协议发送配置指令,使用FFmpeg进行硬件解码。实现了多路视频码流的传输、显示和控制。测试结果表明,所设计视频编解码系统功能实用可靠、性能良好,满足使用需求。