RATE CONTROL ALGORITHM FOR H.264 VIDEO ENCODER

This letter proposes a rate control algorithm for H.264 video encoder, which is based on block activity and buffer state. Experimental results indicate that it has an excellent performance by providing much accurate bit rate and better coding efficiency compared with H.264. The computational complexity of the algorithm is reduced by adopting a novel block activity description method using the Sum of Absolute Difference (SAD) of 16× 16 mode, and its robustness is enhanced by introducing a feedback circuit at frame layer.

A rate control scheme for H.264 video under low bandwidth channel

The dilemma of the quantization parameter (QP) being involved in both rate control and rate-distortion optimization (RDO) prevents using the traditional rate control scheme. Although some rate control schemes are proposed to circumvent the dilemma, the inaccurate prediction model and improper bit allocation deter H.264 application on low bandwidth channel. To resolve this issue, this paper proposes a novel rate control scheme by considering the macroblock (MB) encoding complexity variation and buffer variation and by exploiting the spatio-temporal correlation sufficiently well. Simulations showed that this scheme improves the perceptual quality of the pictures with similar or smaller PSNR deviations when compared to that of rate control in JVT-O016.

The Design and Implementation of Qt-based Cross-platform Video Conferencing Remote Control

In order to overcome the defects of the dedicated video conference remote control, this paper designs and implements a Qt-based cross-platform video conferencing remote control. The remote control not only implements a full range of video conferencing control functions with an easy-to-use visual interface;but also implement cross-platform feature to allow users to use remote control software on their own equipment. It is economic, convenient and stylish for users. This paper mainly describes the design and implementation of remote control system framework and cross-platform features. Finally, the result in the paper shows: This remote control is reliable and easy to use.

In-Network Puncturing for Delay-Efficient Rate Control of Distributed Video Coding in Wireless Video Sensor Networks

Wyner-Ziv Video Coding (WZVC) is considered as a promising video coding scheme for Wireless Video Sensor Networks (WVSNs) due to its high comp ression efficiency and error resilience functionalities, as well as its low encoding comp lexity. To achieve a good Rate-Distortion (R-D) performance, the current WZVC paradigms usually adopt an end-to-end rate control scheme in which the decoder rep eatedly requests the additional decoding data from the encoder for decoding Wyner-Ziv frames. Therefore, the waiting time of the additional decoding data is esp ecially long in multihop WVSNs. In this paper, we propose a novel progressive in-network rate control scheme for WZVC. The proposed in-network puncturing-based rate control scheme transfers the partial channel codes puncturing task from the encoder to the relay nodes. Then, the decoder can request the additional decoding data from the relay nodes instead of the encoder, and the total waiting time for decoding Wyner-Ziv frames is reduced consequently. Simulation results validate the proposed rate control scheme.

Variable Bit Rate Fuzzy Control for Low Delay Video Coding

Rate control plays a critical role in achieving perceivable video quality under a variable bit rate,limited buffer sizes and low delay applications.Since a rate control system exhibits non-linear and unpredictable characteristics,it is difficult to establish a very accurate rate-distortion(R-D)model and acquire effective rate control performance.Considering the excellent control ability and low computing complexity of the fuzzy logic in non-linear systems,this paper proposes a bitrate control algorithm based on a fuzzy controller,named the Fuzzy Rate Control Algorithm(FRCA),for All-Intra(AI)and low-delay(LD)video source coding.Contributions of the proposed FRCA mainly consist of four aspects.First,fuzzy logic is adopted to minimize the deviation between the actual and the target buffer size in the hypothetical reference decoder(HRD).Second,a fast lookup table is employed in fuzzy rate control,which reduces computing cost of the control process.Third,an input domain determination scheme is proposed to improve the precision of the fuzzy controller.Fourth,a novel scene change detection is introduced and integrated in the FRCA to adaptively adjust the Group-of-Pictures(GOP)length when the source content fluctuates.The FRCA can be transplanted and implemented in various industry coders.Extensive experiments show that the FRCA has accurate variable bit-rate control ability and maintains a steady buffer size during the encoding processes.Compared with the default configuration encoding under AI and LD,the proposed FRCA can achieve the target bit rates more accurately in various classical encoders.

Streaming and congestion control using scalable video coding based on H.264/AVC

This paper presents a streaming system using scalable video coding based on H.264/AVC. The system provides a congestion control algorithm supported by channel bandwidth estimation of the client. It uses retransmission only for packets of the base layer to disburden the congested network. The bandwidth estimation allows for adjusting the transmission rate quickly to the current available bandwidth of the network. Compared to binomial congestion control, the proposed system allows for shorter start-up times and data rate adaptation. The paper describes the components of this streaming system and the results of experiments showing that the proposed approach works effectively for streaming video.

Optimal source rate control for adapting VBR video over CBR channels

In this paper we discuss the source rate control problem of adapting variable bit-rate （VBR） compressed video over constant bit-rate （CBR） channels. Firstly we formulate it as an optimal control problem of a discrete linear system with state and control constraints. Then we apply the discrete maximum principle to get the optimal solution. Experimental results are given in the end. Compared with traditional algorithms, the proposed algorithm is suitable for the coder with continuous output rates, and can achieve the better solution. Our algorithm can be used in both off-line and on-line coding.

VBR WAVELET VIDEO CODING AND ITS RATE CONTROL IN ATM NETWORKS

This paper presents a new video coding system based on wavelet transform and its rate control scheme over ATM networks. First, three dimensional wavelet transform is performed for the original image sequence, and an extension of set partitioning in hierarchical trees algorithm is employed to quantize the wavelet coefficients. Then, the output rate of the coder is controlled at group of frame scale, ensuring that it conforms to the parameters of a leaky bucket controller. Several leaky buckets with different sizes are discussed too. Simulation shows the efficiency of this codec and the effectiveness of the proposed rate control scheme.

Efficient Rate Control Algorithm for Hierarchical Video Coding

For rate control (RC) of hierarchical structure coding, an independent rate-quantization (R-Q) model was proposed based on mean absolute differences (MADs) in different temporal levels (TLs). In the proposed R-Q model, a novel MAD model was developed according to the hierarchical structure. The experimental results demonstrate that the proposed algorithm provides better performance, in terms of average peak signal-to-noise ratio (PSNR) and quality smoothness, than the H.264 reference model, JM14.2, under various sequences.

PID-Based Bit Allocation Strategy for Asymmetric Stereoscopic Video Coding with Fuzzy Quality Controller

Asymmetric stereoscopic video coding can take advantage of binocular suppression in human vision by representing one of the two views in lower quality.This paper proposes a bit allocation strategy for asymmetric stereoscopic video coding.In order to improve the accuracy of bit allocation and rate control in the left view,a proportionalintegral-derivative controller is adopted.Meanwhile,to control the quality fluctuation between consecutive frames of the left view,a quality controller is adopted.Besides,a fuzzy controller is proposed to control the variation in quality between the left and right views by comparing the PSNR disparity of two views with a fixed threshold,which is used to quantize the binocular psycho-visual redundancy and adjust the quantization parameter (QP) of the right view correspondingly.The proposed algorithm has been implemented in H.264/AVC video codec,and the experimental results show its effectiveness in rate control while keeping a good quality for the left view,and fewer bits are allocated for the right view so that the overall bit rate is saved by 7.2% at most without the loss of subjective visual quality for stereoscopic video.

Equation based rate control scheme for video streaming over wireless channels with link level ARQ

Equation based TCP-friendly rate control (TFRC) protocol has been proposed to support video streaming applications. In order to improve TFRC performance in wireless channels, the link level automatic repeat request (ARQ) scheme is usually deployed. However, ARQ cannot ensure strict delay guarantees, especially over multihop links. This paper introduces a theoretical model to deduce an equation for packet size adjustment in transport layer to minimize retransmission delay by taking into con- sideration the causative reasons inducing retransmission in link layer. An enhanced TFRC (ETFRC) scheme is proposed inte- grating TFRC with variable packet size policy. Simulation results demonstrate that higher goodput, lower packet loss rate (PLR), lower frame transmission delay and jitter with good fairness can be achieved by our proposed mechanism.

内河航道视频监控系统设计

作为重要的水路运输通道,内河航道对于航运管理的安全监控至关重要。保障航道的安全监控对于确保水域船舶航行的安全性、预防船舶污染、提升海事管理和应急搜救能力具有重要意义。文章将借助LiveMedia平台接口对内河航道视频监控系统进行优化设计,旨在提高海事管理水平和执法准确性,使航道管理更加科学和高效。通过这种优化设计,系统将更好地服务于航道安全管理以应对复杂多变的航运环境,为提升水域管理水平和保障船舶安全航行提供技术支持与有效手段。

Hardware Implementation and System Control Strategy of Videoconference System Based on Rec. H. 261

The design and realization of a videoconference system based on international recommendation are introduced in this paper, and the hardware implementation of video codec based on ITU-T H. 261 is briefly discussed. Furthermore, the buffer control method and the adaptive control strategy for quantization are proposed, which are adaptive and robust. This system can be operated under the transmission rate ranging from 128kb/s to 2Mb/s. With these strategies for the videoconference system, the high quality image is obtained. The time delay of the system is about half a second.

A Video Game Based on Optimal Control and Elementary Statistics

The video game presented in this paper is a prey-predator game where two preys (human players) must avoid three predators (automated players) and must reach a location in the game field (the computer screen) called preys’ home. The game is a sequence of matches and the human players (preys) must cooperate in order to achieve the best perform- ance against their opponents (predators). The goal of the predators is to capture the preys, which are the predators try to have a “rendez vous” with the preys, using a small amount of the “resources” available to them. The score of the game is assigned following a set of rules to the prey team, not to the individual prey. In some situations the rules imply that to achieve the best score it is convenient for the prey team to sacrifice one of his components. The video game pursues two main purposes. The first one is to show how the closed loop solution of an optimal control problem and elementary sta- tistics can be used to generate (game) actors whose movements satisfy the laws of classical mechanics and whose be- haviour simulates a simple form of intelligence. The second one is “educational”, in fact the human players in order to be successful in the game must understand the restrictions to their movements posed by the laws of classical mechanics and must cooperate between themselves. The video game has been developed having in mind as players for children aged between five and thirteen years. These children playing the video game acquire an intuitive understanding of the basic laws of classical mechanics (Newton’s dynamical principle) and enjoy cooperating with their teammate. The video game has been experimented on a sample of a few dozen children. The children aged between five and eight years find the game amusing and after playing a few matches develop an intuitive understanding of the laws of classical me- chanics. They are able to cooperate in making fruitful decisions based on the positions of the preys (themselves), of the predators (their opponents) and on the physical limitations to the movements of the game actors. The interest in the game decreases when the age of the players increases. The game is too simple to interest a teenager. The game engine consists in the solution of an assignment problem, in the closed loop solution of an optimal control problem and in the adaptive choice of some parameters. At the beginning of each match, and when necessary during a match, an assign- ment problem is solved, that is the game engine chooses how to assign to the predators the preys to chase. The resulting assignment implies some cooperation among the predators and defines the optimal control problem used to compute the strategies of the predators during the match that follows. These strategies are determined as the closed loop solution of the optimal control problem considered and can be thought as a (first) form of artificial intelligence (AI) of the preda- tors. In the optimal control problem the preys and the predators are represented as point masses moving according to Newton’s dynamical principle under the action of friction forces and of active forces. The equations of motion of these point masses are the constraints of the control problem and are expressed through differential equations. The formula- tion of the decision process through optimal control and Newton’s dynamical principle allows us to develop a game where the effectiveness and the goals of the automated players can be changed during the game in an intuitive way sim- ply modifying the values of some parameters (i.e. mass, friction coefficient, ...). In a sequence of game matches the predators (automated players) have “personalities” that try to simulate human behaviour. The predator personalities are determined making an elementary statistical analysis of the points scored by the preys in the game matches played and consist in the adaptive choice of the value of a parameter (the mass) that appears in the differential equations that define the movements of the predators. The values taken by this parameter determine the behaviour of the predators and their effectiveness in chasing the preys. The predators personalities are a (second) form of AI based on elementary statistics that goes beyond the intelligence used to chase the preys in a match. In a sequence of matches the predators using this second form of AI adapt their behaviour to the preys’ behaviour. The video game can be downloaded from the website: http://www.ceri.uniroma1.it/ceri/zirilli/w10/.

Optimal Rate Control for Transporting VBR Video over QoS-assured Channels

In this paper we discuss how to select appropriate source and channel rate for transporting variable bit-rate (VBR) compressed video over QoS (quality of service)-assured channels. We first formulate it as an optimal control problem of discrete linear time-delay system. Then the discrete maximum principle is used to get the optimal control. Compared to traditional solutions, the proposed algorithm is designed for the coder with continuous output rate, and can work without special requirements for the encoder and decoder buffer sizes. Theoretical analysis and experimental results show that the proposed algorithm has lower space and time complexity. Our solution can be used in both off-line and on-line coding.

面向智能视频监控的空中交通管制员图像分割

为解决复杂场景下空中交通管制员检测与分割精度低、鲁棒性差的问题,提出一种基于掩码区域卷积神经网络(Mask Region-based Convolutional Neural Networks, Mask R-CNN)的管制员图像分割模型ATC Mask R-CNN(ATC Mask Region-based Convolutional Neural Networks)。首先,构建管制员监控图像数据集(ATC Monitor Image Dataset, AMID)并用于模型训练、测试;其次,在主干网络中引入瓶颈注意力模块(Bottleneck Attention Module, BAM)以增强管制员特征提取,采取改进的柔性非极大值抑制算法(Soft Non-maximum Suppression, Soft-NMS)替代NMS算法进行候选框选取,提高对遮挡目标的检测分割;最后,基于AMID进行管制员图像分割试验。结果显示:ATC Mask R-CNN的精确率、召回率和平均精度分别为96.49%、95.62%和88.84%,表明了该方法的有效性。与Mask R-CNN相比,ATC Mask R-CNN有效降低了复杂场景的不利影响,更适用于管制员工作场景,可以为管制大厅安全管理自动化应用提供技术支撑。

煤矿智能压风系统的应用研究

针对传统压风系统多电机之间无法协同配合,压风机房需要定时巡检等问题,设计了一种智能压风系统。该系统通过在控制侧加入可编程控制柜,并引入模糊控制算法,实现压风系统的按压供风、负载均衡、自动轮换的功能。通过布置故障诊断装置,检测压风机的健康状况,在发生故障时可停止压风机的运行,并及时开启另一台压风机,保障管道压力恒定。通过安装视频分析摄像仪实现对压风机房进入人员的监测,分析是否有违规或越界行为,保证人员和设备的安全。智能压风系统的管控平台展示压风机的各项数据,并通过动画生动的展示压风机房内各设备的运行状态,显示压风机健康状况的分析结果。该系统的应用减少了电能的浪费,提供了准确的诊断结果,提高了煤矿智能化水平。

面向铁路5G-R宽带集群通信的视频传输控制方法

视频业务是5G-R宽带集群通信的典型新增业务,视频传输控制方法直接影响该业务的运用效果和效率。由于标准3GPP MCVideo的视频传输控制方法并不完全适用于铁路集群通信场景,结合铁路应用需求和MCVideo标准,提出一种适用于铁路集群通信的视频传输控制模型和方法。首先,按照业务与移动通信网络解耦、信令与数据分离、利于功能扩展的原则,设计提出5G-R宽带集群通信MCVideo系统架构。其次,根据5G-R宽带集群通信视频业务需求和MCVideo标准,抽象建立视频传输控制模型,并探讨模型控制流程和性能评估。然后,针对模型在5G-R下应用时的重点问题,通过用户视频传输权限策略、多路视频接收处理策略、多系统视频传输控制、用户身份标识等,给出铁路特色的视频传输控制关键方法。最后,在5G-R实验室条件下搭建全实物平台和设备进行试验验证。研究结果表明:相比于B-TrunC同源视频组呼、会议视频控制、标准3GPP MCVideo等方法,该模型方法在满足铁路运用需求方面具有显著优势。通过全实物平台验证了所提方法的可行性,能够实现铁路集群调度视频传输控制。在性能方面,所提视频传输控制方法在95%情况下时延为65 ms左右。该方法可在合理使用网络带宽的情况下,实现紧密结合铁路需求、更灵活的视频传输控制,极大地满足了铁路集群和调度通信应用要求,提高了指挥和通信效率。

基于数据虚拟化模型的铁路客运站视频数据湖研究

针对当前铁路旅客服务与生产管控平台(简称:管控平台)智能视频分析应用中存在的视频接入方式不规范、智能分析模型精度低、数据传输带宽受限等问题,设计了视频数据接入及存储硬件架构,在带宽受限的情况下,实现了视频码流、设备管理信息的安全接入,满足视频数据存储应用需求;构建了基于数据虚拟化模型的铁路客运客运站视频数据湖体系架构,满足客运站智能视频分析的实时性需求;对设备配置能力进行估算,并对主要设备进行配置。文章的研究结果可为相关工程的建设、设计和实施提供参考。