基于SEI的煤矿智能监控视频传输方法

SEI based intelligent monitoring video transmission method for coal mines

目前煤矿视频监控数据传输存在高延迟问题,而视频传输延迟的主要成因是编码延迟。针对该问题,提出了一种无视频编码的基于媒体补充增强信息(SEI)的煤矿智能监控视频传输方法。该方法在解复用视频流得到视频压缩帧后缓存一份副本,解码视频压缩帧得到视频解码帧,通过SEI存储视频解码帧中AI模型分析结果,根据时间戳对应关系将自定义SEI写入该视频解码帧对应视频压缩帧副本的网络提取层单元,并复用视频压缩帧副本,实现煤矿智能监控视频实时传输。在24核CPU上对该方法进行实验测试,结果表明:对于1280×720分辨率的视频,采用该方法处理视频时CPU整体使用率由采用传统方法时的24.7%~36.6%降至20.3%~23.9%,端到端延迟由1946 ms降至345 ms;对于1920×1080分辨率的视频,采用该方法处理视频时CPU整体使用率由采用传统方法时的29.2%~41.8%降至18.5%~26.3%,端到端延迟由6204 ms降至479 ms。该方法通过规避视频编码环节,降低了煤矿智能监控视频传输延迟,且节省了视频编码所需的CPU或GPU资源,降低了智能视频监控系统硬件成本。

Currently,there is a high latency problem in the transmission of video surveillance data in coal mines,and the main cause of video transmission delay is encoding delay.In order to solve the above problems,a intelligent monitoring video transmission method for coal mines based on media supplemental enhancement information(SEI)without video encoding is proposed.This method caches a copy of the compressed video frame obtained by demultiplexing the video stream,and decodes the compressed video frame to obtain the decoded video frame.The method stores the AI model analysis results in the decoded video frame through SEI,writes the custom SEI into the network extraction layer unit corresponding to the compressed video frame copy of the decoded video frame based on the timestamp correspondence.The method multiplexes the compressed video frame copy to achieve real-time transmission of coal mine intelligent monitoring videos.Experimental testing of this method is conducted on a 24 core CPU.The results show that for videos with a resolution of 1280×720,the overall CPU utilization rate for video processing using this method decreases from 24.7%to 36.3%when using traditional methods to 20.3%to 23.9%.The end-to-end delay decreases from 1946 ms to 345 ms.For videos with a resolution of 1920×1080,the overall CPU utilization rate for video processing using this method decreases from 29.2%to 41.8%using traditional methods to 18.5%to 26.3%.The end-to-end latency decreases from 6204 ms to 479 ms.This method reduces the transmission delay of coal mine intelligent monitoring videos by avoiding the video encoding process,saves CPU or GPU resources required for video encoding,and reduces the hardware cost of the intelligent video monitoring system.