工作面刮板输送机煤流状态识别方法

Method for recognizing coal flow status of scraper conveyor in working face

煤矿井下工作面刮板输送机场景中存在的刮板输送机姿态多变、煤料形状不规则、设备安装位置受限、高粉尘、异物遮挡等不利因素,导致现有针对带式输送机场景的煤流状态识别方法无法有效在刮板输送机场景下进行工程化应用。针对上述问题,提出了一种基于时序视觉特征的工作面刮板输送机煤流状态识别方法。该方法首先利用DeepLabV3+语义分割模型获取工作面煤流视频图像中粗略煤流区域,并在此基础上通过线性拟合方法进行精细煤流区域定位与分割,实现煤流图像提取;然后将煤流图像按视频时序进行排列,构成煤流图像序列;最后采用C3D动作识别模型针对煤流图像序列进行特征建模,实现煤流状态自动识别。实验结果表明:该方法能准确获取煤流图像并自动、实时识别煤流状态,煤流状态平均识别准确率达92.73%;针对工程化部署应用,利用TensorRT对模型进行加速处理,对于分辨率为1 280×720的煤流视频图像,整体处理速度为42.7帧/s,满足工作面煤流状态智能监测实际需求。

The various poses of scraper conveyors,irregular coal material shapes,limited equipment installation positions,high dust,and foreign object obstruction in the scene of scraper conveyors in underground coal mines have led to the inability of existing coal flow status recognition methods for belt conveyor scenarios to be applied in engineering.In order to solve the above problems,a method for recognizing the coal flow status of a scraper conveyor in a working face based on temporal visual features is proposed.This method first utilizes the DeepLabV3+semantic segmentation model to obtain rough coal flow regions in the coal flow video image of the working face.Then the method uses linear fitting method to locate and segment fine coal flow regions,achieving coal flow image extraction.Then the method arranges the coal flow images in video sequence to form a sequence of coal flow images.Finally,a convolutional 3D(C3D)action recognition model is used to model the features of coal flow image sequences and achieve automatic recognition of coal flow status.The experimental results show that this method can accurately obtain coal flow images and automatically and real-time recognize coal flow status,with an average recognition accuracy of 92.73%for coal flow status.For engineering deployment applications,TensorRT is used to accelerate model processing.For the coal flow video image with a resolution of 1280×720,the overall processing speed is 42.7 frames/s,which meets the actual demand for intelligent monitoring of coal flow status at the working face.