基于注意力机制的3D卷积双波段烟火识别方法

3D convolutional dual-band smoke and fire recognition method based on attention mechanism

为提高复杂环境下烟火识别的精度,提出一种基于3D卷积和时空注意力机制的双波段烟火识别方法,该方法融合近红外和可见光双波段图像数据,使用视频流中基于时间的动态特征和基于空间的静态特征降低漏报率、误报率。实验结果表明,该算法在双波段数据集上的烟火识别精度达到99.90%,优于其他基于3D卷积的烟火识别算法,同时,模型具有较小的参数量,能够满足实时推理需求。因此,使用双波段特征的同时,结合注意力机制充分利用视频的动态信息,可以有效提高烟火识别精度。

To improve the accuracy of smoke and fire recognition in complex environments,this paper proposes a dual-band smoke and fire recognition method based on 3D convolution and a spatio-temporal attention mechanism.The method in this paper fuses near-infrared and visible dual-band image data and uses time-based dynamic features and spatial-based static features in the video stream to reduce missed and false alarms.Experimental results show that the algorithm in this paper achieves 99.90% smoke and fire recognition accuracy on the dual-band data set,which is better than other 3D convolutionbased smoke and fire recognition algorithms,while the model has a small number of parameters and can meet the real-time inference requirements.Therefore,the use of dual-band features combined with an attention mechanism to make full use of the dynamic information in the video can effectively improve the smoke and fire recognition accuracy.