To improve the performance of the forest fire smoke detection model and achieve a better balance between detection accuracy and speed, an improved YOLOv4 detection model (MoAm-YOLOv4) that combines a lightweight netwo...To improve the performance of the forest fire smoke detection model and achieve a better balance between detection accuracy and speed, an improved YOLOv4 detection model (MoAm-YOLOv4) that combines a lightweight network and attention mechanism was proposed. Based on the YOLOv4 algorithm, the backbone network CSPDarknet53 was replaced with a lightweight network MobilenetV1 to reduce the model’s size. An attention mechanism was added to the three channels before the output to increase its ability to extract forest fire smoke effectively. The algorithm used the K-means clustering algorithm to cluster the smoke dataset, and obtained candidate frames that were close to the smoke images;the dataset was expanded to 2000 images by the random flip expansion method to avoid overfitting in training. The experimental results show that the improved YOLOv4 algorithm has excellent detection effect. Its mAP can reach 93.45%, precision can get 93.28%, and the model size is only 45.58 MB. Compared with YOLOv4 algorithm, MoAm-YOLOv4 improves the accuracy by 1.3% and reduces the model size by 80% while sacrificing only 0.27% mAP, showing reasonable practicability.展开更多
Purpose–Fire smoke detection in petrochemical plant can prevent fire and ensure production safety and life safety.The purpose of this paper is to solve the problem of missed detection and false detection in flame smo...Purpose–Fire smoke detection in petrochemical plant can prevent fire and ensure production safety and life safety.The purpose of this paper is to solve the problem of missed detection and false detection in flame smoke detection under complex factory background.Design/methodology/approach–This paper presents a flame smoke detection algorithm based on YOLOv5.The target regression loss function(CIoU)is used to improve the missed detection and false detection in target detection and improve the model detection performance.The improved activation function avoids gradient disappearance to maintain high real-time performance of the algorithm.Data enhancement technology is used to enhance the ability of the network to extract features and improve the accuracy of the model for small target detection.Findings–Based on the actual situation of flame smoke,the loss function and activation function of YOLOv5 model are improved.Based on the improved YOLOv5 model,a flame smoke detection algorithm with generalization performance is established.The improved model is compared with SSD and YOLOv4-tiny.The accuracy of the improved YOLOv5 model can reach 99.5%,which achieves a more accurate detection effect on flame smoke.The improved network model is superior to the existing methods in running time and accuracy.Originality/value–Aiming at the actual particularity of flame smoke detection,an improved flame smoke detection network model based on YOLOv5 is established.The purpose of optimizing the model is achieved by improving the loss function,and the activation function with stronger nonlinear ability is combined to avoid over-fitting of the network.This method is helpful to improve the problems of missed detection and false detection in flame smoke detection and can be further extended to pedestrian target detection and vehicle running recognition.展开更多
Existing almost deep learning methods rely on a large amount of annotated data, so they are inappropriate for forest fire smoke detection with limited data. In this paper, a novel hybrid attention-based few-shot learn...Existing almost deep learning methods rely on a large amount of annotated data, so they are inappropriate for forest fire smoke detection with limited data. In this paper, a novel hybrid attention-based few-shot learning method, named Attention-Based Prototypical Network, is proposed for forest fire smoke detection. Specifically, feature extraction network, which consists of convolutional block attention module, could extract high-level and discriminative features and further decrease the false alarm rate resulting from suspected smoke areas. Moreover, we design a metalearning module to alleviate the overfitting issue caused by limited smoke images, and the meta-learning network enables achieving effective detection via comparing the distance between the class prototype of support images and the features of query images. A series of experiments on forest fire smoke datasets and miniImageNet dataset testify that the proposed method is superior to state-of-the-art few-shot learning approaches.展开更多
Smoke detection is the most commonly used method in early warning of fire and is widely used in forest detection.Most existing smoke detection methods contain empty spaces and obstacles which interfere with detection ...Smoke detection is the most commonly used method in early warning of fire and is widely used in forest detection.Most existing smoke detection methods contain empty spaces and obstacles which interfere with detection and extract false smoke roots.This study developed a new smoke roots search algorithm based on a multi-feature fusion dynamic extraction strategy.This determines smoke origin candidate points and region based on a multi-frame discrete confidence level.The results show that the new method provides a more complete smoke contour with no background interference,compared to the results using existing methods.Unlike video-based methods that rely on continuous frames,an adaptive threshold method was developed to build the judgment image set composed of non-consecutive frames.The smoke roots origin search algorithm increased the detection rate and significantly reduced false detection rate compared to existing methods.展开更多
Fire-detection technology plays a critical role in ensuring public safety and facilitating the development of smart cities.Early fire detection is imperative to mitigate potential hazards and minimize associated losse...Fire-detection technology plays a critical role in ensuring public safety and facilitating the development of smart cities.Early fire detection is imperative to mitigate potential hazards and minimize associated losses.However,existing vision-based fire-detection methods exhibit limited generalizability and fail to adequately consider the effect of fire object size on detection accuracy.To address this issue,in this study a decoder-free fully transformer-based(DFFT)detector is used to achieve early smoke and flame detection,improving the detection performance for fires of different sizes.This method effectively captures multi-level and multi-scale fire features with rich semantic information while using two powerful encoders to maintain the accuracy of the single-feature map prediction.First,data augmentation is performed to enhance the generalizability of the model.Second,the detection-oriented transformer(DOT)backbone network is treated as a single-layer fire-feature extractor to obtain fire-related features on four scales,which are then fed into an encoder-only single-layer dense prediction module.Finally,the prediction module aggregates the multi-scale fire features into a single feature map using a scale-aggregated encoder(SAE).The prediction module then aligns the classification and regression features using a task-aligned encoder(TAE)to ensure the semantic interaction of the classification and regression predictions.Experimental results on one private dataset and one public dataset demonstrate that the adopted DFFT possesses high detection accuracy and a strong generalizability for fires of different sizes,particularly early small fires.The DFFT achieved mean average precision(mAP)values of 87.40%and 81.12%for the two datasets,outperforming other baseline models.It exhibits a better detection performance on flame objects than on smoke objects because of the prominence of flame features.展开更多
Smoke and fire recognition are of great importance on foreseeing fire disasters and preventing environmental pollution by monitoring the burning process of objects(e.g., straw, fuels). However, since fire images suffe...Smoke and fire recognition are of great importance on foreseeing fire disasters and preventing environmental pollution by monitoring the burning process of objects(e.g., straw, fuels). However, since fire images suffer from problems like the variability of the features, complexity of scenarios, interference from background, changeable weather conditions as well as image quality problems, identifying smoke and fire accurately and promptly from a given image still remains a substantial challenge. Automatically learning the features of smoke images by CNNs has improved the target recognition ability compared to traditional approaches,nonetheless, convolutions and pooling operations in CNNs may cause severe information loss which may lead to misjudgment.To tackle the above problems, this paper proposed a hybrid attention model based on the characteristics of smoke images. This model adopted multiple optimized attention mechanism in several stages to quickly and precisely capture the important features,achieving state-of-the-art performance on smoke and fire recognition in terms of accuracy and speed. Our proposed module mainly consists of two stages: pooling and attention. In the first stage, we conducted several newly proposed first-order pooling methods. Through traversing the data space in a larger scope, features are better reserved, thus constructing a more intact feature space of smoke and fire in an image. In the second stage, feature maps are aggregated together to perform channel and spatial attention. The channel and spatial dependencies allow us to quickly catch the important features presented in an image. By fully exploring the feature space and prominent salient features, characteristics of smoke and fire are better presented so as to obtain better smoke and fire detection results. Experiments have been conducted on public smoke detection dataset and new proposed fine-grained smoke and fire detection database. Experimental results revealed that the proposed method outperformed popular deep CNNs and existing prevalent attention models for smoke and fire detection problems.展开更多
Smoking is the main reason for fire disaster and pollution in petrol station,construction site and warehouse.Existing solutions based on wearable devices and smoking sensors were costly and hard to obtain evidence of ...Smoking is the main reason for fire disaster and pollution in petrol station,construction site and warehouse.Existing solutions based on wearable devices and smoking sensors were costly and hard to obtain evidence of smoking in unmanned scenarios.With the developments of closed circuit television(CCTV)system,vision-based methods for object detection,mostly driven by deep learning techniques,were introduced recently.However,the massive GPU computing hardware required by the deep learning algorithm made these methods hard to be deployed.This paper aims at solving the smoking detection problem on edge and proposes the solution that has fast detection speed,high accuracy on micro-objects and low computing budget,i.e.,it could be deployed on the edge device such as NVIDIA JETSON TX2.We designed a new framework named RTVBS based on yolov3 and made a smoking dataset to train our model.We raised several methods to improve detection accuracy during the training step.The validation results show our model has excellent performance in smoking detection.展开更多
文摘To improve the performance of the forest fire smoke detection model and achieve a better balance between detection accuracy and speed, an improved YOLOv4 detection model (MoAm-YOLOv4) that combines a lightweight network and attention mechanism was proposed. Based on the YOLOv4 algorithm, the backbone network CSPDarknet53 was replaced with a lightweight network MobilenetV1 to reduce the model’s size. An attention mechanism was added to the three channels before the output to increase its ability to extract forest fire smoke effectively. The algorithm used the K-means clustering algorithm to cluster the smoke dataset, and obtained candidate frames that were close to the smoke images;the dataset was expanded to 2000 images by the random flip expansion method to avoid overfitting in training. The experimental results show that the improved YOLOv4 algorithm has excellent detection effect. Its mAP can reach 93.45%, precision can get 93.28%, and the model size is only 45.58 MB. Compared with YOLOv4 algorithm, MoAm-YOLOv4 improves the accuracy by 1.3% and reduces the model size by 80% while sacrificing only 0.27% mAP, showing reasonable practicability.
基金This work was supported by National Natural Science Foundation of China(61973094).
文摘Purpose–Fire smoke detection in petrochemical plant can prevent fire and ensure production safety and life safety.The purpose of this paper is to solve the problem of missed detection and false detection in flame smoke detection under complex factory background.Design/methodology/approach–This paper presents a flame smoke detection algorithm based on YOLOv5.The target regression loss function(CIoU)is used to improve the missed detection and false detection in target detection and improve the model detection performance.The improved activation function avoids gradient disappearance to maintain high real-time performance of the algorithm.Data enhancement technology is used to enhance the ability of the network to extract features and improve the accuracy of the model for small target detection.Findings–Based on the actual situation of flame smoke,the loss function and activation function of YOLOv5 model are improved.Based on the improved YOLOv5 model,a flame smoke detection algorithm with generalization performance is established.The improved model is compared with SSD and YOLOv4-tiny.The accuracy of the improved YOLOv5 model can reach 99.5%,which achieves a more accurate detection effect on flame smoke.The improved network model is superior to the existing methods in running time and accuracy.Originality/value–Aiming at the actual particularity of flame smoke detection,an improved flame smoke detection network model based on YOLOv5 is established.The purpose of optimizing the model is achieved by improving the loss function,and the activation function with stronger nonlinear ability is combined to avoid over-fitting of the network.This method is helpful to improve the problems of missed detection and false detection in flame smoke detection and can be further extended to pedestrian target detection and vehicle running recognition.
基金The work was supported by the National Key R&D Program of China(Grant No.2020YFC1511601)Fundamental Research Funds for the Central Universities(Grant No.2019SHFWLC01).
文摘Existing almost deep learning methods rely on a large amount of annotated data, so they are inappropriate for forest fire smoke detection with limited data. In this paper, a novel hybrid attention-based few-shot learning method, named Attention-Based Prototypical Network, is proposed for forest fire smoke detection. Specifically, feature extraction network, which consists of convolutional block attention module, could extract high-level and discriminative features and further decrease the false alarm rate resulting from suspected smoke areas. Moreover, we design a metalearning module to alleviate the overfitting issue caused by limited smoke images, and the meta-learning network enables achieving effective detection via comparing the distance between the class prototype of support images and the features of query images. A series of experiments on forest fire smoke datasets and miniImageNet dataset testify that the proposed method is superior to state-of-the-art few-shot learning approaches.
基金supported by the National Natural Science Foundation of China(grants no.32171797 and 31800549)。
文摘Smoke detection is the most commonly used method in early warning of fire and is widely used in forest detection.Most existing smoke detection methods contain empty spaces and obstacles which interfere with detection and extract false smoke roots.This study developed a new smoke roots search algorithm based on a multi-feature fusion dynamic extraction strategy.This determines smoke origin candidate points and region based on a multi-frame discrete confidence level.The results show that the new method provides a more complete smoke contour with no background interference,compared to the results using existing methods.Unlike video-based methods that rely on continuous frames,an adaptive threshold method was developed to build the judgment image set composed of non-consecutive frames.The smoke roots origin search algorithm increased the detection rate and significantly reduced false detection rate compared to existing methods.
基金This work was supported by the Open Fund Project[grant number Mz2022KF05]of Civil Aircraft Fire Science and Safety Engineering Key Laboratory of Sichuan Province,the National Science Foundation of China[Grant No.72204155]the Natural Science Foundation of Shanghai[grant number 23ZR1423100]。
文摘Fire-detection technology plays a critical role in ensuring public safety and facilitating the development of smart cities.Early fire detection is imperative to mitigate potential hazards and minimize associated losses.However,existing vision-based fire-detection methods exhibit limited generalizability and fail to adequately consider the effect of fire object size on detection accuracy.To address this issue,in this study a decoder-free fully transformer-based(DFFT)detector is used to achieve early smoke and flame detection,improving the detection performance for fires of different sizes.This method effectively captures multi-level and multi-scale fire features with rich semantic information while using two powerful encoders to maintain the accuracy of the single-feature map prediction.First,data augmentation is performed to enhance the generalizability of the model.Second,the detection-oriented transformer(DOT)backbone network is treated as a single-layer fire-feature extractor to obtain fire-related features on four scales,which are then fed into an encoder-only single-layer dense prediction module.Finally,the prediction module aggregates the multi-scale fire features into a single feature map using a scale-aggregated encoder(SAE).The prediction module then aligns the classification and regression features using a task-aligned encoder(TAE)to ensure the semantic interaction of the classification and regression predictions.Experimental results on one private dataset and one public dataset demonstrate that the adopted DFFT possesses high detection accuracy and a strong generalizability for fires of different sizes,particularly early small fires.The DFFT achieved mean average precision(mAP)values of 87.40%and 81.12%for the two datasets,outperforming other baseline models.It exhibits a better detection performance on flame objects than on smoke objects because of the prominence of flame features.
基金supported by the National Key Research and Development Program of China(Grant No. 2021ZD0112302)the National Natural Science Foundation of China(Grant Nos. 62076013, 62021003, 61890935)CAAI-Huawei MindSpore Open Fund(Grant No. CAAIXSJLJJ-2021-016A)。
文摘Smoke and fire recognition are of great importance on foreseeing fire disasters and preventing environmental pollution by monitoring the burning process of objects(e.g., straw, fuels). However, since fire images suffer from problems like the variability of the features, complexity of scenarios, interference from background, changeable weather conditions as well as image quality problems, identifying smoke and fire accurately and promptly from a given image still remains a substantial challenge. Automatically learning the features of smoke images by CNNs has improved the target recognition ability compared to traditional approaches,nonetheless, convolutions and pooling operations in CNNs may cause severe information loss which may lead to misjudgment.To tackle the above problems, this paper proposed a hybrid attention model based on the characteristics of smoke images. This model adopted multiple optimized attention mechanism in several stages to quickly and precisely capture the important features,achieving state-of-the-art performance on smoke and fire recognition in terms of accuracy and speed. Our proposed module mainly consists of two stages: pooling and attention. In the first stage, we conducted several newly proposed first-order pooling methods. Through traversing the data space in a larger scope, features are better reserved, thus constructing a more intact feature space of smoke and fire in an image. In the second stage, feature maps are aggregated together to perform channel and spatial attention. The channel and spatial dependencies allow us to quickly catch the important features presented in an image. By fully exploring the feature space and prominent salient features, characteristics of smoke and fire are better presented so as to obtain better smoke and fire detection results. Experiments have been conducted on public smoke detection dataset and new proposed fine-grained smoke and fire detection database. Experimental results revealed that the proposed method outperformed popular deep CNNs and existing prevalent attention models for smoke and fire detection problems.
文摘Smoking is the main reason for fire disaster and pollution in petrol station,construction site and warehouse.Existing solutions based on wearable devices and smoking sensors were costly and hard to obtain evidence of smoking in unmanned scenarios.With the developments of closed circuit television(CCTV)system,vision-based methods for object detection,mostly driven by deep learning techniques,were introduced recently.However,the massive GPU computing hardware required by the deep learning algorithm made these methods hard to be deployed.This paper aims at solving the smoking detection problem on edge and proposes the solution that has fast detection speed,high accuracy on micro-objects and low computing budget,i.e.,it could be deployed on the edge device such as NVIDIA JETSON TX2.We designed a new framework named RTVBS based on yolov3 and made a smoking dataset to train our model.We raised several methods to improve detection accuracy during the training step.The validation results show our model has excellent performance in smoking detection.