Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems,...Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems, including spectral, polarization, and infrared technologies, there is still a lack of effective real-time method for accurately detecting small-size and high-efficient camouflaged people in complex real-world scenes. Here, this study proposes a snapshot multispectral image-based camouflaged detection model, multispectral YOLO(MS-YOLO), which utilizes the SPD-Conv and Sim AM modules to effectively represent targets and suppress background interference by exploiting the spatial-spectral target information. Besides, the study constructs the first real-shot multispectral camouflaged people dataset(MSCPD), which encompasses diverse scenes, target scales, and attitudes. To minimize information redundancy, MS-YOLO selects an optimal subset of 12 bands with strong feature representation and minimal inter-band correlation as input. Through experiments on the MSCPD, MS-YOLO achieves a mean Average Precision of 94.31% and real-time detection at 65 frames per second, which confirms the effectiveness and efficiency of our method in detecting camouflaged people in various typical desert and forest scenes. Our approach offers valuable support to improve the perception capabilities of unmanned aerial vehicles in detecting enemy forces and rescuing personnel in battlefield.展开更多
露天矿区场景复杂,行车障碍物检测受扬尘和颗粒物等粉尘噪声干扰严重,难以准确识别障碍物,尤其是光线较差的夜间,不利于做出正确决策,从而影响无人作业的安全性和整体效率。针对以上问题,提出了一种基于YOLOv8n模型的露天矿区行车障碍...露天矿区场景复杂,行车障碍物检测受扬尘和颗粒物等粉尘噪声干扰严重,难以准确识别障碍物,尤其是光线较差的夜间,不利于做出正确决策,从而影响无人作业的安全性和整体效率。针对以上问题,提出了一种基于YOLOv8n模型的露天矿区行车障碍物检测算法YOLOv8n-Enhanced。该算法主要从3个方面进行了改进,具体包括:首先,针对受粉尘噪声干扰严重和夜间光线不足的问题,提出了C2fCA模块结构,提高了模型特征提取能力;其次,使用轻量级卷积技术GSConv和VoV-GSCSP模块,减轻模型复杂性,实现检测器更高的计算成本效益;最后,使用WIOU损失函数,提高了模型泛化能力。试验结果表明:改进算法在保持实时性的前提下,可将YOLOv8n的平均精度(mean Average Precision,mAP)分别提高1.8%和2.6%,实现白天与夜间场景下不同尺度的障碍物识别。展开更多
基金support by the National Natural Science Foundation of China (Grant No. 62005049)Natural Science Foundation of Fujian Province (Grant Nos. 2020J01451, 2022J05113)Education and Scientific Research Program for Young and Middleaged Teachers in Fujian Province (Grant No. JAT210035)。
文摘Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems, including spectral, polarization, and infrared technologies, there is still a lack of effective real-time method for accurately detecting small-size and high-efficient camouflaged people in complex real-world scenes. Here, this study proposes a snapshot multispectral image-based camouflaged detection model, multispectral YOLO(MS-YOLO), which utilizes the SPD-Conv and Sim AM modules to effectively represent targets and suppress background interference by exploiting the spatial-spectral target information. Besides, the study constructs the first real-shot multispectral camouflaged people dataset(MSCPD), which encompasses diverse scenes, target scales, and attitudes. To minimize information redundancy, MS-YOLO selects an optimal subset of 12 bands with strong feature representation and minimal inter-band correlation as input. Through experiments on the MSCPD, MS-YOLO achieves a mean Average Precision of 94.31% and real-time detection at 65 frames per second, which confirms the effectiveness and efficiency of our method in detecting camouflaged people in various typical desert and forest scenes. Our approach offers valuable support to improve the perception capabilities of unmanned aerial vehicles in detecting enemy forces and rescuing personnel in battlefield.
文摘露天矿区场景复杂,行车障碍物检测受扬尘和颗粒物等粉尘噪声干扰严重,难以准确识别障碍物,尤其是光线较差的夜间,不利于做出正确决策,从而影响无人作业的安全性和整体效率。针对以上问题,提出了一种基于YOLOv8n模型的露天矿区行车障碍物检测算法YOLOv8n-Enhanced。该算法主要从3个方面进行了改进,具体包括:首先,针对受粉尘噪声干扰严重和夜间光线不足的问题,提出了C2fCA模块结构,提高了模型特征提取能力;其次,使用轻量级卷积技术GSConv和VoV-GSCSP模块,减轻模型复杂性,实现检测器更高的计算成本效益;最后,使用WIOU损失函数,提高了模型泛化能力。试验结果表明:改进算法在保持实时性的前提下,可将YOLOv8n的平均精度(mean Average Precision,mAP)分别提高1.8%和2.6%,实现白天与夜间场景下不同尺度的障碍物识别。
