In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swa...In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.展开更多
Deep learning for topology optimization has been extensively studied to reduce the cost of calculation in recent years.However,the loss function of the above method is mainly based on pixel-wise errors from the image ...Deep learning for topology optimization has been extensively studied to reduce the cost of calculation in recent years.However,the loss function of the above method is mainly based on pixel-wise errors from the image perspective,which cannot embed the physical knowledge of topology optimization.Therefore,this paper presents an improved deep learning model to alleviate the above difficulty effectively.The feature pyramid network(FPN),a kind of deep learning model,is trained to learn the inherent physical law of topology optimization itself,of which the loss function is composed of pixel-wise errors and physical constraints.Since the calculation of physical constraints requires finite element analysis(FEA)with high calculating costs,the strategy of adjusting the time when physical constraints are added is proposed to achieve the balance between the training cost and the training effect.Then,two classical topology optimization problems are investigated to verify the effectiveness of the proposed method.The results show that the developed model using a small number of samples can quickly obtain the optimization structure without any iteration,which has not only high pixel-wise accuracy but also good physical performance.展开更多
While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection ...While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection of objects with multiple aspect ratios and scales is still a key problem. This paper proposes a top-down and bottom-up feature pyramid network(TDBU-FPN),which combines multi-scale feature representation and anchor generation at multiple aspect ratios. First, in order to build the multi-scale feature map, this paper puts a number of fully convolutional layers after the backbone. Second, to link neighboring feature maps, top-down and bottom-up flows are adopted to introduce context information via top-down flow and supplement suboriginal information via bottom-up flow. The top-down flow refers to the deconvolution procedure, and the bottom-up flow refers to the pooling procedure. Third, the problem of adapting different object aspect ratios is tackled via many anchor shapes with different aspect ratios on each multi-scale feature map. The proposed method is evaluated on the pattern analysis, statistical modeling and computational learning visual object classes(PASCAL VOC)dataset and reaches an accuracy of 79%, which exhibits a 1.8% improvement with a detection speed of 23 fps.展开更多
SAR images commonly suffer fromspeckle noise,posing a significant challenge in their analysis and interpretation.Existing convolutional neural network(CNN)based despeckling methods have shown great performance in remo...SAR images commonly suffer fromspeckle noise,posing a significant challenge in their analysis and interpretation.Existing convolutional neural network(CNN)based despeckling methods have shown great performance in removing speckle noise.However,these CNN-basedmethods have a fewlimitations.They do not decouple complex background information in amulti-resolutionmanner.Moreover,they have deep network structures thatmay result in many parameters,limiting their applicability tomobile devices.Furthermore,extracting key speckle information in the presence of complex background is also a major problem with SAR.The proposed study addresses these limitations by introducing a lightweight pyramid and attention-based despeckling(PAN-Despeck)network.The primary objective is to enhance image quality and enable improved information interpretation,particularly on mobile devices and scenarios involving complex backgrounds.The PAN-Despeck network leverages domainspecific knowledge and integrates Gaussian Laplacian image pyramid decomposition for multi-resolution image analysis.By utilizing this approach,complex background information can be effectively decoupled,leading to enhanced despeckling performance.Furthermore,the attention mechanism selectively focuses on key speckle features and facilitates complex background removal.The network incorporates recursive and residual blocks to ensure computational efficiency and accelerate training speed,making it lightweight while maintaining high performance.Through comprehensive evaluations,it is demonstrated that PAN-Despeck outperforms existing image restoration methods.With an impressive average peak signal-to-noise ratio(PSNR)of 28.355114 and a remarkable structural similarity index(SSIM)of 0.905467,it demonstrates exceptional performance in effectively reducing speckle noise in SAR images.The source code for the PAN-DeSpeck network is available on GitHub.展开更多
Recognition of human activity is one of the most exciting aspects of time-series classification,with substantial practical and theoretical impli-cations.Recent evidence indicates that activity recognition from wearabl...Recognition of human activity is one of the most exciting aspects of time-series classification,with substantial practical and theoretical impli-cations.Recent evidence indicates that activity recognition from wearable sensors is an effective technique for tracking elderly adults and children in indoor and outdoor environments.Consequently,researchers have demon-strated considerable passion for developing cutting-edge deep learning sys-tems capable of exploiting unprocessed sensor data from wearable devices and generating practical decision assistance in many contexts.This study provides a deep learning-based approach for recognizing indoor and outdoor movement utilizing an enhanced deep pyramidal residual model called Sen-PyramidNet and motion information from wearable sensors(accelerometer and gyroscope).The suggested technique develops a residual unit based on a deep pyramidal residual network and introduces the concept of a pyramidal residual unit to increase detection capability.The proposed deep learning-based model was assessed using the publicly available 19Nonsens dataset,which gathered motion signals from various indoor and outdoor activities,including practicing various body parts.The experimental findings demon-strate that the proposed approach can efficiently reuse characteristics and has achieved an identification accuracy of 96.37%for indoor and 97.25%for outdoor activity.Moreover,comparison experiments demonstrate that the SenPyramidNet surpasses other cutting-edge deep learning models in terms of accuracy and F1-score.Furthermore,this study explores the influence of several wearable sensors on indoor and outdoor action recognition ability.展开更多
Generalized Farey tree network(GFTN)and generalized Farey organized pyramid network(GFOPN)model are proposed,and their topological characteristics are studied by both theoreticalanalysis and numerical simulations,whic...Generalized Farey tree network(GFTN)and generalized Farey organized pyramid network(GFOPN)model are proposed,and their topological characteristics are studied by both theoreticalanalysis and numerical simulations,which are in good accordance with each other.Then weightedGFTN is studied using cumulative distributions of its Farey number value,edge weight,and nodestrength.These results maybe helpful for future theoretical develonment of hvbrid models.展开更多
为了解决金属表面缺陷检测的漏检、误检等问题,提出了一种改进YOLOv3算法。首先,使用动态激活函数替换主干特征提取网络中所有残差块的激活函数,并加入了混合注意力机制,强化其对复杂缺陷目标的特征提取能力。然后,在特征金字塔网络部...为了解决金属表面缺陷检测的漏检、误检等问题,提出了一种改进YOLOv3算法。首先,使用动态激活函数替换主干特征提取网络中所有残差块的激活函数,并加入了混合注意力机制,强化其对复杂缺陷目标的特征提取能力。然后,在特征金字塔网络部分新增一个104×104的特征层,并将浅层网络与深层网络进行逐层特征融合,增强算法对小缺陷目标检测的敏感性。最后,利用K-Means++聚类算法替换K-Means聚类算法,筛选出适用于金属表面缺陷检测的最优先验框尺寸,使目标定位更加准确。实验结果表明,改进YOLOv3算法的每秒检测帧数(frames per second,FPS)可达到32.3,平均精度均值(mean average precision,mAP)可达到78.69%,检测性能得到了明显提升。展开更多
针对步态识别易受拍摄视角、外观变化等影响的问题,提出一种基于双支路卷积网络的步态识别方法。首先,提出随机裁剪随机遮挡的数据增强方法RRDA(Restricted Random Data Augmentation),以扩展外观变化的数据样本,提高模型遮挡的鲁棒性;...针对步态识别易受拍摄视角、外观变化等影响的问题,提出一种基于双支路卷积网络的步态识别方法。首先,提出随机裁剪随机遮挡的数据增强方法RRDA(Restricted Random Data Augmentation),以扩展外观变化的数据样本,提高模型遮挡的鲁棒性;其次,采用结合注意力机制的两路复合卷积层(C-Conv)提取步态特征,一个分支通过水平金字塔映射(HPM)提取行人外观全局和最具辨识度的信息;另一分支通过多个并行的微动作捕捉模块(MCM)提取短时间的步态时空信息;最后,将两个分支的特征信息相加融合,再通过全连接层实现步态识别。基于平衡样本特征的区分能力和模型的收敛性构造联合损失函数,以加速模型的收敛。在CASIA-B步态数据集上进行实验,所提方法在3种行走状态下的平均识别率分别达到97.40%、93.67%和81.19%,均高于GaitSet方法、CapsNet方法、双流步态方法和GaitPart方法;在正常行走状态下比GaitSet方法的识别准确率提升了1.30个百分点,在携带背包状态下提升了2.87个百分点,在穿着外套状态下提升了10.89个百分点。实验结果表明,所提方法是可行、有效的。展开更多
文摘In this paper,based on a bidirectional parallel multi-branch feature pyramid network(BPMFPN),a novel one-stage object detector called BPMFPN Det is proposed for real-time detection of ground multi-scale targets by swarm unmanned aerial vehicles(UAVs).First,the bidirectional parallel multi-branch convolution modules are used to construct the feature pyramid to enhance the feature expression abilities of different scale feature layers.Next,the feature pyramid is integrated into the single-stage object detection framework to ensure real-time performance.In order to validate the effectiveness of the proposed algorithm,experiments are conducted on four datasets.For the PASCAL VOC dataset,the proposed algorithm achieves the mean average precision(mAP)of 85.4 on the VOC 2007 test set.With regard to the detection in optical remote sensing(DIOR)dataset,the proposed algorithm achieves 73.9 mAP.For vehicle detection in aerial imagery(VEDAI)dataset,the detection accuracy of small land vehicle(slv)targets reaches 97.4 mAP.For unmanned aerial vehicle detection and tracking(UAVDT)dataset,the proposed BPMFPN Det achieves the mAP of 48.75.Compared with the previous state-of-the-art methods,the results obtained by the proposed algorithm are more competitive.The experimental results demonstrate that the proposed algorithm can effectively solve the problem of real-time detection of ground multi-scale targets in aerial images of swarm UAVs.
基金This work was supported in part by National Natural Science Foundation of China under Grant Nos.11725211,52005505,and 62001502Post-graduate Scientific Research Innovation Project of Hunan Province under Grant No.CX20200023.
文摘Deep learning for topology optimization has been extensively studied to reduce the cost of calculation in recent years.However,the loss function of the above method is mainly based on pixel-wise errors from the image perspective,which cannot embed the physical knowledge of topology optimization.Therefore,this paper presents an improved deep learning model to alleviate the above difficulty effectively.The feature pyramid network(FPN),a kind of deep learning model,is trained to learn the inherent physical law of topology optimization itself,of which the loss function is composed of pixel-wise errors and physical constraints.Since the calculation of physical constraints requires finite element analysis(FEA)with high calculating costs,the strategy of adjusting the time when physical constraints are added is proposed to achieve the balance between the training cost and the training effect.Then,two classical topology optimization problems are investigated to verify the effectiveness of the proposed method.The results show that the developed model using a small number of samples can quickly obtain the optimization structure without any iteration,which has not only high pixel-wise accuracy but also good physical performance.
基金supported by the Program of Introducing Talents of Discipline to Universities(111 Plan)of China(B14010)the National Natural Science Foundation of China(31727901)
文摘While moving ahead with the object detection technology, especially deep neural networks, many related tasks, such as medical application and industrial automation, have achieved great success. However, the detection of objects with multiple aspect ratios and scales is still a key problem. This paper proposes a top-down and bottom-up feature pyramid network(TDBU-FPN),which combines multi-scale feature representation and anchor generation at multiple aspect ratios. First, in order to build the multi-scale feature map, this paper puts a number of fully convolutional layers after the backbone. Second, to link neighboring feature maps, top-down and bottom-up flows are adopted to introduce context information via top-down flow and supplement suboriginal information via bottom-up flow. The top-down flow refers to the deconvolution procedure, and the bottom-up flow refers to the pooling procedure. Third, the problem of adapting different object aspect ratios is tackled via many anchor shapes with different aspect ratios on each multi-scale feature map. The proposed method is evaluated on the pattern analysis, statistical modeling and computational learning visual object classes(PASCAL VOC)dataset and reaches an accuracy of 79%, which exhibits a 1.8% improvement with a detection speed of 23 fps.
文摘SAR images commonly suffer fromspeckle noise,posing a significant challenge in their analysis and interpretation.Existing convolutional neural network(CNN)based despeckling methods have shown great performance in removing speckle noise.However,these CNN-basedmethods have a fewlimitations.They do not decouple complex background information in amulti-resolutionmanner.Moreover,they have deep network structures thatmay result in many parameters,limiting their applicability tomobile devices.Furthermore,extracting key speckle information in the presence of complex background is also a major problem with SAR.The proposed study addresses these limitations by introducing a lightweight pyramid and attention-based despeckling(PAN-Despeck)network.The primary objective is to enhance image quality and enable improved information interpretation,particularly on mobile devices and scenarios involving complex backgrounds.The PAN-Despeck network leverages domainspecific knowledge and integrates Gaussian Laplacian image pyramid decomposition for multi-resolution image analysis.By utilizing this approach,complex background information can be effectively decoupled,leading to enhanced despeckling performance.Furthermore,the attention mechanism selectively focuses on key speckle features and facilitates complex background removal.The network incorporates recursive and residual blocks to ensure computational efficiency and accelerate training speed,making it lightweight while maintaining high performance.Through comprehensive evaluations,it is demonstrated that PAN-Despeck outperforms existing image restoration methods.With an impressive average peak signal-to-noise ratio(PSNR)of 28.355114 and a remarkable structural similarity index(SSIM)of 0.905467,it demonstrates exceptional performance in effectively reducing speckle noise in SAR images.The source code for the PAN-DeSpeck network is available on GitHub.
基金supported by the Thailand Science Research and Innovation Fundthe University of Phayao(Grant No.FF66-UoE001)King Mongkut’s University of Technology North Bangkok,Contract No.KMUTNB-66-KNOW-05.
文摘Recognition of human activity is one of the most exciting aspects of time-series classification,with substantial practical and theoretical impli-cations.Recent evidence indicates that activity recognition from wearable sensors is an effective technique for tracking elderly adults and children in indoor and outdoor environments.Consequently,researchers have demon-strated considerable passion for developing cutting-edge deep learning sys-tems capable of exploiting unprocessed sensor data from wearable devices and generating practical decision assistance in many contexts.This study provides a deep learning-based approach for recognizing indoor and outdoor movement utilizing an enhanced deep pyramidal residual model called Sen-PyramidNet and motion information from wearable sensors(accelerometer and gyroscope).The suggested technique develops a residual unit based on a deep pyramidal residual network and introduces the concept of a pyramidal residual unit to increase detection capability.The proposed deep learning-based model was assessed using the publicly available 19Nonsens dataset,which gathered motion signals from various indoor and outdoor activities,including practicing various body parts.The experimental findings demon-strate that the proposed approach can efficiently reuse characteristics and has achieved an identification accuracy of 96.37%for indoor and 97.25%for outdoor activity.Moreover,comparison experiments demonstrate that the SenPyramidNet surpasses other cutting-edge deep learning models in terms of accuracy and F1-score.Furthermore,this study explores the influence of several wearable sensors on indoor and outdoor action recognition ability.
基金supported by the Nature Science Foundation of China under Grand Nos. 70431002, 60874087, 60773120, and 10647001the Nature Science Foundation of Beijing under Grand No. 4092040
文摘Generalized Farey tree network(GFTN)and generalized Farey organized pyramid network(GFOPN)model are proposed,and their topological characteristics are studied by both theoreticalanalysis and numerical simulations,which are in good accordance with each other.Then weightedGFTN is studied using cumulative distributions of its Farey number value,edge weight,and nodestrength.These results maybe helpful for future theoretical develonment of hvbrid models.
基金supported by the International Research Center of Big Data for Sustainable Development Goals [grant number CBAS2022GSP01]the National Natural Science Foundation of China [grant numbers 42276203 and 42030406]+1 种基金the Natural Science Foundation of Shandong Province [grant number ZR2021MD001]the Laoshan Laboratory [grant number LSKJ202204302].
文摘为了解决金属表面缺陷检测的漏检、误检等问题,提出了一种改进YOLOv3算法。首先,使用动态激活函数替换主干特征提取网络中所有残差块的激活函数,并加入了混合注意力机制,强化其对复杂缺陷目标的特征提取能力。然后,在特征金字塔网络部分新增一个104×104的特征层,并将浅层网络与深层网络进行逐层特征融合,增强算法对小缺陷目标检测的敏感性。最后,利用K-Means++聚类算法替换K-Means聚类算法,筛选出适用于金属表面缺陷检测的最优先验框尺寸,使目标定位更加准确。实验结果表明,改进YOLOv3算法的每秒检测帧数(frames per second,FPS)可达到32.3,平均精度均值(mean average precision,mAP)可达到78.69%,检测性能得到了明显提升。
文摘针对步态识别易受拍摄视角、外观变化等影响的问题,提出一种基于双支路卷积网络的步态识别方法。首先,提出随机裁剪随机遮挡的数据增强方法RRDA(Restricted Random Data Augmentation),以扩展外观变化的数据样本,提高模型遮挡的鲁棒性;其次,采用结合注意力机制的两路复合卷积层(C-Conv)提取步态特征,一个分支通过水平金字塔映射(HPM)提取行人外观全局和最具辨识度的信息;另一分支通过多个并行的微动作捕捉模块(MCM)提取短时间的步态时空信息;最后,将两个分支的特征信息相加融合,再通过全连接层实现步态识别。基于平衡样本特征的区分能力和模型的收敛性构造联合损失函数,以加速模型的收敛。在CASIA-B步态数据集上进行实验,所提方法在3种行走状态下的平均识别率分别达到97.40%、93.67%和81.19%,均高于GaitSet方法、CapsNet方法、双流步态方法和GaitPart方法;在正常行走状态下比GaitSet方法的识别准确率提升了1.30个百分点,在携带背包状态下提升了2.87个百分点,在穿着外套状态下提升了10.89个百分点。实验结果表明,所提方法是可行、有效的。