The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in ...The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in the per-frame 3D posture estimation from two-dimensional(2D)mapping to 3D mapping.Firstly,by examining the relationship between the movements of different bones in the human body,four virtual skeletons are proposed to enhance the cyclic constraints of limb joints.Then,multiple parameters describing the skeleton are fused and projected into a high-dimensional space.Utilizing a multi-branch network,motion features between bones and overall motion features are extracted to mitigate the drift error in the estimation results.Furthermore,the estimated relative depth is projected into 3D space,and the error is calculated against real 3D data,forming a loss function along with the relative depth error.This article adopts the average joint pixel error as the primary performance metric.Compared to the benchmark approach,the estimation findings indicate an increase in average precision of 1.8 mm within the Human3.6M sample.展开更多
Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which ...Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which is crucial for intelligent applications,contradicts the lowdetection accuracy of human posture detection models in practical scenarios.To address this issue,a human pose estimation network called AT-HRNet has been proposed,which combines convolu-tional self-attention and cross-dimensional feature transformation.AT-HRNet captures significantfeature information from various regions in an adaptive manner,aggregating them through convolu-tional operations within the local receptive domain.The residual structures TripNeck and Trip-Block of the high-resolution network are designed to further refine the key point locations,wherethe attention weight is adjusted by a cross-dimensional interaction to obtain more features.To vali-date the effectiveness of this network,AT-HRNet was evaluated using the COCO2017 dataset.Theresults show that AT-HRNet outperforms HRNet by improving 3.2%in mAP,4.0%in AP75,and3.9%in AP^(M).This suggests that AT-HRNet can offer more beneficial solutions for human posture estimation.展开更多
According to recent research statistics,approximately 30%of people who experienced falls are over the age of 65.Therefore,it is meaningful research to detect it in time and take appropriate measures when falling behav...According to recent research statistics,approximately 30%of people who experienced falls are over the age of 65.Therefore,it is meaningful research to detect it in time and take appropriate measures when falling behavior occurs.In this paper,a fall detection model based on improved human posture estimation algorithm is proposed.The improved human posture estimation algorithm is implemented on the basis of Openpose.An im-proved strategy based on depthwise separable convolution combined with HDC structure is proposed.The depthwise separable convolution is used to replace the convolution neural network structure,which makes the network lightweight and reduces the redundant layer in the network.At the same time,in order to ensure that the image features are not lost and ensure the accuracy of detecting human joint points,HDC structure is introduced.Experiments show that the improved algorithm with HDC structure has higher accuracy in joint point detection.Then,human posture estimation is applied to fall detection research,and fall event modeling is carried out through fall feature extraction.The designed convolution neural network model is used to classify and distinguish falls.The experimental results show that our method achieves 98.53%,97.71%and 97.20%accuracy on three public fall detection data sets.Compared with the experimental results of other methods on the same data set,the model designed in this paper has a certain improvement in system accuracy.The sensitivity is also improved,which will reduce the error detection probability of the system.In addition,this paper also verifies the real-time performance of the model.Even if researchers are experimenting with low-level hardware,it can ensure a certain detection speed without too much delay.展开更多
基金supported by the Medical Special Cultivation Project of Anhui University of Science and Technology(Grant No.YZ2023H2B013)the Anhui Provincial Key Research and Development Project(Grant No.2022i01020015)the Open Project of Key Laboratory of Conveyance Equipment(East China Jiaotong University),Ministry of Education(KLCE2022-01).
文摘The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in the per-frame 3D posture estimation from two-dimensional(2D)mapping to 3D mapping.Firstly,by examining the relationship between the movements of different bones in the human body,four virtual skeletons are proposed to enhance the cyclic constraints of limb joints.Then,multiple parameters describing the skeleton are fused and projected into a high-dimensional space.Utilizing a multi-branch network,motion features between bones and overall motion features are extracted to mitigate the drift error in the estimation results.Furthermore,the estimated relative depth is projected into 3D space,and the error is calculated against real 3D data,forming a loss function along with the relative depth error.This article adopts the average joint pixel error as the primary performance metric.Compared to the benchmark approach,the estimation findings indicate an increase in average precision of 1.8 mm within the Human3.6M sample.
基金the National Natural Science Foundation of China(No.61975015)the Research and Innovation Project for Graduate Students at Zhongyuan University of Technology(No.YKY2024ZK14).
文摘Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which is crucial for intelligent applications,contradicts the lowdetection accuracy of human posture detection models in practical scenarios.To address this issue,a human pose estimation network called AT-HRNet has been proposed,which combines convolu-tional self-attention and cross-dimensional feature transformation.AT-HRNet captures significantfeature information from various regions in an adaptive manner,aggregating them through convolu-tional operations within the local receptive domain.The residual structures TripNeck and Trip-Block of the high-resolution network are designed to further refine the key point locations,wherethe attention weight is adjusted by a cross-dimensional interaction to obtain more features.To vali-date the effectiveness of this network,AT-HRNet was evaluated using the COCO2017 dataset.Theresults show that AT-HRNet outperforms HRNet by improving 3.2%in mAP,4.0%in AP75,and3.9%in AP^(M).This suggests that AT-HRNet can offer more beneficial solutions for human posture estimation.
文摘According to recent research statistics,approximately 30%of people who experienced falls are over the age of 65.Therefore,it is meaningful research to detect it in time and take appropriate measures when falling behavior occurs.In this paper,a fall detection model based on improved human posture estimation algorithm is proposed.The improved human posture estimation algorithm is implemented on the basis of Openpose.An im-proved strategy based on depthwise separable convolution combined with HDC structure is proposed.The depthwise separable convolution is used to replace the convolution neural network structure,which makes the network lightweight and reduces the redundant layer in the network.At the same time,in order to ensure that the image features are not lost and ensure the accuracy of detecting human joint points,HDC structure is introduced.Experiments show that the improved algorithm with HDC structure has higher accuracy in joint point detection.Then,human posture estimation is applied to fall detection research,and fall event modeling is carried out through fall feature extraction.The designed convolution neural network model is used to classify and distinguish falls.The experimental results show that our method achieves 98.53%,97.71%and 97.20%accuracy on three public fall detection data sets.Compared with the experimental results of other methods on the same data set,the model designed in this paper has a certain improvement in system accuracy.The sensitivity is also improved,which will reduce the error detection probability of the system.In addition,this paper also verifies the real-time performance of the model.Even if researchers are experimenting with low-level hardware,it can ensure a certain detection speed without too much delay.