The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in ...The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in the per-frame 3D posture estimation from two-dimensional(2D)mapping to 3D mapping.Firstly,by examining the relationship between the movements of different bones in the human body,four virtual skeletons are proposed to enhance the cyclic constraints of limb joints.Then,multiple parameters describing the skeleton are fused and projected into a high-dimensional space.Utilizing a multi-branch network,motion features between bones and overall motion features are extracted to mitigate the drift error in the estimation results.Furthermore,the estimated relative depth is projected into 3D space,and the error is calculated against real 3D data,forming a loss function along with the relative depth error.This article adopts the average joint pixel error as the primary performance metric.Compared to the benchmark approach,the estimation findings indicate an increase in average precision of 1.8 mm within the Human3.6M sample.展开更多
Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which ...Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which is crucial for intelligent applications,contradicts the lowdetection accuracy of human posture detection models in practical scenarios.To address this issue,a human pose estimation network called AT-HRNet has been proposed,which combines convolu-tional self-attention and cross-dimensional feature transformation.AT-HRNet captures significantfeature information from various regions in an adaptive manner,aggregating them through convolu-tional operations within the local receptive domain.The residual structures TripNeck and Trip-Block of the high-resolution network are designed to further refine the key point locations,wherethe attention weight is adjusted by a cross-dimensional interaction to obtain more features.To vali-date the effectiveness of this network,AT-HRNet was evaluated using the COCO2017 dataset.Theresults show that AT-HRNet outperforms HRNet by improving 3.2%in mAP,4.0%in AP75,and3.9%in AP^(M).This suggests that AT-HRNet can offer more beneficial solutions for human posture estimation.展开更多
According to recent research statistics,approximately 30%of people who experienced falls are over the age of 65.Therefore,it is meaningful research to detect it in time and take appropriate measures when falling behav...According to recent research statistics,approximately 30%of people who experienced falls are over the age of 65.Therefore,it is meaningful research to detect it in time and take appropriate measures when falling behavior occurs.In this paper,a fall detection model based on improved human posture estimation algorithm is proposed.The improved human posture estimation algorithm is implemented on the basis of Openpose.An im-proved strategy based on depthwise separable convolution combined with HDC structure is proposed.The depthwise separable convolution is used to replace the convolution neural network structure,which makes the network lightweight and reduces the redundant layer in the network.At the same time,in order to ensure that the image features are not lost and ensure the accuracy of detecting human joint points,HDC structure is introduced.Experiments show that the improved algorithm with HDC structure has higher accuracy in joint point detection.Then,human posture estimation is applied to fall detection research,and fall event modeling is carried out through fall feature extraction.The designed convolution neural network model is used to classify and distinguish falls.The experimental results show that our method achieves 98.53%,97.71%and 97.20%accuracy on three public fall detection data sets.Compared with the experimental results of other methods on the same data set,the model designed in this paper has a certain improvement in system accuracy.The sensitivity is also improved,which will reduce the error detection probability of the system.In addition,this paper also verifies the real-time performance of the model.Even if researchers are experimenting with low-level hardware,it can ensure a certain detection speed without too much delay.展开更多
With the development of technology and the progress of life,more and more people,regardless of entertainment,learning,or work,cannot do without computer desks and cannot put down their mobile phones.Due to prolonged s...With the development of technology and the progress of life,more and more people,regardless of entertainment,learning,or work,cannot do without computer desks and cannot put down their mobile phones.Due to prolonged sitting and often neglecting the importance of posture,incorrect posture can often lead to health problems such as hunchback,lumbar muscle strain,and shoulder and neck pain over time.To address this issue,we designed a computer vision-based human body posture detection system.The system utilizes YOLOv8 technology to accurately locate key points of the human body skeleton,and then analyzes the coordinate positions and depth information of these key points to establish a criterion for distinguishing different postures.With the assistance of an SVM classifier,the system achieves an average recognition rate of 95%.Finally,we successfully deployed the posture detection system on Raspberry Pi hardware and conducted extensive testing.The test results demonstrate that the system can effectively detect various postures and provide real-time reminders to users to correct poor posture,demonstrating good practicality and stability.展开更多
Sleep posture surveillance is crucial for patient comfort,yet current systems face difficulties in providing compre-hensive studies due to the obstruction caused by blankets.Precise posture assessment remains challeng...Sleep posture surveillance is crucial for patient comfort,yet current systems face difficulties in providing compre-hensive studies due to the obstruction caused by blankets.Precise posture assessment remains challenging because of the complex nature of the human body and variations in sleep patterns.Consequently,this study introduces an innovative method utilizing RGB and thermal cameras for comprehensive posture classification,thereby enhancing the analysis of body position and comfort.This method begins by capturing a dataset of sleep postures in the form of videos using RGB and thermal cameras,which depict six commonly adopted postures:supine,left log,right log,prone head,prone left,and prone right.The study involves 10 participants under two conditions:with and without blankets.Initially,the database is normalized into a video frame.The subsequent step entails training a fine-tuned,pretrained Visual Geometry Group(VGG16)and ResNet50 model.In the third phase,the extracted features are utilized for classification.The fourth step of the proposed approach employs a serial fusion technique based on the normal distribution to merge the vectors derived from both the RGB and thermal datasets.Finally,the fused vectors are passed to machine learning classifiers for final classification.The dataset,which includes human sleep postures used in this study’s experiments,achieved a 96.7%accuracy rate using the Quadratic Support Vector Machine(QSVM)without the blanket.Moreover,the Linear SVM,when utilized with a blanket,attained an accuracy of 96%.When normal distribution serial fusion was applied to the blanket features,it resulted in a remarkable average accuracy of 99%.展开更多
Tactile sensors are essential components of wearable electronic devices,but there are still various problems in terms of energy supply,flexibility and skin adaptability.In this paper,we report a self-powered flexible ...Tactile sensors are essential components of wearable electronic devices,but there are still various problems in terms of energy supply,flexibility and skin adaptability.In this paper,we report a self-powered flexible tactile sensor(FTS)mainly composed of a BaTiO_(3)/polyacrylonitrile/Ecoflex(BTO/PAN/Ecoflex)composite film,which can be used for dynamically monitoring human plantar pressure,posture and other physiological and motion parameters.Combining the synergistic piezoelectric properties of PAN and BTO,the output voltage/current of the BTO/PAN/Ecoflex composite film is 4.5/5.8 times that of the BTO/Ecoflex composite film,with maximum instantaneous power that can reach up to 3.375μW.Under the action of external pressure stress,the FTS can reach a normalized voltage sensitivity and voltage linearity of 0.54 V/N and 0.98,respectively.Furthermore,a human-machine interaction test system is built,which can display the stress changes of human body monitoring parts in real time according to voltage changes and different color assignments.The developed human-machine interaction test system provides a new idea for the diagnosis of flatfoot and other medical diseases.Hence,this work proposes new FTSs that use a BTO/PAN/Ecoflex composite film with high sensitivity and great output performance,thus exhibiting immense potential application prospects in medical research,personalized recognition and human-machine interaction.展开更多
A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper.In this method,the original image sequence data i...A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper.In this method,the original image sequence data is first separated from the foreground and background.Then,the free anchor frame detection method is used in the foreground image to detect the personnel and correct their direction.Finally,human posture nodes are extracted from each frame of the image sequence,which are then used to identify the abnormal behavior of the human.Simulation experiment results demonstrate that the proposed algorithm has significant advantages in terms of the accuracy of human posture node detection and risk behavior identification.展开更多
Mobile device research has been increasing rapidly in Human Computer Interaction (HCI) recently. Following this trend, this paper proposes a user-centered interface, which has been designed, completely installed and...Mobile device research has been increasing rapidly in Human Computer Interaction (HCI) recently. Following this trend, this paper proposes a user-centered interface, which has been designed, completely installed and independently run on a mobile phone. Video signal is steamed through its camera as the image input to the interface by employing techniques of image processing, computer vision and graphics to identify automatically absolute positions of human face, neck and two hands. A paradigm is also put up theoretically. And it embeds this interface to perceive the human postures and convert them into relaxed comic character according to its context.展开更多
基金supported by the Medical Special Cultivation Project of Anhui University of Science and Technology(Grant No.YZ2023H2B013)the Anhui Provincial Key Research and Development Project(Grant No.2022i01020015)the Open Project of Key Laboratory of Conveyance Equipment(East China Jiaotong University),Ministry of Education(KLCE2022-01).
文摘The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in the per-frame 3D posture estimation from two-dimensional(2D)mapping to 3D mapping.Firstly,by examining the relationship between the movements of different bones in the human body,four virtual skeletons are proposed to enhance the cyclic constraints of limb joints.Then,multiple parameters describing the skeleton are fused and projected into a high-dimensional space.Utilizing a multi-branch network,motion features between bones and overall motion features are extracted to mitigate the drift error in the estimation results.Furthermore,the estimated relative depth is projected into 3D space,and the error is calculated against real 3D data,forming a loss function along with the relative depth error.This article adopts the average joint pixel error as the primary performance metric.Compared to the benchmark approach,the estimation findings indicate an increase in average precision of 1.8 mm within the Human3.6M sample.
基金the National Natural Science Foundation of China(No.61975015)the Research and Innovation Project for Graduate Students at Zhongyuan University of Technology(No.YKY2024ZK14).
文摘Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which is crucial for intelligent applications,contradicts the lowdetection accuracy of human posture detection models in practical scenarios.To address this issue,a human pose estimation network called AT-HRNet has been proposed,which combines convolu-tional self-attention and cross-dimensional feature transformation.AT-HRNet captures significantfeature information from various regions in an adaptive manner,aggregating them through convolu-tional operations within the local receptive domain.The residual structures TripNeck and Trip-Block of the high-resolution network are designed to further refine the key point locations,wherethe attention weight is adjusted by a cross-dimensional interaction to obtain more features.To vali-date the effectiveness of this network,AT-HRNet was evaluated using the COCO2017 dataset.Theresults show that AT-HRNet outperforms HRNet by improving 3.2%in mAP,4.0%in AP75,and3.9%in AP^(M).This suggests that AT-HRNet can offer more beneficial solutions for human posture estimation.
文摘According to recent research statistics,approximately 30%of people who experienced falls are over the age of 65.Therefore,it is meaningful research to detect it in time and take appropriate measures when falling behavior occurs.In this paper,a fall detection model based on improved human posture estimation algorithm is proposed.The improved human posture estimation algorithm is implemented on the basis of Openpose.An im-proved strategy based on depthwise separable convolution combined with HDC structure is proposed.The depthwise separable convolution is used to replace the convolution neural network structure,which makes the network lightweight and reduces the redundant layer in the network.At the same time,in order to ensure that the image features are not lost and ensure the accuracy of detecting human joint points,HDC structure is introduced.Experiments show that the improved algorithm with HDC structure has higher accuracy in joint point detection.Then,human posture estimation is applied to fall detection research,and fall event modeling is carried out through fall feature extraction.The designed convolution neural network model is used to classify and distinguish falls.The experimental results show that our method achieves 98.53%,97.71%and 97.20%accuracy on three public fall detection data sets.Compared with the experimental results of other methods on the same data set,the model designed in this paper has a certain improvement in system accuracy.The sensitivity is also improved,which will reduce the error detection probability of the system.In addition,this paper also verifies the real-time performance of the model.Even if researchers are experimenting with low-level hardware,it can ensure a certain detection speed without too much delay.
基金funded by the Science and Technology Project of Hebei Education Department (No.ZD2022100).
文摘With the development of technology and the progress of life,more and more people,regardless of entertainment,learning,or work,cannot do without computer desks and cannot put down their mobile phones.Due to prolonged sitting and often neglecting the importance of posture,incorrect posture can often lead to health problems such as hunchback,lumbar muscle strain,and shoulder and neck pain over time.To address this issue,we designed a computer vision-based human body posture detection system.The system utilizes YOLOv8 technology to accurately locate key points of the human body skeleton,and then analyzes the coordinate positions and depth information of these key points to establish a criterion for distinguishing different postures.With the assistance of an SVM classifier,the system achieves an average recognition rate of 95%.Finally,we successfully deployed the posture detection system on Raspberry Pi hardware and conducted extensive testing.The test results demonstrate that the system can effectively detect various postures and provide real-time reminders to users to correct poor posture,demonstrating good practicality and stability.
基金supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute(KHIDI)funded by the Ministry of Health&Welfare,Republic of Korea(Grant Number:H12C1831)+2 种基金Korea Institute for Advancement of Technology(KIAT)Grant funded by the Korea Government(MOTIE)(P0012724,HRD Program for Industrial Innovation)the National Research Foundation of Korea(NRF)Grant funded by the Korea Government(MSIT)(No.RS-2023-00218176)the Soonchunhyang University Research Fund.
文摘Sleep posture surveillance is crucial for patient comfort,yet current systems face difficulties in providing compre-hensive studies due to the obstruction caused by blankets.Precise posture assessment remains challenging because of the complex nature of the human body and variations in sleep patterns.Consequently,this study introduces an innovative method utilizing RGB and thermal cameras for comprehensive posture classification,thereby enhancing the analysis of body position and comfort.This method begins by capturing a dataset of sleep postures in the form of videos using RGB and thermal cameras,which depict six commonly adopted postures:supine,left log,right log,prone head,prone left,and prone right.The study involves 10 participants under two conditions:with and without blankets.Initially,the database is normalized into a video frame.The subsequent step entails training a fine-tuned,pretrained Visual Geometry Group(VGG16)and ResNet50 model.In the third phase,the extracted features are utilized for classification.The fourth step of the proposed approach employs a serial fusion technique based on the normal distribution to merge the vectors derived from both the RGB and thermal datasets.Finally,the fused vectors are passed to machine learning classifiers for final classification.The dataset,which includes human sleep postures used in this study’s experiments,achieved a 96.7%accuracy rate using the Quadratic Support Vector Machine(QSVM)without the blanket.Moreover,the Linear SVM,when utilized with a blanket,attained an accuracy of 96%.When normal distribution serial fusion was applied to the blanket features,it resulted in a remarkable average accuracy of 99%.
基金supported by the National Key R&D Program of China(Grant Nos. 2019YFF0301802, 2019YFB2004802 and 2018YFF0300605)the National Natural Science Foundation of China (Grant Nos. 62101513,52175554, 51975542)+1 种基金the Applied Fundamental Research Program of Shanxi Province (Grant Nos. 201901D111146, 20210302124170)Shanxi “1331 Project” Key Subject Construction (Grant No. 1331KSC)
文摘Tactile sensors are essential components of wearable electronic devices,but there are still various problems in terms of energy supply,flexibility and skin adaptability.In this paper,we report a self-powered flexible tactile sensor(FTS)mainly composed of a BaTiO_(3)/polyacrylonitrile/Ecoflex(BTO/PAN/Ecoflex)composite film,which can be used for dynamically monitoring human plantar pressure,posture and other physiological and motion parameters.Combining the synergistic piezoelectric properties of PAN and BTO,the output voltage/current of the BTO/PAN/Ecoflex composite film is 4.5/5.8 times that of the BTO/Ecoflex composite film,with maximum instantaneous power that can reach up to 3.375μW.Under the action of external pressure stress,the FTS can reach a normalized voltage sensitivity and voltage linearity of 0.54 V/N and 0.98,respectively.Furthermore,a human-machine interaction test system is built,which can display the stress changes of human body monitoring parts in real time according to voltage changes and different color assignments.The developed human-machine interaction test system provides a new idea for the diagnosis of flatfoot and other medical diseases.Hence,this work proposes new FTSs that use a BTO/PAN/Ecoflex composite film with high sensitivity and great output performance,thus exhibiting immense potential application prospects in medical research,personalized recognition and human-machine interaction.
基金supported by the project“Research and application of key technologies of safe production management and control of substation operation and maintenance based on video semantic analysis”(5700-202133259A-0-0-00)of the State Grid Corporation of China.
文摘A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper.In this method,the original image sequence data is first separated from the foreground and background.Then,the free anchor frame detection method is used in the foreground image to detect the personnel and correct their direction.Finally,human posture nodes are extracted from each frame of the image sequence,which are then used to identify the abnormal behavior of the human.Simulation experiment results demonstrate that the proposed algorithm has significant advantages in terms of the accuracy of human posture node detection and risk behavior identification.
基金supported by the MKE(The Ministry of Knowledge Economy),Korea,under the ITRC(Information Technology Research Center) support program supervised by the NIPA(National ITIndustry Promotion Agency)(NIPA-2009-(C1090-0902-0007))the Soongsil University BK21 Digital Media Division
文摘Mobile device research has been increasing rapidly in Human Computer Interaction (HCI) recently. Following this trend, this paper proposes a user-centered interface, which has been designed, completely installed and independently run on a mobile phone. Video signal is steamed through its camera as the image input to the interface by employing techniques of image processing, computer vision and graphics to identify automatically absolute positions of human face, neck and two hands. A paradigm is also put up theoretically. And it embeds this interface to perceive the human postures and convert them into relaxed comic character according to its context.