Non-obstacle design is critical to tailor physically handicapped workers in manufacturing system. Simultaneous consideration of variability in physically disabled users, machines and environment of the manufacturing s...Non-obstacle design is critical to tailor physically handicapped workers in manufacturing system. Simultaneous consideration of variability in physically disabled users, machines and environment of the manufacturing system is extremely complex and generally requires modeling of physically handicapped interaction with the system. Most current modeling either concentrates on the task results or functional disability. The integration of physical constraints with task constraints is far more complex because of functional disability and its extended influence on adjacent body parts. A framework is proposed to integrate the two constraints and thus model the specific behavior of the physical handicapped in virtual environment generated by product specifications. Within the framework a simplified model of physical disabled body is constructed, and body motion is generated based on 3 levels of constraints(effecter constraints, kinematics constraints and physical constraints). The kinematics and dynamic calculations are made and optimized based on the weighting manipulated by the kinematics constraints and dynamic constraints. With object transferring task as example, the model is validated in Jack 6.0. Modelled task motion elements except for squatting and overreaching well matched with captured motion elements. The proposed modeling method can model the complex behavior of the physically handicapped by integrating both task and physical disability constraints.展开更多
This study proposes a pose estimation-convolutional neural network-bidirectional gated recurrent unit(PSECNN-BiGRU)fusion model for human posture recognition to address low accuracy issues in abnormal posture recognit...This study proposes a pose estimation-convolutional neural network-bidirectional gated recurrent unit(PSECNN-BiGRU)fusion model for human posture recognition to address low accuracy issues in abnormal posture recognition due to the loss of some feature information and the deterioration of comprehensive performance in model detection in complex home environments.Firstly,the deep convolutional network is integrated with the Mediapipe framework to extract high-precision,multi-dimensional information from the key points of the human skeleton,thereby obtaining a human posture feature set.Thereafter,a double-layer BiGRU algorithm is utilized to extract multi-layer,bidirectional temporal features from the human posture feature set,and a CNN network with an exponential linear unit(ELU)activation function is adopted to perform deep convolution of the feature map to extract the spatial feature of the human posture.Furthermore,a squeeze and excitation networks(SENet)module is introduced to adaptively learn the importance weights of each channel,enhancing the network’s focus on important features.Finally,comparative experiments are performed on available datasets,including the public human activity recognition using smartphone dataset(UCIHAR),the public human activity recognition 70 plus dataset(HAR70PLUS),and the independently developed home abnormal behavior recognition dataset(HABRD)created by the authors’team.The results show that the average accuracy of the proposed PSE-CNN-BiGRU fusion model for human posture recognition is 99.56%,89.42%,and 98.90%,respectively,which are 5.24%,5.83%,and 3.19%higher than the average accuracy of the five models proposed in the comparative literature,including CNN,GRU,and others.The F1-score for abnormal posture recognition reaches 98.84%(heartache),97.18%(fall),99.6%(bellyache),and 98.27%(climbing)on the self-builtHABRDdataset,thus verifying the effectiveness,generalization,and robustness of the proposed model in enhancing human posture recognition.展开更多
The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in ...The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in the per-frame 3D posture estimation from two-dimensional(2D)mapping to 3D mapping.Firstly,by examining the relationship between the movements of different bones in the human body,four virtual skeletons are proposed to enhance the cyclic constraints of limb joints.Then,multiple parameters describing the skeleton are fused and projected into a high-dimensional space.Utilizing a multi-branch network,motion features between bones and overall motion features are extracted to mitigate the drift error in the estimation results.Furthermore,the estimated relative depth is projected into 3D space,and the error is calculated against real 3D data,forming a loss function along with the relative depth error.This article adopts the average joint pixel error as the primary performance metric.Compared to the benchmark approach,the estimation findings indicate an increase in average precision of 1.8 mm within the Human3.6M sample.展开更多
Sleep posture surveillance is crucial for patient comfort,yet current systems face difficulties in providing compre-hensive studies due to the obstruction caused by blankets.Precise posture assessment remains challeng...Sleep posture surveillance is crucial for patient comfort,yet current systems face difficulties in providing compre-hensive studies due to the obstruction caused by blankets.Precise posture assessment remains challenging because of the complex nature of the human body and variations in sleep patterns.Consequently,this study introduces an innovative method utilizing RGB and thermal cameras for comprehensive posture classification,thereby enhancing the analysis of body position and comfort.This method begins by capturing a dataset of sleep postures in the form of videos using RGB and thermal cameras,which depict six commonly adopted postures:supine,left log,right log,prone head,prone left,and prone right.The study involves 10 participants under two conditions:with and without blankets.Initially,the database is normalized into a video frame.The subsequent step entails training a fine-tuned,pretrained Visual Geometry Group(VGG16)and ResNet50 model.In the third phase,the extracted features are utilized for classification.The fourth step of the proposed approach employs a serial fusion technique based on the normal distribution to merge the vectors derived from both the RGB and thermal datasets.Finally,the fused vectors are passed to machine learning classifiers for final classification.The dataset,which includes human sleep postures used in this study’s experiments,achieved a 96.7%accuracy rate using the Quadratic Support Vector Machine(QSVM)without the blanket.Moreover,the Linear SVM,when utilized with a blanket,attained an accuracy of 96%.When normal distribution serial fusion was applied to the blanket features,it resulted in a remarkable average accuracy of 99%.展开更多
Cardiovascular disease is the leading cause of death globally.This disease causes loss of heart muscles and is also responsible for the death of heart cells,sometimes damaging their functionality.A person’s life may ...Cardiovascular disease is the leading cause of death globally.This disease causes loss of heart muscles and is also responsible for the death of heart cells,sometimes damaging their functionality.A person’s life may depend on receiving timely assistance as soon as possible.Thus,minimizing the death ratio can be achieved by early detection of heart attack(HA)symptoms.In the United States alone,an estimated 610,000 people die fromheart attacks each year,accounting for one in every four fatalities.However,by identifying and reporting heart attack symptoms early on,it is possible to reduce damage and save many lives significantly.Our objective is to devise an algorithm aimed at helping individuals,particularly elderly individuals living independently,to safeguard their lives.To address these challenges,we employ deep learning techniques.We have utilized a vision transformer(ViT)to address this problem.However,it has a significant overhead cost due to its memory consumption and computational complexity because of scaling dot-product attention.Also,since transformer performance typically relies on large-scale or adequate data,adapting ViT for smaller datasets is more challenging.In response,we propose a three-in-one steam model,theMulti-Head Attention Vision Hybrid(MHAVH).Thismodel integrates a real-time posture recognition framework to identify chest pain postures indicative of heart attacks using transfer learning techniques,such as ResNet-50 and VGG-16,renowned for their robust feature extraction capabilities.By incorporatingmultiple heads into the vision transformer to generate additional metrics and enhance heart-detection capabilities,we leverage a 2019 posture-based dataset comprising RGB images,a novel creation by the author that marks the first dataset tailored for posture-based heart attack detection.Given the limited online data availability,we segmented this dataset into gender categories(male and female)and conducted testing on both segmented and original datasets.The training accuracy of our model reached an impressive 99.77%.Upon testing,the accuracy for male and female datasets was recorded at 92.87%and 75.47%,respectively.The combined dataset accuracy is 93.96%,showcasing a commendable performance overall.Our proposed approach demonstrates versatility in accommodating small and large datasets,offering promising prospects for real-world applications.展开更多
With the development of technology and the progress of life,more and more people,regardless of entertainment,learning,or work,cannot do without computer desks and cannot put down their mobile phones.Due to prolonged s...With the development of technology and the progress of life,more and more people,regardless of entertainment,learning,or work,cannot do without computer desks and cannot put down their mobile phones.Due to prolonged sitting and often neglecting the importance of posture,incorrect posture can often lead to health problems such as hunchback,lumbar muscle strain,and shoulder and neck pain over time.To address this issue,we designed a computer vision-based human body posture detection system.The system utilizes YOLOv8 technology to accurately locate key points of the human body skeleton,and then analyzes the coordinate positions and depth information of these key points to establish a criterion for distinguishing different postures.With the assistance of an SVM classifier,the system achieves an average recognition rate of 95%.Finally,we successfully deployed the posture detection system on Raspberry Pi hardware and conducted extensive testing.The test results demonstrate that the system can effectively detect various postures and provide real-time reminders to users to correct poor posture,demonstrating good practicality and stability.展开更多
Over the years,the continuous development of new technology has promoted research in the field of posture recognition and also made the application field of posture recognition have been greatly expanded.The purpose o...Over the years,the continuous development of new technology has promoted research in the field of posture recognition and also made the application field of posture recognition have been greatly expanded.The purpose of this paper is to introduce the latest methods of posture recognition and review the various techniques and algorithms of posture recognition in recent years,such as scale-invariant feature transform,histogram of oriented gradients,support vectormachine(SVM),Gaussian mixturemodel,dynamic time warping,hiddenMarkovmodel(HMM),lightweight network,convolutional neural network(CNN).We also investigate improved methods of CNN,such as stacked hourglass networks,multi-stage pose estimation networks,convolutional posemachines,and high-resolution nets.The general process and datasets of posture recognition are analyzed and summarized,and several improved CNNmethods and threemain recognition techniques are compared.In addition,the applications of advanced neural networks in posture recognition,such as transfer learning,ensemble learning,graph neural networks,and explainable deep neural networks,are introduced.It was found that CNN has achieved great success in posture recognition and is favored by researchers.Still,a more in-depth research is needed in feature extraction,information fusion,and other aspects.Among classification methods,HMM and SVM are the most widely used,and lightweight network gradually attracts the attention of researchers.In addition,due to the lack of 3Dbenchmark data sets,data generation is a critical research direction.展开更多
BACKGROUND Primiparas are usually at high risk of experiencing perinatal depression,which may cause prolonged labor,increased blood loss,and intensified pain,affecting maternal and fetal outcomes.Therefore,interventio...BACKGROUND Primiparas are usually at high risk of experiencing perinatal depression,which may cause prolonged labor,increased blood loss,and intensified pain,affecting maternal and fetal outcomes.Therefore,interventions are necessary to improve maternal and fetal outcomes and alleviate primiparas’negative emotions(NEs).AIM To discusses the impact of nursing responsibility in midwifery and postural and psychological interventions on maternal and fetal outcomes as well as primiparas’NEs.METHODS As participants,115 primiparas admitted to Quanzhou Maternity and Child Healthcare Hospital between May 2020 and May 2022 were selected.Among them,56 primiparas(control group,Con)were subjected to conventional midwifery and routine nursing.The remaining 59(research group,Res)were subjected to the nursing model of midwifery and postural and psychological interventions.Both groups were comparatively analyzed from the perspectives of delivery mode(cesarean,natural,or forceps-assisted),maternal and fetal outcomes(uterine inertia,postpartum hemorrhage,placental abruption,neonatal pulmonary injury,and neonatal asphyxia),NEs(Hamilton Anxiety/Depressionrating Scale,HAMA/HAMD),labor duration,and nursing satisfaction.RESULTS The Res exhibited a markedly higher natural delivery rate and nursing satisfaction than the Con.Additionally,the Res indicated a lower incidence of adverse events(e.g.,uterine inertia,postpartum hemorrhage,placental abruption,neonatal lung injury,and neonatal asphyxia)and shortened duration of various stages of labor.It also showed statistically lower post-interventional HAMA and HAMD scores than the Con and pre-interventional values.CONCLUSION The nursing model of midwifery and postural and psychological interventions increase the natural delivery rate and reduce the duration of each labor stage.These are also conducive to improving maternal and fetal outcomes and mitigating primiparas’NEs and thus deserve popularity in clinical practice.展开更多
Technological development of motion and posture analyses is rapidly progressing,especially in rehabilitation settings and sport biomechanics.Consequently,clear discrimination among different measurement systems is req...Technological development of motion and posture analyses is rapidly progressing,especially in rehabilitation settings and sport biomechanics.Consequently,clear discrimination among different measurement systems is required to diversify their use as needed.This review aims to resume the currently used motion and posture analysis systems,clarify and suggest the appropriate approaches suitable for specific cases or contexts.The currently gold standard systems of motion analysis,widely used in clinical settings,present several limitations related to marker placement or long procedure time.Fully automated and markerless systems are overcoming these drawbacks for conducting biomechanical studies,especially outside laboratories.Similarly,new posture analysis techniques are emerging,often driven by the need for fast and non-invasive methods to obtain high-precision results.These new technologies have also become effective for children or adolescents with non-specific back pain and postural insufficiencies.The evolutions of these methods aim to standardize measurements and provide manageable tools in clinical practice for the early diagnosis of musculoskeletal pathologies and to monitor daily improvements of each patient.Herein,these devices and their uses are described,providing researchers,clinicians,orthopedics,physical therapists,and sports coaches an effective guide to use new technologies in their practice as instruments of diagnosis,therapy,and prevention.展开更多
Considering the unmanned aerial vehicle(UAV) three-dimensional(3D) posture, a novel 3D non-stationary geometry-based stochastic model(GBSM) is proposed for multiple-input multipleoutput(MIMO) UAV-to-vehicle(U2V) chann...Considering the unmanned aerial vehicle(UAV) three-dimensional(3D) posture, a novel 3D non-stationary geometry-based stochastic model(GBSM) is proposed for multiple-input multipleoutput(MIMO) UAV-to-vehicle(U2V) channels. It consists of a line-of-sight(Lo S) and non-line-of-sight(NLo S) components. The factor of fuselage posture is considered by introducing a time-variant 3D posture matrix. Some important statistical properties, i.e.the temporal autocorrelation function(ACF) and spatial cross correlation function(CCF), are derived and investigated. Simulation results show that the fuselage posture has significant impact on the U2V channel characteristic and aggravate the non-stationarity. The agreements between analytical, simulated, and measured results verify the correctness of proposed model and derivations. Moreover, it is demonstrated that the proposed model is also compatible to the existing GBSM without considering fuselage posture.展开更多
To detect the improper sitting posture of a person sitting on a chair,a posture detection system using machine learning classification has been proposed in this work.The addressed problem correlates to the third Susta...To detect the improper sitting posture of a person sitting on a chair,a posture detection system using machine learning classification has been proposed in this work.The addressed problem correlates to the third Sustainable Development Goal(SDG),ensuring healthy lives and promoting well-being for all ages,as specified by the World Health Organization(WHO).An improper sitting position can be fatal if one sits for a long time in the wrong position,and it can be dangerous for ulcers and lower spine discomfort.This novel study includes a practical implementation of a cushion consisting of a grid of 3×3 force-sensitive resistors(FSR)embedded to read the pressure of the person sitting on it.Additionally,the Body Mass Index(BMI)has been included to increase the resilience of the system across individual physical variances and to identify the incorrect postures(backward,front,left,and right-leaning)based on the five machine learning algorithms:ensemble boosted trees,ensemble bagged trees,ensemble subspace K-Nearest Neighbors(KNN),ensemble subspace discriminant,and ensemble RUSBoosted trees.The proposed arrangement is novel as existing works have only provided simulations without practical implementation,whereas we have implemented the proposed design in Simulink.The results validate the proposed sensor placements,and the machine learning(ML)model reaches a maximum accuracy of 99.99%,which considerably outperforms the existing works.The proposed concept is valuable as it makes it easier for people in workplaces or even at individual household levels to work for long periods without suffering from severe harmful effects from poor posture.展开更多
Dairy farm management is crucial to maintain the longevity of the farm,and poor dairy youngstock or calf management could lead to gradually deteriorating calf health,which often causes premature death.This was found t...Dairy farm management is crucial to maintain the longevity of the farm,and poor dairy youngstock or calf management could lead to gradually deteriorating calf health,which often causes premature death.This was found to be the most neglected part among the management workflows in Malaysia and has caused continuous loss over the recent years.Calf posture recognition is one of the effective methods to monitor calf behaviour and health state,which can be achieved by monitoring the calf behaviours of standing and lying where the former depicts active calf,and the latter,passive calf.Calf posture recognition module is an important component of some automated calf monitoring systems,as the system requires the calf to be in a standing posture before proceeding to the next stage of monitoring,or at the very least,to monitor the activeness of the calves.Calf posture such as standing or resting can easily be distinguished by human eye,however,to be recognized by a machine,it will require more complicated frameworks,particularly one that involves a deep learning neural networks model.Large number of highquality images are required to train a deep learning model for such tasks.In this paper,multiple ConvolutionalNeuralNetwork(CNN)architectures were compared,and the residual network(ResNet)model(specifically,ResNet-50)was ultimately chosen due to its simplicity,great performance,and decent inference time.Two ResNet-50 models having the exact same architecture and configuration have been trained on two different image datasets respectively sourced by separate cameras placed at different angle.There were two camera placements to use for comparison because camera placements can significantly impact the quality of the images,which is highly correlated to the deep learning model performance.After model training,the performance for both CNN models were 99.7%and 99.99%accuracies,respectively,and is adequate for a real-time calf monitoring system.展开更多
In addressing the challenge of motion artifacts in Positron Emission Tomography (PET) lung scans, our studyintroduces the Triple Equivariant Motion Transformer (TEMT), an innovative, unsupervised, deep-learningbasedfr...In addressing the challenge of motion artifacts in Positron Emission Tomography (PET) lung scans, our studyintroduces the Triple Equivariant Motion Transformer (TEMT), an innovative, unsupervised, deep-learningbasedframework for efficient respiratory motion correction in PET imaging. Unlike traditional techniques,which segment PET data into bins throughout a respiratory cycle and often face issues such as inefficiency andoveremphasis on certain artifacts, TEMT employs Convolutional Neural Networks (CNNs) for effective featureextraction and motion decomposition.TEMT’s unique approach involves transforming motion sequences into Liegroup domains to highlight fundamental motion patterns, coupled with employing competitive weighting forprecise target deformation field generation. Our empirical evaluations confirm TEMT’s superior performancein handling diverse PET lung datasets compared to existing image registration networks. Experimental resultsdemonstrate that TEMT achieved Dice indices of 91.40%, 85.41%, 79.78%, and 72.16% on simulated geometricphantom data, lung voxel phantom data, cardiopulmonary voxel phantom data, and clinical data, respectively. Tofacilitate further research and practical application, the TEMT framework, along with its implementation detailsand part of the simulation data, is made publicly accessible at https://github.com/yehaowei/temt.展开更多
Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal ...Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer.To address this issue,this study proposes a safe motion planning and control(SMPAC)framework for AVs.For the control layer,a dynamic model including multi-dimensional uncertainties is established.A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set.A flexible tube with varying cross-sections is constructed to reduce the controller conservatism.For the planning layer,a concept of safety sets,representing the geometric boundaries of the ego vehicle and obstacles under uncertainties,is proposed.The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories.An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles.A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC.The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.展开更多
Among steganalysis techniques,detection against MV(motion vector)domain-based video steganography in the HEVC(High Efficiency Video Coding)standard remains a challenging issue.For the purpose of improving the detectio...Among steganalysis techniques,detection against MV(motion vector)domain-based video steganography in the HEVC(High Efficiency Video Coding)standard remains a challenging issue.For the purpose of improving the detection performance,this paper proposes a steganalysis method that can perfectly detectMV-based steganography in HEVC.Firstly,we define the local optimality of MVP(Motion Vector Prediction)based on the technology of AMVP(Advanced Motion Vector Prediction).Secondly,we analyze that in HEVC video,message embedding either usingMVP index orMVD(Motion Vector Difference)may destroy the above optimality of MVP.And then,we define the optimal rate of MVP as a steganalysis feature.Finally,we conduct steganalysis detection experiments on two general datasets for three popular steganographymethods and compare the performance with four state-ofthe-art steganalysis methods.The experimental results demonstrate the effectiveness of the proposed feature set.Furthermore,our method stands out for its practical applicability,requiring no model training and exhibiting low computational complexity,making it a viable solution for real-world scenarios.展开更多
To ensure the safe performance of deep-sea mining vehicles(DSMVs),it is necessary to study the mechanical characteristics of the interaction between the seabed soil and the track plate.The rotation and digging motions...To ensure the safe performance of deep-sea mining vehicles(DSMVs),it is necessary to study the mechanical characteristics of the interaction between the seabed soil and the track plate.The rotation and digging motions of the track plate are important links in the contact between the driving mechanism of the DSMV and seabed soil.In this study,a numerical simulation is conducted using the coupled Eulerian–Lagrangian(CEL)large deformation numerical method to investigate the interaction between the track plate of the DSMV and the seabed soil under two working conditions:rotating condition and digging condition.First,a soil numerical model is established based on the elastoplastic mechanical characterization using the basic physical and mechanical properties of the seabed soil obtained by in situ sampling.Subsequently,the soil disturbance mechanism and the dynamic mechanical response of the track plate under rotating and digging conditions are obtained through the analysis of the sensitivity of the motion parameters,the grouser structure,the layered soil features and the soil heterogeneity.The results indicate that the above parameters remarkably influence the interaction between the DSMV and the seabed soil.Therefore,it is important to consider the rotating and digging motion of the DSMV in practical engineering to develop a detailed optimization design of the track plate.展开更多
This paper presents a distributed scheme with limited communications, aiming to achieve cooperative motion control for multiple omnidirectional mobile manipulators(MOMMs).The proposed scheme extends the existing singl...This paper presents a distributed scheme with limited communications, aiming to achieve cooperative motion control for multiple omnidirectional mobile manipulators(MOMMs).The proposed scheme extends the existing single-agent motion control to cater to scenarios involving the cooperative operation of MOMMs. Specifically, squeeze-free cooperative load transportation is achieved for the end-effectors of MOMMs by incorporating cooperative repetitive motion planning(CRMP), while guiding each individual to desired poses. Then, the distributed scheme is formulated as a time-varying quadratic programming(QP) and solved online utilizing a noise-tolerant zeroing neural network(NTZNN). Theoretical analysis shows that the NTZNN model converges globally to the optimal solution of QP in the presence of noise. Finally, the effectiveness of the control design is demonstrated by numerical simulations and physical platform experiments.展开更多
This paper presented a novel tinny motion capture system for measuring bird posture based on inertial and magnetic measurement units that are made up of micromachined gyroscopes, accelerometers, and magnetometers. Mul...This paper presented a novel tinny motion capture system for measuring bird posture based on inertial and magnetic measurement units that are made up of micromachined gyroscopes, accelerometers, and magnetometers. Multiple quaternion-based extended Kalman filters were implemented to estimate the absolute orientations to achieve high accuracy.Under the guidance of ornithology experts, the extending/contracting motions and flapping cycles were recorded using the developed motion capture system, and the orientation of each bone was also analyzed. The captured flapping gesture of the Falco peregrinus is crucial to the motion database of raptors as well as the bionic design.展开更多
基金supported by National Natural Science Foundation of China(Grant No. 60975058)
文摘Non-obstacle design is critical to tailor physically handicapped workers in manufacturing system. Simultaneous consideration of variability in physically disabled users, machines and environment of the manufacturing system is extremely complex and generally requires modeling of physically handicapped interaction with the system. Most current modeling either concentrates on the task results or functional disability. The integration of physical constraints with task constraints is far more complex because of functional disability and its extended influence on adjacent body parts. A framework is proposed to integrate the two constraints and thus model the specific behavior of the physical handicapped in virtual environment generated by product specifications. Within the framework a simplified model of physical disabled body is constructed, and body motion is generated based on 3 levels of constraints(effecter constraints, kinematics constraints and physical constraints). The kinematics and dynamic calculations are made and optimized based on the weighting manipulated by the kinematics constraints and dynamic constraints. With object transferring task as example, the model is validated in Jack 6.0. Modelled task motion elements except for squatting and overreaching well matched with captured motion elements. The proposed modeling method can model the complex behavior of the physically handicapped by integrating both task and physical disability constraints.
基金funded by the Henan Provincial Science and Technology Research Project(222102210086)the Starry Sky Creative Space Innovation Space Innovation Incubation Project of Zhengzhou University of Light Industry(2023ZCKJ211).
文摘This study proposes a pose estimation-convolutional neural network-bidirectional gated recurrent unit(PSECNN-BiGRU)fusion model for human posture recognition to address low accuracy issues in abnormal posture recognition due to the loss of some feature information and the deterioration of comprehensive performance in model detection in complex home environments.Firstly,the deep convolutional network is integrated with the Mediapipe framework to extract high-precision,multi-dimensional information from the key points of the human skeleton,thereby obtaining a human posture feature set.Thereafter,a double-layer BiGRU algorithm is utilized to extract multi-layer,bidirectional temporal features from the human posture feature set,and a CNN network with an exponential linear unit(ELU)activation function is adopted to perform deep convolution of the feature map to extract the spatial feature of the human posture.Furthermore,a squeeze and excitation networks(SENet)module is introduced to adaptively learn the importance weights of each channel,enhancing the network’s focus on important features.Finally,comparative experiments are performed on available datasets,including the public human activity recognition using smartphone dataset(UCIHAR),the public human activity recognition 70 plus dataset(HAR70PLUS),and the independently developed home abnormal behavior recognition dataset(HABRD)created by the authors’team.The results show that the average accuracy of the proposed PSE-CNN-BiGRU fusion model for human posture recognition is 99.56%,89.42%,and 98.90%,respectively,which are 5.24%,5.83%,and 3.19%higher than the average accuracy of the five models proposed in the comparative literature,including CNN,GRU,and others.The F1-score for abnormal posture recognition reaches 98.84%(heartache),97.18%(fall),99.6%(bellyache),and 98.27%(climbing)on the self-builtHABRDdataset,thus verifying the effectiveness,generalization,and robustness of the proposed model in enhancing human posture recognition.
基金supported by the Medical Special Cultivation Project of Anhui University of Science and Technology(Grant No.YZ2023H2B013)the Anhui Provincial Key Research and Development Project(Grant No.2022i01020015)the Open Project of Key Laboratory of Conveyance Equipment(East China Jiaotong University),Ministry of Education(KLCE2022-01).
文摘The human pose paradigm is estimated using a transformer-based multi-branch multidimensional directed the three-dimensional(3D)method that takes into account self-occlusion,badly posedness,and a lack of depth data in the per-frame 3D posture estimation from two-dimensional(2D)mapping to 3D mapping.Firstly,by examining the relationship between the movements of different bones in the human body,four virtual skeletons are proposed to enhance the cyclic constraints of limb joints.Then,multiple parameters describing the skeleton are fused and projected into a high-dimensional space.Utilizing a multi-branch network,motion features between bones and overall motion features are extracted to mitigate the drift error in the estimation results.Furthermore,the estimated relative depth is projected into 3D space,and the error is calculated against real 3D data,forming a loss function along with the relative depth error.This article adopts the average joint pixel error as the primary performance metric.Compared to the benchmark approach,the estimation findings indicate an increase in average precision of 1.8 mm within the Human3.6M sample.
基金supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute(KHIDI)funded by the Ministry of Health&Welfare,Republic of Korea(Grant Number:H12C1831)+2 种基金Korea Institute for Advancement of Technology(KIAT)Grant funded by the Korea Government(MOTIE)(P0012724,HRD Program for Industrial Innovation)the National Research Foundation of Korea(NRF)Grant funded by the Korea Government(MSIT)(No.RS-2023-00218176)the Soonchunhyang University Research Fund.
文摘Sleep posture surveillance is crucial for patient comfort,yet current systems face difficulties in providing compre-hensive studies due to the obstruction caused by blankets.Precise posture assessment remains challenging because of the complex nature of the human body and variations in sleep patterns.Consequently,this study introduces an innovative method utilizing RGB and thermal cameras for comprehensive posture classification,thereby enhancing the analysis of body position and comfort.This method begins by capturing a dataset of sleep postures in the form of videos using RGB and thermal cameras,which depict six commonly adopted postures:supine,left log,right log,prone head,prone left,and prone right.The study involves 10 participants under two conditions:with and without blankets.Initially,the database is normalized into a video frame.The subsequent step entails training a fine-tuned,pretrained Visual Geometry Group(VGG16)and ResNet50 model.In the third phase,the extracted features are utilized for classification.The fourth step of the proposed approach employs a serial fusion technique based on the normal distribution to merge the vectors derived from both the RGB and thermal datasets.Finally,the fused vectors are passed to machine learning classifiers for final classification.The dataset,which includes human sleep postures used in this study’s experiments,achieved a 96.7%accuracy rate using the Quadratic Support Vector Machine(QSVM)without the blanket.Moreover,the Linear SVM,when utilized with a blanket,attained an accuracy of 96%.When normal distribution serial fusion was applied to the blanket features,it resulted in a remarkable average accuracy of 99%.
基金Researchers Supporting Project Number(RSPD2024R576),King Saud University,Riyadh,Saudi Arabia。
文摘Cardiovascular disease is the leading cause of death globally.This disease causes loss of heart muscles and is also responsible for the death of heart cells,sometimes damaging their functionality.A person’s life may depend on receiving timely assistance as soon as possible.Thus,minimizing the death ratio can be achieved by early detection of heart attack(HA)symptoms.In the United States alone,an estimated 610,000 people die fromheart attacks each year,accounting for one in every four fatalities.However,by identifying and reporting heart attack symptoms early on,it is possible to reduce damage and save many lives significantly.Our objective is to devise an algorithm aimed at helping individuals,particularly elderly individuals living independently,to safeguard their lives.To address these challenges,we employ deep learning techniques.We have utilized a vision transformer(ViT)to address this problem.However,it has a significant overhead cost due to its memory consumption and computational complexity because of scaling dot-product attention.Also,since transformer performance typically relies on large-scale or adequate data,adapting ViT for smaller datasets is more challenging.In response,we propose a three-in-one steam model,theMulti-Head Attention Vision Hybrid(MHAVH).Thismodel integrates a real-time posture recognition framework to identify chest pain postures indicative of heart attacks using transfer learning techniques,such as ResNet-50 and VGG-16,renowned for their robust feature extraction capabilities.By incorporatingmultiple heads into the vision transformer to generate additional metrics and enhance heart-detection capabilities,we leverage a 2019 posture-based dataset comprising RGB images,a novel creation by the author that marks the first dataset tailored for posture-based heart attack detection.Given the limited online data availability,we segmented this dataset into gender categories(male and female)and conducted testing on both segmented and original datasets.The training accuracy of our model reached an impressive 99.77%.Upon testing,the accuracy for male and female datasets was recorded at 92.87%and 75.47%,respectively.The combined dataset accuracy is 93.96%,showcasing a commendable performance overall.Our proposed approach demonstrates versatility in accommodating small and large datasets,offering promising prospects for real-world applications.
基金funded by the Science and Technology Project of Hebei Education Department (No.ZD2022100).
文摘With the development of technology and the progress of life,more and more people,regardless of entertainment,learning,or work,cannot do without computer desks and cannot put down their mobile phones.Due to prolonged sitting and often neglecting the importance of posture,incorrect posture can often lead to health problems such as hunchback,lumbar muscle strain,and shoulder and neck pain over time.To address this issue,we designed a computer vision-based human body posture detection system.The system utilizes YOLOv8 technology to accurately locate key points of the human body skeleton,and then analyzes the coordinate positions and depth information of these key points to establish a criterion for distinguishing different postures.With the assistance of an SVM classifier,the system achieves an average recognition rate of 95%.Finally,we successfully deployed the posture detection system on Raspberry Pi hardware and conducted extensive testing.The test results demonstrate that the system can effectively detect various postures and provide real-time reminders to users to correct poor posture,demonstrating good practicality and stability.
基金supported by British Heart Foundation Accelerator Award,UK(AA/18/3/34220)Royal Society International Exchanges Cost Share Award,UK(RP202G0230)+7 种基金Hope Foundation for Cancer Research,UK(RM60G0680)Medical Research Council Confidence in Concept Award,UK(MC_PC_17171)Sino-UK Industrial Fund,UK(RP202G0289)Global Challenges Research Fund(GCRF),UK(P202PF11)LIAS Pioneering Partnerships award,UK(P202ED10)Data Science Enhancement Fund,UK(P202RE237)Fight for Sight,UK(24NN201)Sino-UK Education Fund,UK(OP202006).
文摘Over the years,the continuous development of new technology has promoted research in the field of posture recognition and also made the application field of posture recognition have been greatly expanded.The purpose of this paper is to introduce the latest methods of posture recognition and review the various techniques and algorithms of posture recognition in recent years,such as scale-invariant feature transform,histogram of oriented gradients,support vectormachine(SVM),Gaussian mixturemodel,dynamic time warping,hiddenMarkovmodel(HMM),lightweight network,convolutional neural network(CNN).We also investigate improved methods of CNN,such as stacked hourglass networks,multi-stage pose estimation networks,convolutional posemachines,and high-resolution nets.The general process and datasets of posture recognition are analyzed and summarized,and several improved CNNmethods and threemain recognition techniques are compared.In addition,the applications of advanced neural networks in posture recognition,such as transfer learning,ensemble learning,graph neural networks,and explainable deep neural networks,are introduced.It was found that CNN has achieved great success in posture recognition and is favored by researchers.Still,a more in-depth research is needed in feature extraction,information fusion,and other aspects.Among classification methods,HMM and SVM are the most widely used,and lightweight network gradually attracts the attention of researchers.In addition,due to the lack of 3Dbenchmark data sets,data generation is a critical research direction.
文摘BACKGROUND Primiparas are usually at high risk of experiencing perinatal depression,which may cause prolonged labor,increased blood loss,and intensified pain,affecting maternal and fetal outcomes.Therefore,interventions are necessary to improve maternal and fetal outcomes and alleviate primiparas’negative emotions(NEs).AIM To discusses the impact of nursing responsibility in midwifery and postural and psychological interventions on maternal and fetal outcomes as well as primiparas’NEs.METHODS As participants,115 primiparas admitted to Quanzhou Maternity and Child Healthcare Hospital between May 2020 and May 2022 were selected.Among them,56 primiparas(control group,Con)were subjected to conventional midwifery and routine nursing.The remaining 59(research group,Res)were subjected to the nursing model of midwifery and postural and psychological interventions.Both groups were comparatively analyzed from the perspectives of delivery mode(cesarean,natural,or forceps-assisted),maternal and fetal outcomes(uterine inertia,postpartum hemorrhage,placental abruption,neonatal pulmonary injury,and neonatal asphyxia),NEs(Hamilton Anxiety/Depressionrating Scale,HAMA/HAMD),labor duration,and nursing satisfaction.RESULTS The Res exhibited a markedly higher natural delivery rate and nursing satisfaction than the Con.Additionally,the Res indicated a lower incidence of adverse events(e.g.,uterine inertia,postpartum hemorrhage,placental abruption,neonatal lung injury,and neonatal asphyxia)and shortened duration of various stages of labor.It also showed statistically lower post-interventional HAMA and HAMD scores than the Con and pre-interventional values.CONCLUSION The nursing model of midwifery and postural and psychological interventions increase the natural delivery rate and reduce the duration of each labor stage.These are also conducive to improving maternal and fetal outcomes and mitigating primiparas’NEs and thus deserve popularity in clinical practice.
基金Supported by University Research Project GrantNo. PIACERI Found–NATURE-OA-2020-2022。
文摘Technological development of motion and posture analyses is rapidly progressing,especially in rehabilitation settings and sport biomechanics.Consequently,clear discrimination among different measurement systems is required to diversify their use as needed.This review aims to resume the currently used motion and posture analysis systems,clarify and suggest the appropriate approaches suitable for specific cases or contexts.The currently gold standard systems of motion analysis,widely used in clinical settings,present several limitations related to marker placement or long procedure time.Fully automated and markerless systems are overcoming these drawbacks for conducting biomechanical studies,especially outside laboratories.Similarly,new posture analysis techniques are emerging,often driven by the need for fast and non-invasive methods to obtain high-precision results.These new technologies have also become effective for children or adolescents with non-specific back pain and postural insufficiencies.The evolutions of these methods aim to standardize measurements and provide manageable tools in clinical practice for the early diagnosis of musculoskeletal pathologies and to monitor daily improvements of each patient.Herein,these devices and their uses are described,providing researchers,clinicians,orthopedics,physical therapists,and sports coaches an effective guide to use new technologies in their practice as instruments of diagnosis,therapy,and prevention.
基金supported by the National Natural Science Foundation of China,No.62271250the National Key Scientific Instrument and Equipment Development Project,No.61827801+3 种基金Key Technologies R&D Program of Jiangsu(Prospective and Key Technologies for Industry),No.BE2022067,BE2022067-1 and BE2022067-3the Natural Science Foundation of Jiangsu Province,No.BK20211182the open research fund of National Mobile Communications Research Laboratory,Southeast University,No.2022D04the Experimental technology research and development,No.SYJS202304Z。
文摘Considering the unmanned aerial vehicle(UAV) three-dimensional(3D) posture, a novel 3D non-stationary geometry-based stochastic model(GBSM) is proposed for multiple-input multipleoutput(MIMO) UAV-to-vehicle(U2V) channels. It consists of a line-of-sight(Lo S) and non-line-of-sight(NLo S) components. The factor of fuselage posture is considered by introducing a time-variant 3D posture matrix. Some important statistical properties, i.e.the temporal autocorrelation function(ACF) and spatial cross correlation function(CCF), are derived and investigated. Simulation results show that the fuselage posture has significant impact on the U2V channel characteristic and aggravate the non-stationarity. The agreements between analytical, simulated, and measured results verify the correctness of proposed model and derivations. Moreover, it is demonstrated that the proposed model is also compatible to the existing GBSM without considering fuselage posture.
文摘To detect the improper sitting posture of a person sitting on a chair,a posture detection system using machine learning classification has been proposed in this work.The addressed problem correlates to the third Sustainable Development Goal(SDG),ensuring healthy lives and promoting well-being for all ages,as specified by the World Health Organization(WHO).An improper sitting position can be fatal if one sits for a long time in the wrong position,and it can be dangerous for ulcers and lower spine discomfort.This novel study includes a practical implementation of a cushion consisting of a grid of 3×3 force-sensitive resistors(FSR)embedded to read the pressure of the person sitting on it.Additionally,the Body Mass Index(BMI)has been included to increase the resilience of the system across individual physical variances and to identify the incorrect postures(backward,front,left,and right-leaning)based on the five machine learning algorithms:ensemble boosted trees,ensemble bagged trees,ensemble subspace K-Nearest Neighbors(KNN),ensemble subspace discriminant,and ensemble RUSBoosted trees.The proposed arrangement is novel as existing works have only provided simulations without practical implementation,whereas we have implemented the proposed design in Simulink.The results validate the proposed sensor placements,and the machine learning(ML)model reaches a maximum accuracy of 99.99%,which considerably outperforms the existing works.The proposed concept is valuable as it makes it easier for people in workplaces or even at individual household levels to work for long periods without suffering from severe harmful effects from poor posture.
基金funded under the Malaysian Young Researchers grant scheme(MRUN-MYRGS)Vote number:5539500(Universiti Putra Malaysia)Title:Precision surveillance system to support dairy young stock rearing decisions(NMN).
文摘Dairy farm management is crucial to maintain the longevity of the farm,and poor dairy youngstock or calf management could lead to gradually deteriorating calf health,which often causes premature death.This was found to be the most neglected part among the management workflows in Malaysia and has caused continuous loss over the recent years.Calf posture recognition is one of the effective methods to monitor calf behaviour and health state,which can be achieved by monitoring the calf behaviours of standing and lying where the former depicts active calf,and the latter,passive calf.Calf posture recognition module is an important component of some automated calf monitoring systems,as the system requires the calf to be in a standing posture before proceeding to the next stage of monitoring,or at the very least,to monitor the activeness of the calves.Calf posture such as standing or resting can easily be distinguished by human eye,however,to be recognized by a machine,it will require more complicated frameworks,particularly one that involves a deep learning neural networks model.Large number of highquality images are required to train a deep learning model for such tasks.In this paper,multiple ConvolutionalNeuralNetwork(CNN)architectures were compared,and the residual network(ResNet)model(specifically,ResNet-50)was ultimately chosen due to its simplicity,great performance,and decent inference time.Two ResNet-50 models having the exact same architecture and configuration have been trained on two different image datasets respectively sourced by separate cameras placed at different angle.There were two camera placements to use for comparison because camera placements can significantly impact the quality of the images,which is highly correlated to the deep learning model performance.After model training,the performance for both CNN models were 99.7%and 99.99%accuracies,respectively,and is adequate for a real-time calf monitoring system.
基金the National Natural Science Foundation of China(No.82160347)Yunnan Provincial Science and Technology Department(No.202102AE090031)Yunnan Key Laboratory of Smart City in Cyberspace Security(No.202105AG070010).
文摘In addressing the challenge of motion artifacts in Positron Emission Tomography (PET) lung scans, our studyintroduces the Triple Equivariant Motion Transformer (TEMT), an innovative, unsupervised, deep-learningbasedframework for efficient respiratory motion correction in PET imaging. Unlike traditional techniques,which segment PET data into bins throughout a respiratory cycle and often face issues such as inefficiency andoveremphasis on certain artifacts, TEMT employs Convolutional Neural Networks (CNNs) for effective featureextraction and motion decomposition.TEMT’s unique approach involves transforming motion sequences into Liegroup domains to highlight fundamental motion patterns, coupled with employing competitive weighting forprecise target deformation field generation. Our empirical evaluations confirm TEMT’s superior performancein handling diverse PET lung datasets compared to existing image registration networks. Experimental resultsdemonstrate that TEMT achieved Dice indices of 91.40%, 85.41%, 79.78%, and 72.16% on simulated geometricphantom data, lung voxel phantom data, cardiopulmonary voxel phantom data, and clinical data, respectively. Tofacilitate further research and practical application, the TEMT framework, along with its implementation detailsand part of the simulation data, is made publicly accessible at https://github.com/yehaowei/temt.
基金supported by the National Natural Science Foundation of China(51875061)China Scholarship Council(202206050107)。
文摘Model mismatches can cause multi-dimensional uncertainties for the receding horizon control strategies of automated vehicles(AVs).The uncertainties may lead to potentially hazardous behaviors when the AV tracks ideal trajectories that are individually optimized by the AV's planning layer.To address this issue,this study proposes a safe motion planning and control(SMPAC)framework for AVs.For the control layer,a dynamic model including multi-dimensional uncertainties is established.A zonotopic tube-based robust model predictive control scheme is proposed to constrain the uncertain system in a bounded minimum robust positive invariant set.A flexible tube with varying cross-sections is constructed to reduce the controller conservatism.For the planning layer,a concept of safety sets,representing the geometric boundaries of the ego vehicle and obstacles under uncertainties,is proposed.The safety sets provide the basis for the subsequent evaluation and ranking of the generated trajectories.An efficient collision avoidance algorithm decides the desired trajectory through the intersection detection of the safety sets between the ego vehicle and obstacles.A numerical simulation and hardware-in-the-loop experiment validate the effectiveness and real-time performance of the SMPAC.The result of two driving scenarios indicates that the SMPAC can guarantee the safety of automated driving under multi-dimensional uncertainties.
基金the National Natural Science Foundation of China(Grant Nos.62272478,62202496,61872384).
文摘Among steganalysis techniques,detection against MV(motion vector)domain-based video steganography in the HEVC(High Efficiency Video Coding)standard remains a challenging issue.For the purpose of improving the detection performance,this paper proposes a steganalysis method that can perfectly detectMV-based steganography in HEVC.Firstly,we define the local optimality of MVP(Motion Vector Prediction)based on the technology of AMVP(Advanced Motion Vector Prediction).Secondly,we analyze that in HEVC video,message embedding either usingMVP index orMVD(Motion Vector Difference)may destroy the above optimality of MVP.And then,we define the optimal rate of MVP as a steganalysis feature.Finally,we conduct steganalysis detection experiments on two general datasets for three popular steganographymethods and compare the performance with four state-ofthe-art steganalysis methods.The experimental results demonstrate the effectiveness of the proposed feature set.Furthermore,our method stands out for its practical applicability,requiring no model training and exhibiting low computational complexity,making it a viable solution for real-world scenarios.
基金supported by the Natural Science Foundation of Hainan Province(Grant No.520LH015)the Fundamental Research Funds for the Central Universities and the Major Projects of Strategic Emerging Industries in Shanghai(Grant No.BH3230001).
文摘To ensure the safe performance of deep-sea mining vehicles(DSMVs),it is necessary to study the mechanical characteristics of the interaction between the seabed soil and the track plate.The rotation and digging motions of the track plate are important links in the contact between the driving mechanism of the DSMV and seabed soil.In this study,a numerical simulation is conducted using the coupled Eulerian–Lagrangian(CEL)large deformation numerical method to investigate the interaction between the track plate of the DSMV and the seabed soil under two working conditions:rotating condition and digging condition.First,a soil numerical model is established based on the elastoplastic mechanical characterization using the basic physical and mechanical properties of the seabed soil obtained by in situ sampling.Subsequently,the soil disturbance mechanism and the dynamic mechanical response of the track plate under rotating and digging conditions are obtained through the analysis of the sensitivity of the motion parameters,the grouser structure,the layered soil features and the soil heterogeneity.The results indicate that the above parameters remarkably influence the interaction between the DSMV and the seabed soil.Therefore,it is important to consider the rotating and digging motion of the DSMV in practical engineering to develop a detailed optimization design of the track plate.
基金supported in part by the National Natural Science Foundation of China (62373065,61873304,62173048,62106023)the Innovation and Entrepreneurship Talent funding Project of Jilin Province(2022QN04)+1 种基金the Changchun Science and Technology Project (21ZY41)the Open Research Fund of National Mobile Communications Research Laboratory,Southeast University (2024D09)。
文摘This paper presents a distributed scheme with limited communications, aiming to achieve cooperative motion control for multiple omnidirectional mobile manipulators(MOMMs).The proposed scheme extends the existing single-agent motion control to cater to scenarios involving the cooperative operation of MOMMs. Specifically, squeeze-free cooperative load transportation is achieved for the end-effectors of MOMMs by incorporating cooperative repetitive motion planning(CRMP), while guiding each individual to desired poses. Then, the distributed scheme is formulated as a time-varying quadratic programming(QP) and solved online utilizing a noise-tolerant zeroing neural network(NTZNN). Theoretical analysis shows that the NTZNN model converges globally to the optimal solution of QP in the presence of noise. Finally, the effectiveness of the control design is demonstrated by numerical simulations and physical platform experiments.
基金Project supported by the National Natural Science Foundation of China (Grant Nos.52175279 and 51705459)the Natural Science Foundation of Zhejiang Province,China (Grant No.LY20E050022)the Key Research and Development Projects of Zhejiang Provincial Science and Technology Department (Grant No.2021C03122)。
文摘This paper presented a novel tinny motion capture system for measuring bird posture based on inertial and magnetic measurement units that are made up of micromachined gyroscopes, accelerometers, and magnetometers. Multiple quaternion-based extended Kalman filters were implemented to estimate the absolute orientations to achieve high accuracy.Under the guidance of ornithology experts, the extending/contracting motions and flapping cycles were recorded using the developed motion capture system, and the orientation of each bone was also analyzed. The captured flapping gesture of the Falco peregrinus is crucial to the motion database of raptors as well as the bionic design.