Reconstructing a three-dimensional(3D)environment is an indispensable technique to make augmented reality and augmented virtuality feasible.A Kinect device is an efficient tool for reconstructing 3D environments,and u...Reconstructing a three-dimensional(3D)environment is an indispensable technique to make augmented reality and augmented virtuality feasible.A Kinect device is an efficient tool for reconstructing 3D environments,and using multiple Kinect devices enables the enhancement of reconstruction density and expansion of virtual spaces.To employ multiple devices simultaneously,Kinect devices need to be calibrated with respect to each other.There are several schemes available that calibrate 3D images generated frommultiple Kinect devices,including themarker detection method.In this study,we introduce a markerless calibration technique for Azure Kinect devices that avoids the drawbacks of marker detection,which directly affects calibration accuracy;it offers superior userfriendliness,efficiency,and accuracy.Further,we applied a joint tracking algorithm to approximate the calibration.Traditional methods require the information of multiple joints for calibration;however,Azure Kinect,the latest version of Kinect,requires the information of only one joint.The obtained result was further refined using the iterative closest point algorithm.We conducted several experimental tests that confirmed the enhanced efficiency and accuracy of the proposed method for multiple Kinect devices when compared to the conventional markerbased calibration.展开更多
Biomechanics is the study of physiological properties of data and the measurement of human behavior.In normal conditions,behavioural properties in stable form are created using various inputs of subconscious/conscious...Biomechanics is the study of physiological properties of data and the measurement of human behavior.In normal conditions,behavioural properties in stable form are created using various inputs of subconscious/conscious human activities such as speech style,body movements in walking patterns,writing style and voice tunes.One cannot perform any change in these inputs that make results reliable and increase the accuracy.The aim of our study is to perform a comparative analysis between the marker-based motion capturing system(MBMCS)and the marker-less motion capturing system(MLMCS)using the lower body joint angles of human gait patterns.In both the MLMCS and MBMCS,we collected trajectories of all the participants and performed joint angle computation to identify a person and recognize an activity(walk and running).Using five state of the art machine learning algorithms,we obtained 44.6%and 64.3%accuracy in person identification using MBMCS and MLMCS respectively with an ensemble algorithm(two angles as features).In the second set of experiments,we used six machine learning algorithms to obtain 65.9%accuracy with the k-nearest neighbor(KNN)algorithm(two angles as features)and 74.6%accuracy with an ensemble algorithm.Also,by increasing features(6 angles),we obtained higher accuracy of 99.3%in MBMCS for person recognition and 98.1%accuracy in MBMCS for activity recognition using the KNN algorithm.MBMCS is computationally expensive and if we redesign the model of OpenPose with more body joint points and employ more features,MLMCS(low-cost system)can be an effective approach for video data analysis in a person identification and activity recognition process.展开更多
基金supported by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Korea Government(MSIT)(Grant No.NRF-2022R1A2C1004588).
文摘Reconstructing a three-dimensional(3D)environment is an indispensable technique to make augmented reality and augmented virtuality feasible.A Kinect device is an efficient tool for reconstructing 3D environments,and using multiple Kinect devices enables the enhancement of reconstruction density and expansion of virtual spaces.To employ multiple devices simultaneously,Kinect devices need to be calibrated with respect to each other.There are several schemes available that calibrate 3D images generated frommultiple Kinect devices,including themarker detection method.In this study,we introduce a markerless calibration technique for Azure Kinect devices that avoids the drawbacks of marker detection,which directly affects calibration accuracy;it offers superior userfriendliness,efficiency,and accuracy.Further,we applied a joint tracking algorithm to approximate the calibration.Traditional methods require the information of multiple joints for calibration;however,Azure Kinect,the latest version of Kinect,requires the information of only one joint.The obtained result was further refined using the iterative closest point algorithm.We conducted several experimental tests that confirmed the enhanced efficiency and accuracy of the proposed method for multiple Kinect devices when compared to the conventional markerbased calibration.
基金Data and Artificial Intelligence Scientific Chair at Umm Al-Qura University.
文摘Biomechanics is the study of physiological properties of data and the measurement of human behavior.In normal conditions,behavioural properties in stable form are created using various inputs of subconscious/conscious human activities such as speech style,body movements in walking patterns,writing style and voice tunes.One cannot perform any change in these inputs that make results reliable and increase the accuracy.The aim of our study is to perform a comparative analysis between the marker-based motion capturing system(MBMCS)and the marker-less motion capturing system(MLMCS)using the lower body joint angles of human gait patterns.In both the MLMCS and MBMCS,we collected trajectories of all the participants and performed joint angle computation to identify a person and recognize an activity(walk and running).Using five state of the art machine learning algorithms,we obtained 44.6%and 64.3%accuracy in person identification using MBMCS and MLMCS respectively with an ensemble algorithm(two angles as features).In the second set of experiments,we used six machine learning algorithms to obtain 65.9%accuracy with the k-nearest neighbor(KNN)algorithm(two angles as features)and 74.6%accuracy with an ensemble algorithm.Also,by increasing features(6 angles),we obtained higher accuracy of 99.3%in MBMCS for person recognition and 98.1%accuracy in MBMCS for activity recognition using the KNN algorithm.MBMCS is computationally expensive and if we redesign the model of OpenPose with more body joint points and employ more features,MLMCS(low-cost system)can be an effective approach for video data analysis in a person identification and activity recognition process.
