Hybrid pedestrian positioning system using wearable inertial sensors and ultrasonic ranging

Pedestrian positioning system(PPS)using wearable inertial sensors has wide applications towards various emerging fields such as smart healthcare,emergency rescue,soldier positioning,etc.The performance of traditional PPS is limited by the cumulative error of inertial sensors,complex motion modes of pedestrians,and the low robustness of the multi-sensor collaboration structure.This paper presents a hybrid pedestrian positioning system using the combination of wearable inertial sensors and ultrasonic ranging(H-PPS).A robust two nodes integration structure is developed to adaptively combine the motion data acquired from the single waist-mounted and foot-mounted node,and enhanced by a novel ellipsoid constraint model.In addition,a deep-learning-based walking speed estimator is proposed by considering all the motion features provided by different nodes,which effectively reduces the cumulative error originating from inertial sensors.Finally,a comprehensive data and model dual-driven model is presented to effectively combine the motion data provided by different sensor nodes and walking speed estimator,and multi-level constraints are extracted to further improve the performance of the overall system.Experimental results indicate that the proposed H-PPS significantly improves the performance of the single PPS and outperforms existing algorithms in accuracy index under complex indoor scenarios.

A Novel Fall Detection Framework Using Skip-DSCGAN Based on Inertial Sensor Data

With the widespread use of Internet of Things(IoT)technology in daily life and the considerable safety risks of falls for elderly individuals,research on IoT-based fall detection systems has gainedmuch attention.This paper proposes an IoT-based spatiotemporal data processing framework based on a depthwise separable convolution generative adversarial network using skip-connection(Skip-DSCGAN)for fall detection.The method uses spatiotemporal data from accelerometers and gyroscopes in inertial sensors as input data.A semisupervised learning approach is adopted to train the model using only activities of daily living(ADL)data,which can avoid data imbalance problems.Furthermore,a quantile-based approach is employed to determine the fall threshold,which makes the fall detection frameworkmore robust.This proposed fall detection framework is evaluated against four other generative adversarial network(GAN)models with superior anomaly detection performance using two fall public datasets(SisFall&MobiAct).The test results show that the proposed method achieves better results,reaching 96.93% and 92.75% accuracy on the above two test datasets,respectively.At the same time,the proposed method also achieves satisfactory results in terms ofmodel size and inference delay time,making it suitable for deployment on wearable devices with limited resources.In addition,this paper also compares GAN-based semisupervised learning methods with supervised learning methods commonly used in fall detection.It clarifies the advantages of GAN-based semisupervised learning methods in fall detection.

Home Automation-Based Health Assessment Along Gesture Recognition via Inertial Sensors

Hand gesture recognition (HGR) is used in a numerous applications,including medical health-care, industrial purpose and sports detection.We have developed a real-time hand gesture recognition system using inertialsensors for the smart home application. Developing such a model facilitatesthe medical health field (elders or disabled ones). Home automation has alsobeen proven to be a tremendous benefit for the elderly and disabled. Residentsare admitted to smart homes for comfort, luxury, improved quality of life,and protection against intrusion and burglars. This paper proposes a novelsystem that uses principal component analysis, linear discrimination analysisfeature extraction, and random forest as a classifier to improveHGRaccuracy.We have achieved an accuracy of 94% over the publicly benchmarked HGRdataset. The proposed system can be used to detect hand gestures in thehealthcare industry as well as in the industrial and educational sectors.

Automatic Recognition of Construction Worker Activities Using Deep Learning Approaches and Wearable Inertial Sensors

The automated evaluation and analysis of employee behavior in an Industry 4.0-compliant manufacturingfirm are vital for the rapid and accurate diagnosis of work performance,particularly during the training of a new worker.Various techniques for identifying and detecting worker performance in industrial applications are based on computer vision techniques.Despite widespread com-puter vision-based approaches,it is challenging to develop technologies that assist the automated monitoring of worker actions at external working sites where cam-era deployment is problematic.Through the use of wearable inertial sensors,we propose a deep learning method for automatically recognizing the activities of construction workers.The suggested method incorporates a convolutional neural network,residual connection blocks,and multi-branch aggregate transformation modules for high-performance recognition of complicated activities such as con-struction worker tasks.The proposed approach has been evaluated using standard performance measures,such as precision,F1-score,and AUC,using a publicly available benchmark dataset known as VTT-ConIoT,which contains genuine con-struction work activities.In addition,standard deep learning models(CNNs,RNNs,and hybrid models)were developed in different empirical circumstances to compare them to the proposed model.With an average accuracy of 99.71%and an average F1-score of 99.71%,the experimentalfindings revealed that the suggested model could accurately recognize the actions of construction workers.Furthermore,we examined the impact of window size and sensor position on the identification efficiency of the proposed method.

Distinction of an Assortment of Deep Brain Stimulation Parameter Configurations for Treating Parkinson’s Disease Using Machine Learning with Quantification of Tremor Response through a Conformal Wearable and Wireless Inertial Sensor

Deep brain stimulation offers an advanced means of treating Parkinson’s disease in a patient specific context. However, a considerable challenge is the process of ascertaining an optimal parameter configuration. Imperative for the deep brain stimulation parameter optimization process is the quantification of response feedback. As a significant improvement to traditional ordinal scale techniques is the advent of wearable and wireless systems. Recently conformal wearable and wireless systems with a profile on the order of a bandage have been developed. Previous research endeavors have successfully differentiated between deep brain stimulation “On” and “Off” status through quantification using wearable and wireless inertial sensor systems. However, the opportunity exists to further evolve to an objectively quantified response to an assortment of parameter configurations, such as the variation of amplitude, for the deep brain stimulation system. Multiple deep brain stimulation amplitude settings are considered inclusive of “Off” status as a baseline, 1.0 mA, 2.5 mA, and 4.0 mA. The quantified response of this assortment of amplitude settings is acquired through a conformal wearable and wireless inertial sensor system and consolidated using Python software automation to a feature set amenable for machine learning. Five machine learning algorithms are evaluated: J48 decision tree, K-nearest neighbors, support vector machine, logistic regression, and random forest. The performance of these machine learning algorithms is established based on the classification accuracy to distinguish between the deep brain stimulation amplitude settings and the time to develop the machine learning model. The support vector machine achieves the greatest classification accuracy, which is the primary performance parameter, and K-nearest neighbors achieves considerable classification accuracy with minimal time to develop the machine learning model.

Implementation of Machine Learning Classification Regarding Hemiplegic Gait Using an Assortment of Machine Learning Algorithms with Quantification from Conformal Wearable and Wireless Inertial Sensor System

The quantification of gait is uniquely facilitated through the conformal wearable and wireless inertial sensor system, which consists of a profile comparable to a bandage. These attributes advance the ability to quantify hemiplegic gait in consideration of the hemiplegic affected leg and unaffected leg. The recorded inertial sensor data, which is inclusive of the gyroscope signal, can be readily transmitted by wireless means to a secure Cloud. Incorporating Python to automate the post-processing of the gyroscope signal data can enable the development of a feature set suitable for a machine learning platform, such as the Waikato Environment for Knowledge Analysis (WEKA). An assortment of machine learning algorithms, such as the multilayer perceptron neural network, J48 decision tree, random forest, K-nearest neighbors, logistic regression, and na&#239ve Bayes, were evaluated in terms of classification accuracy and time to develop the machine learning model. The K-nearest neighbors achieved optimal performance based on classification accuracy achieved for differentiating between the hemiplegic affected leg and unaffected leg for gait and the time to establish the machine learning model. The achievements of this research endeavor demonstrate the utility of amalgamating the conformal wearable and wireless inertial sensor with machine learning algorithms for distinguishing the hemiplegic affected leg and unaffected leg during gait.

Automatic modeling algorithm of stochastic error for inertial sensors

This paper proposes an automatic algorithm to determine the properties of stochastic processes and their parameters for inertial error. The proposed approach is based on a recently developed method called the generalized method of wavelet moments (GMWM), whose estimator was proven to be consistent and asymptotically normally distributed. This algorithm is suitable mainly (but not only) for the combination of several stochastic processes, where the model identification and parameter estimation are quite difficult for the traditional methods, such as the Allan variance and the power spectral density analysis. This algorithm further explores the complete stochastic error models and the candidate model ranking criterion to realize automatic model identification and determination. The best model is selected by making the trade-off between the model accuracy and the model complexity. The validation of this approach is verified by practical examples of model selection for MEMS-IMUs (micro-electro-mechanical system inertial measurement units) in varying dynamic conditions.

Inertial sensors technologies for navigation applications:state of the art and future trends

Inertial navigation represents a unique method of navigation,in which there is no dependency on external sources of information.As opposed to other position fixing navigation techniques,inertial navigation performs the navigation in a relative sense with respect to the initial navigation state of the moving platform.Hence,inertial navigation systems are not prone to jamming,or spoofing.Inertial navigation systems have developed vastly,from their occurrence in the 1940s up to date.The accuracy of the inertial sensors has improved over time,making inertial sensors sufficient in terms of size,weight,cost,and accuracy for navigation and guidance applications.Within the past few years,inertial sensors have developed from being purely mechanical into incorporating various technologies and taking advantage of numerous physical phenomena,from which the dynamic forces exerted on a moving body could be computed accurately.Besides,the evolution of inertial navigation scheme involved the evolution from stable-platform inertial navigation system,which were mechanically complicated,to computationally demanding strap-down inertial navigation systems.Optical sensory technologies have provided highly accurate inertial sensors,at smaller sizes.Besides,the vibratory inertial navigation technologies enabled the production of Micro-electro-machined inertial sensors that are extremely low-cost,and offer extremely low size,weight and power consumption,making them suitable for a wide range of day-to-day navigation applications.Recently,advanced inertial sensor technologies have been introduced to the industry such as nuclear magnetic resonance technology,coldatom technology,and the reintroduction of fluid-based inertial sensors.On another note,inertial sensor errors constitute a huge research aspect in which it is intended for inertial sensors to reach level in which they could operate for substantially long operation times in the absence of updates from aiding sensors,which would be a huge leap.Inertial sensors error modeling techniques have been developing rapidly trying to ensure higher levels of navigation accuracy using lower-cost inertial sensors.In this review,the inertial sensor technologies are covered extensively,along the future trends in the inertial sensors’technologies.Besides,this review covers a brief overview on the inertial error modeling techniques used to enhance the performance of low-cost sensors.

Inertial measurement unit-camera calibration based on incomplete inertial sensor information

This paper is concerned with the problem of estimating the relative orientation between an inertial measurement unit(IMU) and a camera. Unlike most existing IMU-camera calibrations, the main challenge in this paper is that the information output from the IMU is incomplete. For example, only two tilt information can be read from the gravity sensor of a smart phone. Despite incomplete inertial information, there are strong restrictions between the IMU and camera coordinate systems. This paper addresses the incomplete information based IMUcamera calibration problem by exploiting the intrinsic restrictions among the coordinate transformations. First,the IMU transformation between two poses is formulated with the unknown IMU information. Then the defective IMU information is restored using the complementary visual information. Finally, the Levenberg-Marquardt(LM)algorithm is applied to estimate the optimal calibration result in noisy environments. Experiments on both synthetic and real data show the validity and robustness of our algorithm.

Error Model of Rotary Ring Laser Gyro Inertial Navigation System

To improve the precision of inertial navigation system(INS) during long time operation,the rotation modulated technique(RMT) was employed to modulate the errorr of the inertial sensors into periodically varied signals,and,as a result,to suppress the divergence of INS errors.The principle of the RMT was introduced and the error propagating functions were derived from the rotary navigation equation.Effects of the measurement error for the rotation angle of the platform on the system precision were analyzed.The simulation and experimental results show that the precision of INS was ① dramatically improved with the use of the RMT,and ② hardly reduced when the measurement error for the rotation angle was in arc-second level.The study results offer a theoretical basis for engineering design of rotary INS.

Body Worn Sensors for Health Gaming and e-Learning in Virtual Reality

Virtual reality is an emerging field in the whole world.The problem faced by people today is that they are more indulged in indoor technology rather than outdoor activities.Hence,the proposed system introduces a fitness solution connecting virtual reality with a gaming interface so that an individual can play first-person games.The system proposed in this paper is an efficient and cost-effective solution that can entertain people along with playing outdoor games such as badminton and cricket while sitting in the room.To track the human movement,sensors Micro Processor Unit(MPU6050)are used that are connected with Bluetoothmodules andArduino responsible for sending the sensor data to the game.Further,the sensor data is sent to a machine learning model,which detects the game played by the user.The detected game will be operated on human gestures.A publicly available dataset named IM-Sporting Behaviors is initially used,which utilizes triaxial accelerometers attached to the subject’s wrist,knee,and below neck regions to capture important aspects of human motion.The main objective is that the person is enjoying while playing the game and simultaneously is engaged in some kind of sporting activity.The proposed system uses artificial neural networks classifier giving an accuracy of 88.9%.The proposed system should apply to many systems such as construction,education,offices and the educational sector.Extensive experimentation proved the validity of the proposed system.

A Comprehensive Evaluation of State-of-the-Art Deep Learning Models for Road Surface Type Classification

In recent years,as intelligent transportation systems(ITS)such as autonomous driving and advanced driver-assistance systems have become more popular,there has been a rise in the need for different sources of traffic situation data.The classification of the road surface type,also known as the RST,is among the most essential of these situational data and can be utilized across the entirety of the ITS domain.Recently,the benefits of deep learning(DL)approaches for sensor-based RST classification have been demonstrated by automatic feature extraction without manual methods.The ability to extract important features is vital in making RST classification more accurate.This work investigates the most recent advances in DL algorithms for sensor-based RST classification and explores appropriate feature extraction models.We used different convolutional neural networks to understand the functional architecture better;we constructed an enhanced DL model called SE-ResNet,which uses residual connections and squeeze-and-excitation mod-ules to improve the classification performance.Comparative experiments with a publicly available benchmark dataset,the passive vehicular sensors dataset,have shown that SE-ResNet outperforms other state-of-the-art models.The proposed model achieved the highest accuracy of 98.41%and the highest F1-score of 98.19%when classifying surfaces into segments of dirt,cobblestone,or asphalt roads.Moreover,the proposed model significantly outperforms DL networks(CNN,LSTM,and CNN-LSTM).The proposed RE-ResNet achieved the classification accuracies of asphalt roads at 98.98,cobblestone roads at 97.02,and dirt roads at 99.56%,respectively.

Structural Design of High-precision Positioning System in Weak Signal Environment Based on UWB and IMU Fusion

Aiming at the problem that indoor positioning technology based on wireless ultra-wideband pulse technology is susceptible to non-line-of-sight effects and multipath effects in confined spaces and weak signal environments,a high-precision positioning system based on UWB and IMU in a confined environment is designed.The STM32 chip is used as the main control,and the data information of IMU and UWB is fused by the fusion filtering algorithm.Finally,the real-time information of the positioning is transmitted to the host computer and the cloud.The experimental results show that the positioning accuracy and positioning stability of the system have been improved in the non-line-of-sight case of closed environment.The system has high positioning accuracy in a closed environment,and the components used are consumer-grade,which has strong practicability.

Implementation of an Assortment of Machine Learning Classification Algorithms Regarding Diadochokinesia for Hemiparesis with Quantification from Conformal Wearable and Wireless System

Diadochokinesia pertains to a standard aspect of the conventional neurological examination, which involves the oscillation between muscle groups with an agonist and antagonist relationship. A representative example is the pronation and supination of the forearm. Hemiparesis visibly demonstrates disparity of diadochokinesia, and clinical quantification is achieved through the use of an ordinal scale, which is inherently subjective. A conformal wearable and wireless inertial sensor equipped with a gyroscope mounted about the dorsum of the hand can objectively quantify diadochokinesia respective of forearm pronation and supination. The objective of the research endeavor was to apply an assortment of machine learning algorithms to distinguish between a hemiplegic affected and unaffected upper limb pair based on diadochokinesia with respect to pronation and supination of the forearm. Performance of the machine learning algorithms, such as the multilayer perceptron neural network, J48 decision tree, random forest, K-nearest neighbors, logistic regression, and naïve Bayes, were evaluated in consideration of classification accuracy and time to develop the machine learning model. The machine learning feature set was derived from the acquired gyroscope signal data. Using the gyroscope signal data from the conformal wearable and wireless inertial sensor the logistic regression and naïve Bayes machine learning algorithms achieved considerable performance capability with respect to both time to converge the machine learning model and classification accuracy for distinguishing between a hemiplegic upper limb pair for diadochokinesia in consideration of pronation and supination.

Development of a low-cost GPS/INS integrated system for tractor automatic navigation

The use of low-cost single GPS receivers and inertial sensors for auto-guidance applications has been limited by their reduced accuracy and signal drift over time compared to real-time kinematic(RTK)differential GPS units and fiber-optic gyroscope(FOG)sensors.In this study,a prototype low-cost GPS/INS integrated system consisting of a triangle-shaped array of three Garmin 19x GPS receivers and an Xsens inertial measurement unit(IMU)to improve the accuracy of position and heading angle measured with a single GPS receiver was developed.A triangular algorithm that uses data collected from the three single GPSs mounted on the angular points of a triangular frame was designed.A sensor fusion algorithm based on the Kalman filter combining the GPS and IMU data was developed by integrating position data and heading angles of a triangular array of GPS receivers.The optimized values of two noise covariance matrixes(Q and R)for the Kalman filtering were determined using the Central Composite Design(CCD)method.As compared to the use of a single Garmin GPS receiver,use of the developed GPS/INS system showed improved accuracy performance in terms of both position and heading angle,with reductions in root mean square errors(RMSEs)from 2.7 m to 0.64 m for position and from 8.9ºto 2.1ºfor heading angle.The accuracy improvements show new potential for agricultural auto-guidance applications.

INS stochastic error detection during kinematic tests and impacts on INS/GNSS performance

Inertial Navigation System(INS)and Global Navigation Satellite System(GNSS)integration requires accurate modelling of both INS deterministic and stochastic errors.The Allan Variance(AV)analysis on INS static data is one method of determining INS stochastic errors.However,it is known that INS errors can vary depending on a vehicle’s motion and environment,and application of AV results from static data in kinematic operations typically results in an over-confident estimation of stochastic.In order to overcome this limitation,this paper proposes the use of Dynamic Allan Variance(DAV).The paper compares the resulting performance of the INS/GNSS integrated system by varying the stochastic coefficients obtained from the AV and DAV.The results show that the performance improved when utilizing the stochastic coefficients obtained from the DAV,applied on a kinematic dataset compared to the AV,applied on a static laboratory dataset.