State Estimation Method for GNSS/INS/Visual Multi-sensor Fusion Based on Factor Graph Optimization for Unmanned System

With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation satellite system/inertial navigation system(GNSS/INS)integrated navigation systems can provide high-precision navigation information continuously.However,when this system is applied to indoor or GNSS-denied environments,such as outdoor substations with strong electromagnetic interference and complex dense spaces,it is often unable to obtain high-precision GNSS positioning data.The positioning and orientation errors will diverge and accumulate rapidly,which cannot meet the high-precision localization requirements in large-scale and long-distance navigation scenarios.This paper proposes a method of high-precision state estimation with fusion of GNSS/INS/Vision using a nonlinear optimizer factor graph optimization as the basis for multi-source optimization.Through the collected experimental data and simulation results,this system shows good performance in the indoor environment and the environment with partial GNSS signal loss.

Resilient tightly coupled INS/UWB integration method for indoor UAV navigation under challenging scenarios

Based on the high positioning accuracy,low cost and low-power consumption,the ultra-wide-band(UWB)is an ideal solution for indoor unmanned aerial vehicle(UAV)localization and navigation.However,the UWB signals are easy to be blocked or reflected by obstacles such as walls and furniture.A resilient tightly-coupled inertial navigation system(INS)/UWB integration is proposed and implemented for indoor UAV navigation in this paper.A factor graph optimization(FGO)method enhanced by resilient stochastic model is established to cope with the indoor challenging scenarios.To deal with the impact of UWB non-line-of-sight(NLOS)signals and noise uncertainty,the conventional neural net-works(CNNs)are introduced into the stochastic modelling to improve the resilience and reliability of the integration.Based on the status that the UWB features are limited,a‘two-phase'CNNs structure was designed and implemented:one for signal classification and the other one for measurement noise prediction.The proposed resilient FGO method is tested on flighting UAV platform under actual indoor challenging scenario.Compared to classical FGO method,the overall positioning errors can be decreased from about 0.60 m to centimeter-level under signal block and reflection scenarios.The superiority of resilient FGO which effectively verified in constrained environment is pretty important for positioning accuracy and integrity for indoor navigation task.