Progress and Achievements of Multi-sensor Fusion Navigation in China during 2019—2023

Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.

STUDY OF MULTISENSOR INFORMATION FUSION FILTER IN INTEGRATED NAVIGATION

This paper presents a new information fusion filter in integrated navigation. The method can improve the fault-tolerant performance and make well fault detection, isolation and reconfiguration of the integrated navigation system exist. Based on three sensors'(strapdown system, GPS receiver, Doppler radar) information fusion, a fault-tolerant navigation system is designed with this information fusion filter and two-ellipsoid overlap test. Simulation results show that the design is efficient with the soft-failure of gyro, accelerator, GPS receiver and Doppler radar.

Fault tolerant navigation method for satellite based on information fusion and unscented Kalman filter

An effective autonomous navigation system for the integration of star sensor,infrared horizon sensor,magnetometer,radar altimeter and ultraviolet sensor is developed.The requirements of the integrated navigation system manager make optimum use of the various navigation sensors and allow rapid fault detection,isolation and recovery.The normal full fusion feedback method of federated unscented Kalman filter（UKF） cannot meet the needs of it.So a no-reset feedback federated Kalman filter architecture is developed and used in the autonomous navigation system.The minimal skew sigma points are chosen to improve the calculation speed.Simulation results are presented to demonstrate the advantages of the algorithm.These advantages include improved failure detection and correction,improved computational efficiency,and reliability.Additionally,its＇ accuracy is higher than that of the full fusion feedback method.

DGPS/INS Data Fusion for Land Navigation

The interest for land navigation has increased for the recent years. With the advent of the Global Position System (GPS) we have now the ability to determine the absolute position anywhere on the globe. The problem is that the GPS systems work well only in open environments with no overhead obstructions and they are subject to large unavoidable errors when the reception from some of the satellites are blocked. This occurs frequently in urban environments, forests and tunnels. GPS systems require at least four “visible” satellites to maintain a good position fix. In many situations in which higher level of accuracy is required, the navigation cannot be achieved by GPS alone. This paper discusses the design of a reliable multisensor fusion algorithm using GPS and Inertial Navigation System in order to decrease the implementation cost of such systems on land vehicles. The major contribution of this paper is in the definition of the possible developments and research axes in land navigation.

State Estimation Method for GNSS/INS/Visual Multi-sensor Fusion Based on Factor Graph Optimization for Unmanned System

With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation satellite system/inertial navigation system(GNSS/INS)integrated navigation systems can provide high-precision navigation information continuously.However,when this system is applied to indoor or GNSS-denied environments,such as outdoor substations with strong electromagnetic interference and complex dense spaces,it is often unable to obtain high-precision GNSS positioning data.The positioning and orientation errors will diverge and accumulate rapidly,which cannot meet the high-precision localization requirements in large-scale and long-distance navigation scenarios.This paper proposes a method of high-precision state estimation with fusion of GNSS/INS/Vision using a nonlinear optimizer factor graph optimization as the basis for multi-source optimization.Through the collected experimental data and simulation results,this system shows good performance in the indoor environment and the environment with partial GNSS signal loss.

Unequal-interval data fusion algorithm for inertial/gravity matching integrated navigation system

Inertial/gravity matching integrated navigation system can effectively improve the longendurance navigation ability of underwater vehicles.Through the analysis of the matching process,the problem of unequal-interval in matching trajectory is addressed by an unequal-interval data fusion algorithm which is based on the unequal-interval characteristics analysis of the matching trajectory.Compared with previously available methods,the proposed algorithm improves the location precision.In conclusion,simulations of the integrated navigation system demonstrated the effectiveness and superiority of the proposed algorithm.

Fusion Navigation Technique for Management of Difficult to Access Hepatocellular Carcinoma: A Single Center Experience

Introduction: Sonography is the most universally used imaging technique for planning and performing thermal ablation in Hepatocellular carcinoma patients due to its efficiency and safety. However, the presence of HCC nodules that are hardly visible on traditional sonography is a major drawback to its use during thermal ablation. Real-time image fusion (fusion imaging) or real-time virtual sonography is a new technology that has been developed. Aim: To determine the value of fusion/navigation guided percutaneous thermal ablation in the management of hepatocellular carcinoma that has poor conspicuity at conventional sonography. Subjects and Methods: This study included 70 HCC patients (BCLC A and B). Percutaneous radiofrequency ablation was done via real-time image fusion for 14 patients with poorly visible HCC nodules (study group), while Percutaneous radiofrequency ablation was done via traditional sonography for 56 patients with HCC nodules (control group). Results: The median time to reach the tumor was significantly shorter by using fusion navigation technique (P = 0.034). By using fusion navigation technique 92% of the lesions were completely ablated while 55% only were completely ablated by using ultrasonography (P = 0.014). One year after the procedure , by using fusion navigation technique 92% of the patients had complete response and only 55% of the patients had complete response by using conventional ultrasonography (P = 0.011). The survival distributions for both interventions were statistically significantly different, χ2 = 10.12, P = 0.001. Conclusion: Fusion imaging-guided percutaneous RFA is a reasonable and efficient treatment of patients with HCC undetectable by traditional ultrasonography.

Research on the Relationship Between Information Fusion Method and Information Failure Mode in Integrated Navigation System

On the basis of the basic principles of weighted fusion, Kalman filtering and BP neural networks, the basic principles of information fusion methods used in integrated navigation systems are expounded. Through the analysis of the basic principles, the as-sociation of information fusion methods commonly used in integrated navigation systems and information failure modes is obtained: the information fault mode of weighted fusion method The model is closely related to the specific weight allocation method, which depends on the fault mode of the sensor or sub-system in which the weight is dominant;the information fault mode of the Kalman filtering information fusion method is a continuous mutation fault corresponding to the nonlinear time interval of the system;the in-formation fault mode of the BP neural network method is gradual with time. The information failure mode of the BP neural network method is a slowly varying fault that gradually accumulates over time. Starting from the complexity associated with the information fusion method and the information failure mode, it is pointed out that in order to systematically express the relationship between the information fusion method and the information failure mode, further research can be carried out.

An intelligent navigation experimental system based on multi-mode fusion

At present,most experimental teaching systems lack guidance of an operator,and thus users often do not know what to do during an experiment.The user load is therefore increased,and the learning efficiency of the students is decreased.To solve the problem of insufficient system interactivity and guidance,an experimental navigation system based on multi-mode fusion is proposed in this paper.The system first obtains user information by sensing the hardware devices,intelligently perceives the user intention and progress of the experiment according to the information acquired,and finally carries out a multi-modal intelligent navigation process for users.As an innovative aspect of this study,an intelligent multi-mode navigation system is used to guide users in conducting experiments,thereby reducing the user load and enabling the users to effectively complete their experiments.The results prove that this system can guide users in completing their experiments,and can effectively reduce the user load during the interaction process and improve the efficiency.

FAULT-TOLERANT INTEGRATED NAVIGATION SYSTEM BASED ON NEURONS

In this paper, the multisensor data fusion technique of a fault tolerant integrated navigation system is discussed. A neural approach for data fusion is proposed for multisensor integrated systems. The simulation results show that this neural approach for data fusion is feasible.

Intelligent fault-tolerant algorithm with two-stage and feedback for integrated navigation federated filtering

In order to take full advantage of federated filter in fault-tolerant design of integrated navigation system, the limitation of fault detection algorithm for gradual changing fault detection and the poor fault tolerance of global optimal fusion algorithm are the key problems to deal with. Based on theoretical analysis of the influencing factors of federated filtering fault tolerance, global fault-tolerant fusion algorithm and information sharing algorithm are proposed based on fuzzy assessment. It achieves intelligent fault-tolerant structure with two-stage and feedback, including real-time fault detection in sub-filters, and fault-tolerant fusion and information sharing in main filter. The simulation results demonstrate that the algorithm can effectively improve fault-tolerant ability and ensure relatively high positioning precision of integrated navigation system when a subsystem having gradual changing fault.

Kalman filter applied in underwater integrated navigation system

For the underwater integrated navigation system, information fusion is an important technology. This paper introduces the Kalman filter as the most useful information fusion technology, and then gives a summary of the Kalman filter applied in underwater integrated navigation system at present, and points out the further research directions in this field.

Integrated Navigation Based on Robust Estimation Outputs of Multi-sensor Measurements and Adaptive Weights of Dynamic Model Information

An integrated navlgation based on the kinematic or dynamic state model and the raw measurements has the advantages of high redundancy, high reliability, as well as high ability of fault tolerance and simplicity in calculation. In order to control the influences of measurements outliers and the kinematic model errors on the integrated navigation results, a robust estimation method and an adaptive data fusion method are applied. An integrated navigation example using simulated data is performed and analyzed.

Production of High-Resolution Remote Sensing Images for Navigation Information Infrastructures

This paper introduces the image fusion approach of multi-resolutionanalysis-based intensity modulation (MRAIM) to produce the high-resolution multi-spectral imagesfrom high-resolution panchromatic image and low-resolution multi-spectral images for navigationinformation infrastructure. The mathematical model of image fusion is derived according to theprinciple of remote sensing image formation. It shows that the pixel values of a high-resolutionmulti-spectral images are determined by the pixel values of the approximation of a high-resolutionpanchromatic image at the resolution level of low-resolution multi-spectral images, and in the pixelvalae computation the M-band wavelet theory and the a trous algorithm are then used. In order toevaluate the MRAIM approach, an experiment has been carried out on the basis of the IKONOS 1 mpanchromatic image and 4 m multi-spectral images. The result demonstrates that MRAIM image fusionapproach gives promising fusion results and it can be used to produce the high-resolution remotesensing images required for navigation information infrastructures.

Integrated Navigation Filtering Method Based on Wavelet Neural Network Optimized by MEA Model

In the experiment of combined navigation filtering using wavelet neural network, the initial parameters of the network have the influence of randomness on network convergence and navigation accuracy. A combined navigation filtering method based on wavelet neural network optimized by mind evolution algorithm is proposed. Firstly, the efficient global search ability of the mind evolution algorithm was used to quickly and accurately obtain the initial parameters of the appropriate wavelet neural network, and then the optimized wavelet neural network was applied to directly predict the position and velocity error data. This method is different from the traditional filtering method, while avoiding the drawbacks of the neural network. The simulation experiments with wavelet neural network and GA-wavelet network were carried out. The results show that the proposed method can effectively improve the accuracy of the integrated navigation system and provide a feasible path for combined navigation filtering.

基于IMU-LiDAR紧耦合的煤矿防冲钻孔机器人定位导航方法

防冲钻孔机器人是冲击地压矿井卸压的关键设备,其在复杂卸压巷道的精确地图构建和的稳定导航是实现钻孔作业智能化的基础和前提。在分析激光雷达点云畸变成因和同步定位与地图构建(SLAM)算法缺陷的基础上,设计了基于惯性测量单元(IMU)连续时间轨迹的点云畸变矫正方法,建立了激光雷达和IMU的数据融合模型,提出了基于IMU-LiDAR紧耦合的防冲钻孔机器人定位建图方法。根据煤矿卸压巷道特点建立了密闭坡道模型,开展了建图效果仿真分析,结果表明,所提算法在定位精度、轨迹误差方面均优于现有常用算法。在此基础上,设计了基于改进人工势场法和快速扩展随机树的动态路径规划方法,建立了适用于防冲钻孔机器人的路径规划与导航融合方案,并设计了2种仿真运动场景,结果表明,所提路径规划方法在全局路径规划和动态路径规划的平均路径长度、平均运行时间、平均生成节点数等方面均具有较好的综合性能。为了进一步验证防冲钻孔机器人定位导航方法的实用性,在校内模拟巷道、地面实验基地和井下卸压巷道等场景下开展了多组对比实验,结果表明:将IMU数据与LiDAR数据紧耦合后,所提方法的定位建图精度明显提高,在特征退化场景中具有优越的定位建图性能,且规划路径的运算效率和路径代价方面均具有良好的表现,验证了所提定位导航方法在多种场景中的可行性和优越性。

一种Wi-Fi RTT/数据驱动惯性导航行人室内定位方法

为了研究基于智能手机的行人室内定位方法,并提高其精度,本文提出了一种基于Wi-Fi往返时间(RTT)、惯性测量单元(IMU)的定位系统。该方法主要包括3部分:(1)使用扩展卡尔曼滤波融合测距信息的Wi-Fi RTT室内定位方法;(2)适用于多手机使用模式的航位推算方法,该方法基于长短时记忆模型(LSTM)建立神经网络模型,预测行人运动速度及航向;(3)基于误差状态卡尔曼滤波的Wi-Fi RTT/数据驱动惯性导航融合定位方法,进一步提高定位精度。试验结果表明,与单一的基于Wi-Fi RTT方法和数据驱动惯性导航方法相比,本文方法的平均定位精度提升了10%~20%。

基于改进ESKF的植保无人机时延位姿补偿算法

为解决全球导航卫星系统和惯性测量单元融合时间不同步问题,提高植保无人机位姿估计精度,本文根据植保无人机大惯性、强振动的特性提出一种基于改进误差状态卡尔曼的时延位姿补偿算法。首先对名义状态变量线性预测,引入渐消因子提高强振动环境下的系统稳定性;接着采用互补滤波对角速度补偿,对姿态误差状态变量修正;最后结合测量的延迟时间,使用互补滤波外推数据,提高大惯性特性下的速度位置精度。实验结果表明,相较于误差状态卡尔曼算法,横滚角和俯仰角均方根误差减少0.2669°和0.2414°,偏航角均方根误差减少0.0764°;正常航迹植保作业下,东北天方向速度均方根误差减少0.2105、0.1849、0.2388 m/s;东北天方向位置均方根误差分别减少0.21、0.19、0.23 m,有效提高位姿估计精度。

面向民机可视导航的场面多尺度目标检测

民航飞机视觉辅助驾驶系统通过机载视觉传感器获取周边威胁态势信息,为飞行员提供辅助决策等信息,但是机载视觉传感器获取的机场场面威胁目标尺度变化大,且机载平台算力有限,现有的目标检测方法难以满足视觉辅助驾驶需求.针对上述问题,提出一种基于YOLOv5s算法的轻量化多尺度目标检测算法.首先,为增强场面小目标的特征表达,在加权双向特征金字塔网络(BIFPN)基础上,引入坐标注意力(CA)机制,设计CA-BIFPN特征融合网络,提高模型对多种尺度目标的学习能力.然后,设计GSConv解耦检测头,相互独立优化分类和回归目标,提高目标检测的精度.设计的跨级部分网络轻量化颈部模块可减少因引入解耦头增加的参数量,大幅提高整体网络的检测速度,实现场面目标实时检测.为了验证算法性能,构建机载视觉传感器滑行视角的实测数据、仿真数据组成的多尺度场面目标数据集.在该数据集上的实验结果表明,所提方法检测精度超过Faster R-CNN、SSD和YOLOv6、YOLOv7、YOLOX等经典多尺度目标检测算法,均值平均精度为71.40%,比YOLOv5s提高4.19个百分点;在机载计算仿真实验平台上,检测帧率达到71帧/s,满足实时检测要求.

无人作业船自动导航控制系统的优化

为了提高原有导航系统中低成本传感器的数据检测精度和船体航迹跟踪的控制效果,引入数据融合算法并提出了一种新型的航迹跟踪算法.导航系统首先对船体进行多次坐标变换,通过两次卡尔曼滤波器融合出更精准的船体航向角、坐标和速度;其次提出了一种基于消除航迹速度偏差和航向角偏差的控制算法,将传统的PID控制器设计成由PI控制器和微分控制器组成的串级控制系统,作为内环的微分量正好由现有的加速度计和陀螺仪检测变送,省去了对微分参数的调节,对检测精度不高的系统也可以有较好的控制效果;最后解算出船体两个明轮各自需要的出力情况,以提高航迹跟踪效果.在试验平台上控制无人作业船进行多次巡航试验,通过上位机实时监测船体的状态数据和运行轨迹,并对整体优化后的航迹跟踪效果进行了分析.结果表明:经卡尔曼滤波器融合后的航向角、定位和速度,数据方差更小,更接近于理想值;对于控制算法,系统的超调量不超过3%,响应速度足够快,且稳态误差接近0;航迹跟踪的直线段成功率由优化前的80%提升到了95%,拐弯段的成功率由优化前的60%提升到了90%,直线段的最大偏航平均距离由优化前的0.83 m降到了0.12 m,拐弯段的最大偏航平均距离由优化前的1.25 m降到了0.22 m;拐弯后平均需要0.95 m长的调整距离就可以进入直行状态,直线段和拐弯段的跟踪效果明显得到了改善.