This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a ...This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.展开更多
In order to address the issue of sensor configuration redundancy in intelligent driving,this paper constructs a multi-objective optimization model that considers cost,coverage ability,and perception performance.And th...In order to address the issue of sensor configuration redundancy in intelligent driving,this paper constructs a multi-objective optimization model that considers cost,coverage ability,and perception performance.And then,combining a specific set of parameters,the NSGA-II algorithm is used to solve the multi-objective model established in this paper,and a Pareto front containing 24 typical configuration schemes is extracted after considering empirical constraints.Finally,using the decision preference method proposed in this paper that combines subjective and objective factors,decision scores are calculated and ranked for various configuration schemes from both cost and performance preferences.The research results indicate that the multi-objective optimization model established in this paper can screen and optimize various configuration schemes from the optimal principle of the vehicle,and the optimized configuration schemes can be quantitatively ranked to obtain the decision results for the vehicle under different preference tendencies.展开更多
With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation sa...With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation satellite system/inertial navigation system(GNSS/INS)integrated navigation systems can provide high-precision navigation information continuously.However,when this system is applied to indoor or GNSS-denied environments,such as outdoor substations with strong electromagnetic interference and complex dense spaces,it is often unable to obtain high-precision GNSS positioning data.The positioning and orientation errors will diverge and accumulate rapidly,which cannot meet the high-precision localization requirements in large-scale and long-distance navigation scenarios.This paper proposes a method of high-precision state estimation with fusion of GNSS/INS/Vision using a nonlinear optimizer factor graph optimization as the basis for multi-source optimization.Through the collected experimental data and simulation results,this system shows good performance in the indoor environment and the environment with partial GNSS signal loss.展开更多
The perception module of advanced driver assistance systems plays a vital role.Perception schemes often use a single sensor for data processing and environmental perception or adopt the information processing results ...The perception module of advanced driver assistance systems plays a vital role.Perception schemes often use a single sensor for data processing and environmental perception or adopt the information processing results of various sensors for the fusion of the detection layer.This paper proposes a multi-scale and multi-sensor data fusion strategy in the front end of perception and accomplishes a multi-sensor function disparity map generation scheme.A binocular stereo vision sensor composed of two cameras and a light deterction and ranging(LiDAR)sensor is used to jointly perceive the environment,and a multi-scale fusion scheme is employed to improve the accuracy of the disparity map.This solution not only has the advantages of dense perception of binocular stereo vision sensors but also considers the perception accuracy of LiDAR sensors.Experiments demonstrate that the multi-scale multi-sensor scheme proposed in this paper significantly improves disparity map estimation.展开更多
The transmission line tower will be affected by bad weather and artificial subsidence caused by the foundation and other factors in the power transmission.The tower’s tilt and severe deformation will cause the buildi...The transmission line tower will be affected by bad weather and artificial subsidence caused by the foundation and other factors in the power transmission.The tower’s tilt and severe deformation will cause the building to collapse.Many small changes caused the tower’s collapse,but the early staff often could not intuitively notice the changes in the tower’s state.In the current tower online monitoring system,terminal equipment often needs to replace batteries frequently due to premature exhaustion of power.According to the need for real-time measurement of power line tower,this research designed a real-time monitoring device monitoring the transmission tower attitude tilting and foundation state based on the inertial sensor,the acceleration of 3 axis inertial sensor and angular velocity raw data to pole average filtering pre-processing,and then through the complementary filtering algorithm for comprehensive calculation of tilt angle,the system meets the demand for inclined online monitoring of power line poles and towers regarding measurement accuracy,with low cost and power consumption.The optimization multi-sensor cooperative detection and correction measured tilt angle result relative accuracy can reach 1.03%,which has specific promotion and application value since the system has the advantages of unattended and efficient calculation.展开更多
Glacier disasters occur frequently in alpine regions around the world,but the current conventional geological disaster measurement technology cannot be directly used for glacier disaster measurement.Hence,in this stud...Glacier disasters occur frequently in alpine regions around the world,but the current conventional geological disaster measurement technology cannot be directly used for glacier disaster measurement.Hence,in this study,a distributed multi-sensor measurement system for glacier deformation was established by integrating piezoelectric sensing,coded sensing,attitude sensing technology and wireless communication technology.The traditional Modbus protocol was optimized to solve the problem of data identification confusion of different acquisition nodes.Through indoor wireless transmission,adaptive performance analysis,error measurement experiment and landslide simulation experiment,the performance of the measurement system was analyzed and evaluated.Using unmanned aerial vehicle technology,the reliability and effectiveness of the measurement system were verified on the site of Galongla glacier in southeastern Tibet,China.The results show that the mean absolute percentage errors were only 1.13%and 2.09%for the displacement and temperature,respectively.The distributed glacier deformation real-time measurement system provides a new means for the assessment of the development process of glacier disasters and disaster prevention and mitigation.展开更多
With increased dependence on space assets,scheduling and tasking of the space surveillance network(SSN)are vitally important.The multi-sensor collaborative observation scheduling(MCOS)problem is a multi-constraint and...With increased dependence on space assets,scheduling and tasking of the space surveillance network(SSN)are vitally important.The multi-sensor collaborative observation scheduling(MCOS)problem is a multi-constraint and high-conflict complex combinatorial optimization problem that is nondeterministic polynomial(NP)-hard.This research establishes a sub-time window constraint satisfaction problem(STWCSP)model with the objective of maximizing observation profit.Considering the significant effect of genetic algorithms(GA)on solving the problem of resource allocation,an evolution heuristic(EH)algorithm containing three strategies that focus on the MCOS problem is proposed.For each case,a task scheduling sequence is first obtained via an improved GA with penalty(GAPE)algorithm,and then a mission planning algorithm(heuristic rule)is used to determine the specific observation time.Compared to the model without sub-time windows and some other algorithms,a series of experiments illustrate the STWCSP model has better performance in terms of total profit.Experiments about strategy and parameter sensitivity validate its excellent performance in terms of EH algorithms.展开更多
Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and ot...Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.展开更多
At present, multi-se nsor fusion is widely used in object recognition and classification, since this technique can efficiently improve the accuracy and the ability of fault toleranc e. This paper describes a multi-se...At present, multi-se nsor fusion is widely used in object recognition and classification, since this technique can efficiently improve the accuracy and the ability of fault toleranc e. This paper describes a multi-sensor fusion system, which is model-based and used for rotating mechanical failure diagnosis. In the data fusion process, the fuzzy neural network is selected and used for the data fusion at report level. By comparing the experimental results of fault diagnoses based on fusion data wi th that on original separate data,it is shown that the former is more accurate than the latter.展开更多
多传感器网络化线性离散系统的每个传感器基于自己的观测数据可进行局部状态估计。当局部估值被传输给融合中心时,可能遭受DoS(Denial of service)攻击。为了补偿DoS攻击引起的数据丢失,采用丢失数据的预报器进行补偿。应用线性无偏最...多传感器网络化线性离散系统的每个传感器基于自己的观测数据可进行局部状态估计。当局部估值被传输给融合中心时,可能遭受DoS(Denial of service)攻击。为了补偿DoS攻击引起的数据丢失,采用丢失数据的预报器进行补偿。应用线性无偏最小方差矩阵加权融合算法获得分布式融合状态滤波器。所提出的分布式融合滤波器改善了局部估计的精度,且比协方差交叉融合算法具有更高的估计精度。仿真例子验证了算法的有效性。展开更多
在图优化框架的基础上,设计多传感器融合方案和有效的优化方法,提出一套具有鲁棒性的定位与建图(Simultaneous Localization and Mapping,SLAM)方案,能够有效应对室内外复杂环境。进一步发展激光-视觉后端建图融合方法,构建具备全新地...在图优化框架的基础上,设计多传感器融合方案和有效的优化方法,提出一套具有鲁棒性的定位与建图(Simultaneous Localization and Mapping,SLAM)方案,能够有效应对室内外复杂环境。进一步发展激光-视觉后端建图融合方法,构建具备全新地图表达形式的点云网格化地图。同时使用低成本传感器,设计实现基于多传感器融合的高性能低成本背包扫描系统,整体完成在未知环境中的自我定位和稠密建图,且在低性能CPU设备上将长时间运动带来的每100 m的轨迹误差平均降低至厘米级。提出的基于多传感器融合方案,在精度、算力消耗上能够匹配现有主流方案,对获取各种环境条件下的系统准确定位结果和丰富的空间信息具有重要意义。展开更多
文摘This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.
文摘In order to address the issue of sensor configuration redundancy in intelligent driving,this paper constructs a multi-objective optimization model that considers cost,coverage ability,and perception performance.And then,combining a specific set of parameters,the NSGA-II algorithm is used to solve the multi-objective model established in this paper,and a Pareto front containing 24 typical configuration schemes is extracted after considering empirical constraints.Finally,using the decision preference method proposed in this paper that combines subjective and objective factors,decision scores are calculated and ranked for various configuration schemes from both cost and performance preferences.The research results indicate that the multi-objective optimization model established in this paper can screen and optimize various configuration schemes from the optimal principle of the vehicle,and the optimized configuration schemes can be quantitatively ranked to obtain the decision results for the vehicle under different preference tendencies.
基金supported in part by the Guangxi Power Grid Company’s 2023 Science and Technol-ogy Innovation Project(No.GXKJXM20230169)。
文摘With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation satellite system/inertial navigation system(GNSS/INS)integrated navigation systems can provide high-precision navigation information continuously.However,when this system is applied to indoor or GNSS-denied environments,such as outdoor substations with strong electromagnetic interference and complex dense spaces,it is often unable to obtain high-precision GNSS positioning data.The positioning and orientation errors will diverge and accumulate rapidly,which cannot meet the high-precision localization requirements in large-scale and long-distance navigation scenarios.This paper proposes a method of high-precision state estimation with fusion of GNSS/INS/Vision using a nonlinear optimizer factor graph optimization as the basis for multi-source optimization.Through the collected experimental data and simulation results,this system shows good performance in the indoor environment and the environment with partial GNSS signal loss.
基金the National Key R&D Program of China(2018AAA0103103).
文摘The perception module of advanced driver assistance systems plays a vital role.Perception schemes often use a single sensor for data processing and environmental perception or adopt the information processing results of various sensors for the fusion of the detection layer.This paper proposes a multi-scale and multi-sensor data fusion strategy in the front end of perception and accomplishes a multi-sensor function disparity map generation scheme.A binocular stereo vision sensor composed of two cameras and a light deterction and ranging(LiDAR)sensor is used to jointly perceive the environment,and a multi-scale fusion scheme is employed to improve the accuracy of the disparity map.This solution not only has the advantages of dense perception of binocular stereo vision sensors but also considers the perception accuracy of LiDAR sensors.Experiments demonstrate that the multi-scale multi-sensor scheme proposed in this paper significantly improves disparity map estimation.
基金This work was supported by the National Natural Science Foundation of China(Nos.62172242,51901152)Industry University Cooperation Education Program of the Ministry of Education(No.2020021680113)Shanxi Scholarship Council of China.
文摘The transmission line tower will be affected by bad weather and artificial subsidence caused by the foundation and other factors in the power transmission.The tower’s tilt and severe deformation will cause the building to collapse.Many small changes caused the tower’s collapse,but the early staff often could not intuitively notice the changes in the tower’s state.In the current tower online monitoring system,terminal equipment often needs to replace batteries frequently due to premature exhaustion of power.According to the need for real-time measurement of power line tower,this research designed a real-time monitoring device monitoring the transmission tower attitude tilting and foundation state based on the inertial sensor,the acceleration of 3 axis inertial sensor and angular velocity raw data to pole average filtering pre-processing,and then through the complementary filtering algorithm for comprehensive calculation of tilt angle,the system meets the demand for inclined online monitoring of power line poles and towers regarding measurement accuracy,with low cost and power consumption.The optimization multi-sensor cooperative detection and correction measured tilt angle result relative accuracy can reach 1.03%,which has specific promotion and application value since the system has the advantages of unattended and efficient calculation.
基金funded by National Key R&D Program of China((Nos.2022YFC3003403 and 2018YFC1505203)Key Research and Development Program of Tibet Autonomous Region(XZ202301ZY0039G)+1 种基金Natural Science Foundation of Hebei Province(No.F2021201031)Geological Survey Project of China Geological Survey(No.DD20221747)。
文摘Glacier disasters occur frequently in alpine regions around the world,but the current conventional geological disaster measurement technology cannot be directly used for glacier disaster measurement.Hence,in this study,a distributed multi-sensor measurement system for glacier deformation was established by integrating piezoelectric sensing,coded sensing,attitude sensing technology and wireless communication technology.The traditional Modbus protocol was optimized to solve the problem of data identification confusion of different acquisition nodes.Through indoor wireless transmission,adaptive performance analysis,error measurement experiment and landslide simulation experiment,the performance of the measurement system was analyzed and evaluated.Using unmanned aerial vehicle technology,the reliability and effectiveness of the measurement system were verified on the site of Galongla glacier in southeastern Tibet,China.The results show that the mean absolute percentage errors were only 1.13%and 2.09%for the displacement and temperature,respectively.The distributed glacier deformation real-time measurement system provides a new means for the assessment of the development process of glacier disasters and disaster prevention and mitigation.
基金supported by the National Natural Science Foundation of China(11802333)the Scientific Research Program of the National University of Defense Technology(ZK19-31)。
文摘With increased dependence on space assets,scheduling and tasking of the space surveillance network(SSN)are vitally important.The multi-sensor collaborative observation scheduling(MCOS)problem is a multi-constraint and high-conflict complex combinatorial optimization problem that is nondeterministic polynomial(NP)-hard.This research establishes a sub-time window constraint satisfaction problem(STWCSP)model with the objective of maximizing observation profit.Considering the significant effect of genetic algorithms(GA)on solving the problem of resource allocation,an evolution heuristic(EH)algorithm containing three strategies that focus on the MCOS problem is proposed.For each case,a task scheduling sequence is first obtained via an improved GA with penalty(GAPE)algorithm,and then a mission planning algorithm(heuristic rule)is used to determine the specific observation time.Compared to the model without sub-time windows and some other algorithms,a series of experiments illustrate the STWCSP model has better performance in terms of total profit.Experiments about strategy and parameter sensitivity validate its excellent performance in terms of EH algorithms.
基金National Key R&D Program of China(No.2021YFB2501102)。
文摘Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.
文摘At present, multi-se nsor fusion is widely used in object recognition and classification, since this technique can efficiently improve the accuracy and the ability of fault toleranc e. This paper describes a multi-sensor fusion system, which is model-based and used for rotating mechanical failure diagnosis. In the data fusion process, the fuzzy neural network is selected and used for the data fusion at report level. By comparing the experimental results of fault diagnoses based on fusion data wi th that on original separate data,it is shown that the former is more accurate than the latter.
文摘多传感器网络化线性离散系统的每个传感器基于自己的观测数据可进行局部状态估计。当局部估值被传输给融合中心时,可能遭受DoS(Denial of service)攻击。为了补偿DoS攻击引起的数据丢失,采用丢失数据的预报器进行补偿。应用线性无偏最小方差矩阵加权融合算法获得分布式融合状态滤波器。所提出的分布式融合滤波器改善了局部估计的精度,且比协方差交叉融合算法具有更高的估计精度。仿真例子验证了算法的有效性。
文摘在图优化框架的基础上,设计多传感器融合方案和有效的优化方法,提出一套具有鲁棒性的定位与建图(Simultaneous Localization and Mapping,SLAM)方案,能够有效应对室内外复杂环境。进一步发展激光-视觉后端建图融合方法,构建具备全新地图表达形式的点云网格化地图。同时使用低成本传感器,设计实现基于多传感器融合的高性能低成本背包扫描系统,整体完成在未知环境中的自我定位和稠密建图,且在低性能CPU设备上将长时间运动带来的每100 m的轨迹误差平均降低至厘米级。提出的基于多传感器融合方案,在精度、算力消耗上能够匹配现有主流方案,对获取各种环境条件下的系统准确定位结果和丰富的空间信息具有重要意义。