CONDITION MONITOR OF DEEP-HOLE DRILLING BASED ON MULTI-SENSOR INFORMATION FUSION

监视基于 multi-sensorinformation 熔化的深洞的钻的方法的一个条件被讨论。当在不锈钢 0Crl7Ni4Cu4Nb 上的深洞的钻的条件正常或反常时，颤动和切的力量的信号被收集。Foureigenvectors 在时间域和信号的频率域分析上被提取。然后，四特徵向量被联合并且送到神经网络处理。熔化结果显示那多传感器信息熔化比单个传感器的信息，和那个切的力量信号优异能比颤动信号更好反映切削工具的条件。

Obstacle avoidance technology of bionic quadruped robot based on multi-sensor information fusion

In order to improve the ability of a bionic quadruped robot to percept the location of obstacles in a complex and dynamic environment,the information fusion between an ultrasonic sensor and a binocular sensor was studied under the condition that the robot moves in the Walk gait on a structured road.Firstly,the distance information of obstacles from these two sensors was separately processed by the Kalman filter algorithm,which largely reduced the noise interference.After that,we obtained two groups of estimated distance values from the robot to the obstacle and a variance of the estimation value.Additionally,a fusion of the estimation values and the variances was achieved based on the STF fusion algorithm.Finally,a simulation was performed to show that the curve of a real value was tracked well by that of the estimation value,which attributes to the effectiveness of the Kalman filter algorithm.In contrast to statistics before fusion,the fusion variance of the estimation value was sharply decreased.The precision of the position information is 4.6cm,which meets the application requirements of the robot.

An Indoor Pedestrian Localization Algorithm Based on Multi-Sensor Information Fusion

For existing indoor localization algorithm has low accuracy, high cost in deployment and maintenance, lack of robustness, and low sensor utilization, this paper proposes a particle filter algorithm based on multi-sensor fusion. The pedestrian’s localization in indoor environment is described as dynamic system state estimation problem. The algorithm combines the smart mobile terminal with indoor localization, and filters the result of localization with the particle filter. In this paper, a dynamic interval particle filter algorithm based on pedestrian dead reckoning (PDR) information and RSSI localization information have been used to improve the filtering precision and the stability. Moreover, the localization results will be uploaded to the server in time, and the location fingerprint database will be built incrementally, which can adapt the dynamic changes of the indoor environment. Experimental results show that the algorithm based on multi-sensor improves the localization accuracy and robustness compared with the location algorithm based on Wi-Fi.

Applications of state estimation in multi-sensor information fusion for the monitoring of open pit mine slope deformation

The traditional open pit mine slope deformation monitoring system can not use the monitoring information coming from many monitoring points at the same time, can only using the monitoring data coming from a key monitoring point,and that is to say it can only handle one-dimensional time series.Given this shortage in the monitoring, the multi-sensor information fusion in the state estimation techniques would be intro- duced to the slope deformation monitoring system,and by the dynamic characteristics of deformation slope,the open pit slope would be regarded as a dynamic goal,the condi- tion monitoring of which would be regarded as a dynamic target tracking.Distributed In- formation fusion technology with feedback was used to process the monitoring data and on this basis Klman filtering algorithms was introduced,and the simulation examples was used to prove its effectivenes.

Application of Multi-sensor Information Fusion in the Fault Diagnosis of Hydraulic System

Aiming at the problem of incomplete information and uncertainties in the diagnosis of complex system by using single parameter,a new method of multi-sensor information fusion fault diagnosis based on BP neural network and D-S evidence theory is proposed. In order to simplify the structure of BP neural network,two parallel BP neural networks are used to diagnose the fault data at first; and then,using the evidence theory to fuse the local diagnostic results,the accurate inference of the inaccurate information is realized,and the accurate diagnosis result is obtained. The method is applied to the fault diagnosis of the hydraulic driven servo system( HDSS) in a certain type of rocket launcher,which realizes the fault location and diagnosis of the main components of the hydraulic driven servo system,and effectively improves the reliability of the system.

AMulti-Constraint Path Optimization Scheme Based on Information Fusion in Software Defined Network

The existingmultipath routing in Software Defined Network (SDN) is relatively blind and inefficient, and there is alack of cooperation between the terminal and network sides, making it difficult to achieve dynamic adaptationof service requirements and network resources. To address these issues, we propose a multi-constraint pathoptimization scheme based on information fusion in SDN. The proposed scheme collects network topology andnetwork state information on the network side and computes disjoint paths between end hosts. It uses the FuzzyAnalytic Hierarchy Process (FAHP) to calculate the weight coefficients of multiple constrained parameters andconstructs a composite quality evaluation function for the paths to determine the priority of the disjoint paths. TheSDN controller extracts the service attributes by analyzing the packet header and selects the optimal path for flowrule forwarding. Furthermore, the service attributes are fed back to the path composite quality evaluation function,and the path priority is dynamically adjusted to achieve dynamic adaptation between service requirements andnetwork status. By continuously monitoring and analyzing the service attributes, the scheme can ensure optimalrouting decisions in response to varying network conditions and evolving service demands. The experimentalresults demonstrated that the proposed scheme can effectively improve average throughput and link utilizationwhile meeting the Quality of Service (QoS) requirements of various applications.

Research on Driver’s Fatigue Detection Based on Information Fusion

Driving fatigue is a physiological phenomenon that often occurs during driving.After the driver enters a fatigued state,the attentionis lax,the response is slow,and the ability todeal with emergencies is significantly reduced,which can easily cause traffic accidents.Therefore,studying driver fatigue detectionmethods is significant in ensuring safe driving.However,the fatigue state of actual drivers is easily interfered with by the external environment(glasses and light),which leads to many problems,such as weak reliability of fatigue driving detection.Moreover,fatigue is a slow process,first manifested in physiological signals and then reflected in human face images.To improve the accuracy and stability of fatigue detection,this paper proposed a driver fatigue detection method based on image information and physiological information,designed a fatigue driving detection device,built a simulation driving experiment platform,and collected facial as well as physiological information of drivers during driving.Finally,the effectiveness of the fatigue detection method was evaluated.Eye movement feature parameters and physiological signal features of drivers’fatigue levels were extracted.The driver fatigue detection model was trained to classify fatigue and non-fatigue states based on the extracted features.Accuracy rates of the image,electroencephalogram(EEG),and blood oxygen signals were 86%,82%,and 71%,separately.Information fusion theory was presented to facilitate the fatigue detection effect;the fatigue features were fused using multiple kernel learning and typical correlation analysis methods to increase the detection accuracy to 94%.It can be seen that the fatigue driving detectionmethod based onmulti-source feature fusion effectively detected driver fatigue state,and the accuracy rate was higher than that of a single information source.In summary,fatigue drivingmonitoring has broad development prospects and can be used in traffic accident prevention and wearable driver fatigue recognition.

Multi-sensor information fusion based control for VAV systems using thermal comfort constraints

The conventional control methods of variable air volume (VAV) air conditioning systems usually assume that the indoor air is well mixed, and consider each building zone as one node with homogeneous temperature distribution. The average temperature is subsequently used as the controlled parameter in the VAV cascade control process, which might cause uneven temperature distribution and unsatisfactory thermal comfort. This paper presents a coupled simulation of computational fluid dynamics (CFD) and building energy simulation (BES) for the VAV system in an office building located in Shanghai for the purpose of simulating the building, the VAV control system, and indoor thermal environment simultaneously. An external interface is developed to integrate the CFD and BES models based on quasi-dynamic coupling approach. Based upon the developed co-simulation platform, the novel VAV control method is further proposed by fusing information from multiple sensors. By adding two temperature sensors to constrain the thermal comfort of the occupied zone, the supply air temperature setpoint of the VAV terminal unit can be reset in real time. The novel control method is embedded into the co-simulation platform and compared with the conventional VAV control approach. The results illustrate that the temperature distribution under the proposed method is more uniform. At most times of the typical test day, the air diffusion performance indexes (ADPIs) for the proposed method are above 80%, while the ADPIs for the conventional control method are between 60% and 80%. Due to multi-sensor information fusion, the proposed VAV control approach has better ability to ensure the indoor thermal comfort.

Disparity estimation for multi-scale multi-sensor fusion

The perception module of advanced driver assistance systems plays a vital role.Perception schemes often use a single sensor for data processing and environmental perception or adopt the information processing results of various sensors for the fusion of the detection layer.This paper proposes a multi-scale and multi-sensor data fusion strategy in the front end of perception and accomplishes a multi-sensor function disparity map generation scheme.A binocular stereo vision sensor composed of two cameras and a light deterction and ranging(LiDAR)sensor is used to jointly perceive the environment,and a multi-scale fusion scheme is employed to improve the accuracy of the disparity map.This solution not only has the advantages of dense perception of binocular stereo vision sensors but also considers the perception accuracy of LiDAR sensors.Experiments demonstrate that the multi-scale multi-sensor scheme proposed in this paper significantly improves disparity map estimation.

An Analysis Model of Learners’ Online Learning Status Based on Deep Neural Network and Multi-Dimensional Information Fusion

The learning status of learners directly affects the quality of learning.Compared with offline teachers,it is difficult for online teachers to capture the learning status of students in the whole class,and it is even more difficult to continue to pay attention to studentswhile teaching.Therefore,this paper proposes an online learning state analysis model based on a convolutional neural network and multi-dimensional information fusion.Specifically,a facial expression recognition model and an eye state recognition model are constructed to detect students’emotions and fatigue,respectively.By integrating the detected data with the homework test score data after online learning,an analysis model of students’online learning status is constructed.According to the PAD model,the learning state is expressed as three dimensions of students’understanding,engagement and interest,and then analyzed from multiple perspectives.Finally,the proposed model is applied to actual teaching,and procedural analysis of 5 different types of online classroom learners is carried out,and the validity of the model is verified by comparing with the results of the manual analysis.

A novel adaptive temporal-spatial information fusion model based on Dempster-Shafer evidence theory

In the field of target recognition based on the temporal-spatial information fusion,evidence the-ory has received extensive attention.To achieve accurate and efficient target recognition by the evi-dence theory,an adaptive temporal-spatial information fusion model is proposed.Firstly,an adaptive evaluation correction mechanism is constructed by the evidence distance and Deng entropy,which realizes the credibility discrimination and adaptive correction of the spatial evidence.Secondly,the credibility decay operator is introduced to obtain the dynamic credibility of temporal evidence.Finally,the sequential combination of temporal-spatial evidences is achieved by Shafer’s discount criterion and Dempster’s combination rule.The simulation results show that the proposed method not only considers the dynamic and sequential characteristics of the temporal-spatial evidences com-bination,but also has a strong conflict information processing capability,which provides a new refer-ence for the field of temporal-spatial information fusion.

A Heterogeneous Information Fusion Method for Maritime Radar and AIS Based on D-S Evidence Theory

Maritime radar and automatic identification systems (AIS), which are essential auxiliary equipment for navigation safety in the shipping industry, have played significant roles in maritime safety supervision. However, in practical applications, the information obtained by a single device is limited, and it is necessary to integrate the information of maritime radar and AIS messages to achieve better recognition effects. In this study, the D-S evidence theory is used to fusion the two kinds of heterogeneous information: maritime radar images and AIS messages. Firstly, the radar image and AIS message are processed to get the targets of interest in the same coordinate system. Then, the coordinate position and heading of targets are chosen as the indicators for judging target similarity. Finally, a piece of D-S evidence theory based on the information fusion method is proposed to match the radar target and the AIS target of the same ship. Particularly, the effectiveness of the proposed method has been validated and evaluated through several experiments, which proves that such a method is practical in maritime safety supervision.

Sensor Fusion with Square-Root Cubature Information Filtering

This paper derives a square-root information-type filtering algorithm for nonlinear multi-sensor fusion problems using the cubature Kalman filter theory. The resulting filter is called the square-root cubature Information filter (SCIF). The SCIF propagates the square-root information matrices derived from numerically stable matrix operations and is therefore numerically robust. The SCIF is applied to a highly maneuvering target tracking problem in a distributed sensor network with feedback. The SCIF’s performance is finally compared with the regular cubature information filter and the traditional extended information filter. The results, presented herein, indicate that the SCIF is the most reliable of all three filters and yields a more accurate estimate than the extended information filter.

An Intelligent Fault Diagnosis Method of Multi-Scale Deep Feature Fusion Based on Information Entropy

For a single-structure deep learning fault diagnosis model,its disadvantages are an insufficient feature extraction and weak fault classification capability.This paper proposes a multi-scale deep feature fusion intelligent fault diagnosis method based on information entropy.First,a normal autoencoder,denoising autoencoder,sparse autoencoder,and contractive autoencoder are used in parallel to construct a multi-scale deep neural network feature extraction structure.A deep feature fusion strategy based on information entropy is proposed to obtain low-dimensional features and ensure the robustness of the model and the quality of deep features.Finally,the advantage of the deep belief network probability model is used as the fault classifier to identify the faults.The effectiveness of the proposed method was verified by a gearbox test-bed.Experimental results show that,compared with traditional and existing intelligent fault diagnosis methods,the proposed method can obtain representative information and features from the raw data with higher classification accuracy.

Altitude information fusion method and experiment for UAV

Altitude regulation is a fundamental problem in UAV(unmanned aerial vehicles) control to ensure hovering and autonomous navigation performance.However,data from altitude sensors may be unstable by interference.A digital-filter-based improved adaptive Kalman method is proposed to improve accuracy and reliability of the altitude measurement information.A unique sensor data fusion structure is designed to make different sensors switch automatically in different environment.Simulation and experimental results show that an improved Sage-Husa adaptive extended Kalman filter(SHAEKF) is adopted in altitude data fusion which means that altitude error is limited to 1.5m in high altitude and 1.2m near the ground.This method is proved feasible and effective through hovering flight test and three-dimensional track flight experiment.

Neural Machine Translation by Fusing Key Information of Text

When the Transformer proposed by Google in 2017,it was first used for machine translation tasks and achieved the state of the art at that time.Although the current neural machine translation model can generate high quality translation results,there are still mistranslations and omissions in the translation of key information of long sentences.On the other hand,the most important part in traditional translation tasks is the translation of key information.In the translation results,as long as the key information is translated accurately and completely,even if other parts of the results are translated incorrect,the final translation results’quality can still be guaranteed.In order to solve the problem of mistranslation and missed translation effectively,and improve the accuracy and completeness of long sentence translation in machine translation,this paper proposes a key information fused neural machine translation model based on Transformer.The model proposed in this paper extracts the keywords of the source language text separately as the input of the encoder.After the same encoding as the source language text,it is fused with the output of the source language text encoded by the encoder,then the key information is processed and input into the decoder.With incorporating keyword information from the source language sentence,the model’s performance in the task of translating long sentences is very reliable.In order to verify the effectiveness of the method of fusion of key information proposed in this paper,a series of experiments were carried out on the verification set.The experimental results show that the Bilingual Evaluation Understudy(BLEU)score of the model proposed in this paper on theWorkshop on Machine Translation(WMT)2017 test dataset is higher than the BLEU score of Transformer proposed by Google on the WMT2017 test dataset.The experimental results show the advantages of the model proposed in this paper.

Non-probabilistic information fusion technique for structural damage identification based on measured dynamic data with uncertainty

Based on measured natural frequencies and acceleration responses,a non-probabilistic information fusion technique is proposed for the structural damage detection by adopting the set-membership identification(SMI) and twostep model updating procedure.Due to the insufficiency and uncertainty of information obtained from measurements,the uncertain problem of damage identification is addressed with interval variables in this paper.Based on the first-order Taylor series expansion,the interval bounds of the elemental stiffness parameters in undamaged and damaged models are estimated,respectively.The possibility of damage existence(PoDE) in elements is proposed as the quantitative measure of structural damage probability,which is more reasonable in the condition of insufficient measurement data.In comparison with the identification method based on a single kind of information,the SMI method will improve the accuracy in damage identification,which reflects the information fusion concept based on the non-probabilistic set.A numerical example is performed to demonstrate the feasibility and effectiveness of the proposed technique.

Evaluation Model for Capability of Enterprise Agent Coalition Based on Information Fusion and Attribute Reduction

For the issue of evaluation of capability of enterprise agent coalition,an evaluation model based on information fusion and entropy weighting method is presented. The attribute reduction method is utilized to reduce indicators of the capability according to the theory of rough set. The new indicator system can be determined. Attribute reduction can also reduce the workload and remove the redundant information,when there are too many indicators or the indicators have strong correlation. The research complexity can be reduced and the efficiency can be improved. Entropy weighting method is used to determine the weights of the remaining indicators,and the importance of indicators is analyzed. The information fusion model based on nearest neighbor method is developed and utilized to evaluate the capability of multiple agent coalitions,compared to cloud evaluation model and D-S evidence method. Simulation results are reasonable and with obvious distinction. Thus they verify the effectiveness and feasibility of the model. The information fusion model can provide more scientific,rational decision support for choosing the best agent coalition,and provide innovative steps for the evaluation process of capability of agent coalitions.

Progress and Achievements of Multi-sensor Fusion Navigation in China during 2019—2023

Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.