Disparity estimation for multi-scale multi-sensor fusion

The perception module of advanced driver assistance systems plays a vital role.Perception schemes often use a single sensor for data processing and environmental perception or adopt the information processing results of various sensors for the fusion of the detection layer.This paper proposes a multi-scale and multi-sensor data fusion strategy in the front end of perception and accomplishes a multi-sensor function disparity map generation scheme.A binocular stereo vision sensor composed of two cameras and a light deterction and ranging(LiDAR)sensor is used to jointly perceive the environment,and a multi-scale fusion scheme is employed to improve the accuracy of the disparity map.This solution not only has the advantages of dense perception of binocular stereo vision sensors but also considers the perception accuracy of LiDAR sensors.Experiments demonstrate that the multi-scale multi-sensor scheme proposed in this paper significantly improves disparity map estimation.

Weighted Multi-sensor Data Level Fusion Method of Vibration Signal Based on Correlation Function

As the differences of sensor＇s precision and some random factors are difficult to control,the actual measurement signals are far from the target signals that affect the reliability and precision of rotating machinery fault diagnosis.The traditional signal processing methods,such as classical inference and weighted averaging algorithm usually lack dynamic adaptability that is easy for trends to cause the faults to be misjudged or left out.To enhance the measuring veracity and precision of vibration signal in rotary machine multi-sensor vibration signal fault diagnosis,a novel data level fusion approach is presented on the basis of correlation function analysis to fast determine the weighted value of multi-sensor vibration signals.The approach doesn＇t require knowing the prior information about sensors,and the weighted value of sensors can be confirmed depending on the correlation measure of real-time data tested in the data level fusion process.It gives greater weighted value to the greater correlation measure of sensor signals,and vice versa.The approach can effectively suppress large errors and even can still fuse data in the case of sensor failures because it takes full advantage of sensor＇s own-information to determine the weighted value.Moreover,it has good performance of anti-jamming due to the correlation measures between noise and effective signals are usually small.Through the simulation of typical signal collected from multi-sensors,the comparative analysis of dynamic adaptability and fault tolerance between the proposed approach and traditional weighted averaging approach is taken.Finally,the rotor dynamics and integrated fault simulator is taken as an example to verify the feasibility and advantages of the proposed approach,it is shown that the multi-sensor data level fusion based on correlation function weighted approach is better than the traditional weighted average approach with respect to fusion precision and dynamic adaptability.Meantime,the approach is adaptable and easy to use,can be applied to other areas of vibration measurement.

Dendritic Cell Algorithm with Bayesian Optimization Hyperband for Signal Fusion

The dendritic cell algorithm(DCA)is an excellent prototype for developing Machine Learning inspired by the function of the powerful natural immune system.Too many parameters increase complexity and lead to plenty of criticism in the signal fusion procedure of DCA.The loss function of DCA is ambiguous due to its complexity.To reduce the uncertainty,several researchers simplified the algorithm program;some introduced gradient descent to optimize parameters;some utilized searching methods to find the optimal parameter combination.However,these studies are either time-consuming or need to be revised in the case of non-convex functions.To overcome the problems,this study models the parameter optimization into a black-box optimization problem without knowing the information about its loss function.This study hybridizes bayesian optimization hyperband(BOHB)with DCA to propose a novel DCA version,BHDCA,for accomplishing parameter optimization in the signal fusion process.The BHDCA utilizes the bayesian optimization(BO)of BOHB to find promising parameter configurations and applies the hyperband of BOHB to allocate the suitable budget for each potential configuration.The experimental results show that the proposed algorithm has significant advantages over the otherDCAexpansion algorithms in terms of signal fusion.

Optimal multi-sensor Kalman smoothing fusion for discrete multichannel ARMA signals

Based on the multi-sensor optimal information fusion criterion weighted by matrices in the linear minimum variance sense, using white noise estimators, an optimal fusion distributed Kalman smoother is given for discrete multi-channel ARMA （autoregressive moving average） signals. The smoothing error cross-covanance matrices between any two sensors are given for measurement noises. Furthermore, the fusion smoother gives higher precision than any local smoother does.

Progress and Achievements of Multi-sensor Fusion Navigation in China during 2019—2023

Global Navigation Satellite System(GNSS)can provide all-weather,all-time,high-precision positioning,navigation and timing services,which plays an important role in national security,national economy,public life and other aspects.However,in environments with limited satellite signals such as urban canyons,tunnels,and indoor spaces,it is difficult to provide accurate and reliable positioning services only by satellite navigation.Multi-source sensor integrated navigation can effectively overcome the limitations of single-sensor navigation through the fusion of different types of sensor data such as Inertial Measurement Unit(IMU),vision sensor,and LiDAR,and provide more accurate,stable and robust navigation information in complex environments.We summarizes the research status of multi-source sensor integrated navigation technology,and focuses on the representative innovations and applications of integrated navigation and positioning technology by major domestic scientific research institutions in China during 2019—2023.

Research on Optimal Preload Method of Controllable Rolling Bearing Based on Multisensor Fusion

Angular contact ball bearings have been widely used in machine tool spindles,and the bearing preload plays an important role in the performance of the spindle.In order to solve the problems of the traditional optimal preload prediction method limited by actual conditions and uncertainties,a roller bearing preload test method based on the improved D-S evidence theorymulti-sensor fusion method was proposed.First,a novel controllable preload system is proposed and evaluated.Subsequently,multiple sensors are employed to collect data on the bearing parameters during preload application.Finally,a multisensor fusion algorithm is used to make predictions,and a neural network is used to optimize the fitting of the preload data.The limitations of conventional preload testing methods are identified,and the integration of complementary information frommultiple sensors is used to achieve accurate predictions,offering valuable insights into the optimal preload force.Experimental results demonstrate that the multi-sensor fusion approach outperforms traditional methods in accurately measuring the optimal preload for rolling bearings.

Data Fusion in Distributed Multi-sensor System

This paper presents a data fusion method in distributed multi-sensor system including GPS and INS sensors’ data processing. First, a residual χ 2 \|test strategy with the corresponding algorithm is designed. Then a coefficient matrices calculation method of the information sharing principle is derived. Finally, the federated Kalman filter is used to combine these independent, parallel, real\|time data. A pseudolite (PL) simulation example is given.

STUDY ON THE COAL-ROCK INTERFACE RECOGNITION METHOD BASED ON MULTI-SENSOR DATA FUSION TECHNIQUE

The coal-rock interface recognition method based on multi-sensor data fusiontechnique is put forward because of the localization of single type sensor recognition method. Themeasuring theory based on multi-sensor data fusion technique is analyzed, and hereby the testplatform of recognition system is manufactured. The advantage of data fusion with the fuzzy neuralnetwork (FNN) technique has been probed. The two-level FNN is constructed and data fusion is carriedout. The experiments show that in various conditions the method can always acquire a much higherrecognition rate than normal ones.

A Novel Multi-sensor Data Fusion Algorithm and Its Application to Diagnostics

To Meet the requirements of multi-sensor data fusion in diagnosis for complex equipment systems,a novel, fuzzy similarity-based data fusion algorithm is given. Based on fuzzy set theory, it calculates the fuzzy similarity among a certain sensor's measurement values and the multiple sensor's objective prediction values to determine the importance weigh of each sensor,and realizes the multi-sensor diagnosis parameter data fusion.According to the principle, its application software is also designed. The applied example proves that the algorithm can give priority to the high-stability and high -reliability sensors and it is laconic ,feasible and efficient to real-time circumstance measure and data processing in engine diagnosis.

Multi-sensor measurement and data fusion technology for manufacturing process monitoring:a literature review

Due to the rapid development of precision manufacturing technology,much research has been conducted in the field of multisensor measurement and data fusion technology with a goal of enhancing monitoring capabilities in terms of measurement accuracy and information richness,thereby improving the efficiency and precision of manufacturing.In a multisensor system,each sensor independently measures certain parameters.Then,the system uses a relevant signalprocessing algorithm to combine all of the independent measurements into a comprehensive set of measurement results.The purpose of this paper is to describe multisensor measurement and data fusion technology and its applications in precision monitoring systems.The architecture of multisensor measurement systems is reviewed,and some implementations in manufacturing systems are presented.In addition to the multisensor measurement system,related data fusion methods and algorithms are summarized.Further perspectives on multisensor monitoring and data fusion technology are included at the end of this paper.

Diffusion-weighted magnetic resonance imaging reflects activation of signal transducer and activator of transcription 3 during focal cerebral ischemia/reperfusion

Signal transducer and activator of transcription（STAT）is a unique protein family that binds to DNA,coupled with tyrosine phosphorylation signaling pathways,acting as a transcriptional regulator to mediate a variety of biological effects.Cerebral ischemia and reperfusion can activate STATs signaling pathway,but no studies have confirmed whether STAT activation can be verified by diffusion-weighted magnetic resonance imaging（DWI）in rats after cerebral ischemia/reperfusion.Here,we established a rat model of focal cerebral ischemia injury using the modified Longa method.DWI revealed hyperintensity in parts of the left hemisphere before reperfusion and a low apparent diffusion coefficient.STAT3 protein expression showed no significant change after reperfusion,but phosphorylated STAT3 expression began to increase after 30 minutes of reperfusion and peaked at 24 hours.Pearson correlation analysis showed that STAT3 activation was correlated positively with the relative apparent diffusion coefficient and negatively with the DWI abnormal signal area.These results indicate that DWI is a reliable representation of the infarct area and reflects STAT phosphorylation in rat brain following focal cerebral ischemia/reperfusion.

Applications of state estimation in multi-sensor information fusion for the monitoring of open pit mine slope deformation

The traditional open pit mine slope deformation monitoring system can not use the monitoring information coming from many monitoring points at the same time, can only using the monitoring data coming from a key monitoring point,and that is to say it can only handle one-dimensional time series.Given this shortage in the monitoring, the multi-sensor information fusion in the state estimation techniques would be intro- duced to the slope deformation monitoring system,and by the dynamic characteristics of deformation slope,the open pit slope would be regarded as a dynamic goal,the condi- tion monitoring of which would be regarded as a dynamic target tracking.Distributed In- formation fusion technology with feedback was used to process the monitoring data and on this basis Klman filtering algorithms was introduced,and the simulation examples was used to prove its effectivenes.

An Indoor Pedestrian Localization Algorithm Based on Multi-Sensor Information Fusion

For existing indoor localization algorithm has low accuracy, high cost in deployment and maintenance, lack of robustness, and low sensor utilization, this paper proposes a particle filter algorithm based on multi-sensor fusion. The pedestrian’s localization in indoor environment is described as dynamic system state estimation problem. The algorithm combines the smart mobile terminal with indoor localization, and filters the result of localization with the particle filter. In this paper, a dynamic interval particle filter algorithm based on pedestrian dead reckoning (PDR) information and RSSI localization information have been used to improve the filtering precision and the stability. Moreover, the localization results will be uploaded to the server in time, and the location fingerprint database will be built incrementally, which can adapt the dynamic changes of the indoor environment. Experimental results show that the algorithm based on multi-sensor improves the localization accuracy and robustness compared with the location algorithm based on Wi-Fi.

HIGH RESOLUTION RANGE PROFILE FORMATION BASED ON LFM SIGNAL FUSION OF MULTIPLE RADARS

This paper presents a new method of High Resolution Range (HRR) profile formation based on Linear Frequency Modulation (LFM) signal fusion of multiple radars with multiple frequency bands. The principle of the multiple radars signal fusion improving the range resolution is analyzed. With the analysis of return signals received by two radars,it is derived that the phase difference between the echoes varies almost linearly with respect to the frequency if the distance between two radars is neg-ligible compared with the radar observation distance. To compensate the phase difference,an en-tropy-minimization principle based compensation algorithm is proposed. During the fusion process,the B-splines interpolation method is applied to resample the signals for Fourier transform imaging. The theoretical analysis and simulations results show the proposed method can effectively increase signal bandwidth and provide a high resolution range profile.

Noninvasive Blood Glucose Monitoring System Based on Distributed Multi-Sensors Information Fusion of Multi-Wavelength NIR

In this research, a near infrared multi-wavelength noninvasive blood glucose monitoring system with distributed laser multi-sensors is applied to monitor human blood glucose concentration. In order to improve the monitoring accuracy, a multi-sensors information fusion model based on Back Propagation Artificial Neural Network is proposed. The Root- Mean-Square Error of Prediction for noninvasive blood glucose measurement is 0.088mmol/L, and the correlation coefficient is 0.94. The noninvasive blood glucose monitoring system based on distributed multi-sensors information fusion of multi-wavelength NIR is proved to be of great efficient. And the new proposed idea of measurement based on distri- buted multi-sensors, shows better prediction accuracy.

DISTRIBUTED CFAR SIGNAL DETECTION BASED ON AREA FUSION

The multisensor detection area partitioning is considered. An approach is presented to the fusion in each detection area where the sensor uses different thresholds and then at system level. The expressions of the detection probability and false alarm probability are given. An application of the method is illustrated to distributed CFAR detection systems. The result shows that the system detection probability may be improved by setting different thresholds for a detector.

A Study of Multi-sensor Data Fusion System Based on MAS for Nutrient Solution Measurement

For complementarity and redundancy of multi-sensor data fusion (MSDF) system,it is an effective approach for multiple components measurement.In order to measure nutrient solution on-line,a dynamic and complex system under greenhouse environment,sensors should have intelligent properties including self-calibration and self-compensation. Meanwhile,it is necessary for multiple sensors to cooperate and interact for enhancing reliability of multi-sensor system. Because of the properties of multi-agent system (MAS),it is an appropriate tool to study MSDF system.This paper proposed an architecture of MSDF system based on MAS for the multiple components measurement of nutrient solution.The sensor agent's structure and function modules are analyzed and described in detail,the formal definitions are given,too.The relations of the sensors are modeled to implement reliability diagnosis of the multi-sensor system,so that the reliability of nutrient control system is enhanced.This study offers an effective approach for the study of MSDF.

Adaptive Multi-Feature Fusion for Vehicle Micro-Motor Noise Recognition Considering Auditory Perception

The deployment of vehicle micro-motors has witnessed an expansion owing to the progression in electrification and intelligent technologies.However,some micro-motors may exhibit design deficiencies,component wear,assembly errors,and other imperfections that may arise during the design or manufacturing phases.Conse-quently,these micro-motors might generate anomalous noises during their operation,consequently exerting a substantial adverse influence on the overall comfort of drivers and passengers.Automobile micro-motors exhibit a diverse array of structural variations,consequently leading to the manifestation of a multitude of distinctive auditory irregularities.To address the identification of diverse forms of abnormal noise,this research presents a novel approach rooted in the utilization of vibro-acoustic fusion-convolutional neural network(VAF-CNN).This method entails the deployment of distinct network branches,each serving to capture disparate features from the multi-sensor data,all the while considering the auditory perception traits inherent in the human auditory sys-tem.The intermediary layer integrates the concept of adaptive weighting of multi-sensor features,thus affording a calibration mechanism for the features hailing from multiple sensors,thereby enabling a further refinement of features within the branch network.For optimal model efficacy,a feature fusion mechanism is implemented in the concluding layer.To substantiate the efficacy of the proposed approach,this paper initially employs an augmented data methodology inspired by modified SpecAugment,applied to the dataset of abnormal noise sam-ples,encompassing scenarios both with and without in-vehicle interior noise.This serves to mitigate the issue of limited sample availability.Subsequent comparative evaluations are executed,contrasting the performance of the model founded upon single-sensor data against other feature fusion models reliant on multi-sensor data.The experimental results substantiate that the suggested methodology yields heightened recognition accuracy and greater resilience against interference.Moreover,it holds notable practical significance in the engineering domain,as it furnishes valuable support for the targeted management of noise emanating from vehicle micro-motors.

Multi-sensor Data Fusion by Improved Hough Transformation

In this paper we present an evidence-gathering approach to slove the multi-sensor data fusion problem. It uses an improved Hough transformation method rather than the usual statistical or geometric approach to extract the directions and positions of the walls in a room and update the location (orientation and position)of a mobile robot. The simulation results show that the proposed method is of practical importance since it is very simple and easy to implement.

Obstacle avoidance technology of bionic quadruped robot based on multi-sensor information fusion

In order to improve the ability of a bionic quadruped robot to percept the location of obstacles in a complex and dynamic environment, the information fusion between an ultrasonic sensor and a binocular sensor was studied under the condition that the robot moves in the Walk gait on a structured road. Firstly, the distance information of obstacles from these two sensors was separately processed by the Kalman filter algorithm, which largely reduced the noise interference. After that, we obtained two groups of estimated distance values from the robot to the obstacle and a variance of the estimation value. Additionally, a fusion of the estimation values and the variances was achieved based on the STF fusion algorithm. Finally, a simulation was performed to show that the curve of a real value was tracked well by that of the estimation value, which attributes to the effectiveness of the Kalman filter algorithm. In contrast to statistics before fusion, the fusion variance of the estimation value was sharply decreased. The precision of the position information is 4. 6 cm, which meets the application requirements of the robot.