A multi-source data fusion modeling method for debris flow prevention engineering

The Digital Elevation Model(DEM)data of debris flow prevention engineering are the boundary of a debris flow prevention simulation,which provides accurate and reliable DEM data and is a key consideration in debris flow prevention simulations.Thus,this paper proposes a multi-source data fusion method.First,we constructed 3D models of debris flow prevention using virtual reality technology according to the relevant specifications.The 3D spatial data generated by 3D modeling were converted into DEM data for debris flow prevention engineering.Then,the accuracy and applicability of the DEM data were verified by the error analysis testing and fusion testing of the debris flow prevention simulation.Finally,we propose the Levels of Detail algorithm based on the quadtree structure to realize the visualization of a large-scale disaster prevention scene.The test results reveal that the data fusion method controlled the error rate of the DEM data of the debris flow prevention engineering within an allowable range and generated 3D volume data(obj format)to compensate for the deficiency of the DEM data whereby the 3D internal entity space is not expressed.Additionally,the levels of detailed method can dispatch the data of a large-scale debris flow hazard scene in real time to ensure a realistic 3D visualization.In summary,the proposed methods can be applied to the planning of debris flow prevention engineering and to the simulation of the debris flow prevention process.

Weighted Multi-sensor Data Level Fusion Method of Vibration Signal Based on Correlation Function

As the differences of sensor＇s precision and some random factors are difficult to control,the actual measurement signals are far from the target signals that affect the reliability and precision of rotating machinery fault diagnosis.The traditional signal processing methods,such as classical inference and weighted averaging algorithm usually lack dynamic adaptability that is easy for trends to cause the faults to be misjudged or left out.To enhance the measuring veracity and precision of vibration signal in rotary machine multi-sensor vibration signal fault diagnosis,a novel data level fusion approach is presented on the basis of correlation function analysis to fast determine the weighted value of multi-sensor vibration signals.The approach doesn＇t require knowing the prior information about sensors,and the weighted value of sensors can be confirmed depending on the correlation measure of real-time data tested in the data level fusion process.It gives greater weighted value to the greater correlation measure of sensor signals,and vice versa.The approach can effectively suppress large errors and even can still fuse data in the case of sensor failures because it takes full advantage of sensor＇s own-information to determine the weighted value.Moreover,it has good performance of anti-jamming due to the correlation measures between noise and effective signals are usually small.Through the simulation of typical signal collected from multi-sensors,the comparative analysis of dynamic adaptability and fault tolerance between the proposed approach and traditional weighted averaging approach is taken.Finally,the rotor dynamics and integrated fault simulator is taken as an example to verify the feasibility and advantages of the proposed approach,it is shown that the multi-sensor data level fusion based on correlation function weighted approach is better than the traditional weighted average approach with respect to fusion precision and dynamic adaptability.Meantime,the approach is adaptable and easy to use,can be applied to other areas of vibration measurement.

STUDY ON THE COAL-ROCK INTERFACE RECOGNITION METHOD BASED ON MULTI-SENSOR DATA FUSION TECHNIQUE

The coal-rock interface recognition method based on multi-sensor data fusiontechnique is put forward because of the localization of single type sensor recognition method. Themeasuring theory based on multi-sensor data fusion technique is analyzed, and hereby the testplatform of recognition system is manufactured. The advantage of data fusion with the fuzzy neuralnetwork (FNN) technique has been probed. The two-level FNN is constructed and data fusion is carriedout. The experiments show that in various conditions the method can always acquire a much higherrecognition rate than normal ones.

Fusion of color and hallucinated depth features for enhanced multimodal deep learning-based damage segmentation

Recent advances in computer vision and deep learning have shown that the fusion of depth information can significantly enhance the performance of RGB-based damage detection and segmentation models.However,alongside the advantages,depth-sensing also presents many practical challenges.For instance,the depth sensors impose an additional payload burden on the robotic inspection platforms limiting the operation time and increasing the inspection cost.Additionally,some lidar-based depth sensors have poor outdoor performance due to sunlight contamination during the daytime.In this context,this study investigates the feasibility of abolishing depth-sensing at test time without compromising the segmentation performance.An autonomous damage segmentation framework is developed,based on recent advancements in vision-based multi-modal sensing such as modality hallucination(MH)and monocular depth estimation(MDE),which require depth data only during the model training.At the time of deployment,depth data becomes expendable as it can be simulated from the corresponding RGB frames.This makes it possible to reap the benefits of depth fusion without any depth perception per se.This study explored two different depth encoding techniques and three different fusion strategies in addition to a baseline RGB-based model.The proposed approach is validated on computer-generated RGB-D data of reinforced concrete buildings subjected to seismic damage.It was observed that the surrogate techniques can increase the segmentation IoU by up to 20.1%with a negligible increase in the computation cost.Overall,this study is believed to make a positive contribution to enhancing the resilience of critical civil infrastructure.

Application of data fusion on multi-function earth drill

taking the bucket of multi function earth drill as an example, combining with the conception of multi sensor integration and data fusion, adopting the terrene column chart and digging torque formula as control dependence, the detecting method of the earth drill’s working state is introduced. Multi sensor data fusion is done with the aid of BP neural network in Matlab. The data to be interfused are pre processed and the program of simulation and “point checking” is given.

A Study of Multi-sensor Data Fusion System Based on MAS for Nutrient Solution Measurement

For complementarity and redundancy of multi-sensor data fusion (MSDF) system,it is an effective approach for multiple components measurement.In order to measure nutrient solution on-line,a dynamic and complex system under greenhouse environment,sensors should have intelligent properties including self-calibration and self-compensation. Meanwhile,it is necessary for multiple sensors to cooperate and interact for enhancing reliability of multi-sensor system. Because of the properties of multi-agent system (MAS),it is an appropriate tool to study MSDF system.This paper proposed an architecture of MSDF system based on MAS for the multiple components measurement of nutrient solution.The sensor agent's structure and function modules are analyzed and described in detail,the formal definitions are given,too.The relations of the sensors are modeled to implement reliability diagnosis of the multi-sensor system,so that the reliability of nutrient control system is enhanced.This study offers an effective approach for the study of MSDF.

Image Processing on Geological Data in Vector Format and Multi-Source Spatial Data Fusion

The geological data are constructed in vector format in geographical information system (GIS) while other data such as remote sensing images, geographical data and geochemical data are saved in raster ones. This paper converts the vector data into 8 bit images according to their importance to mineralization each by programming. We can communicate the geological meaning with the raster images by this method. The paper also fuses geographical data and geochemical data with the programmed strata data. The result shows that image fusion can express different intensities effectively and visualize the structure characters in 2 dimensions. Furthermore, it also can produce optimized information from multi-source data and express them more directly.

Method of Multi-Mode Sensor Data Fusion with an Adaptive Deep Coupling Convolutional Auto-Encoder

To address the difficulties in fusing multi-mode sensor data for complex industrial machinery, an adaptive deep coupling convolutional auto-encoder (ADCCAE) fusion method was proposed. First, the multi-mode features extracted synchronously by the CCAE were stacked and fed to the multi-channel convolution layers for fusion. Then, the fused data was passed to all connection layers for compression and fed to the Softmax module for classification. Finally, the coupling loss function coefficients and the network parameters were optimized through an adaptive approach using the gray wolf optimization (GWO) algorithm. Experimental comparisons showed that the proposed ADCCAE fusion model was superior to existing models for multi-mode data fusion.

Synergy Decision for Radar and IRST Data Fusion

A new synergy decision method for radar and infrared search and track (IRST) data fusion is proposed, to solve such problems as how to decrease opportunities for radar suffering from being locked on by adverse electronic support measures (ESM), how to retrieve range information of the target during radar off, and how to detect the maneuver of the target. Firstly, polynomials used to predict target motion states are constructed. Secondly, a set of discriminants for detecting target maneuver are established by comparing the predicted values with the observations from IRST. Thirdly, a set of decisions are presented. Lastly, simulation is performed on the given scenario to test the validity of the method.

Asynchronous Data Fusion of Two Different Sensors

An algorithm is presented for fusion of tracks created by radar and IR sensor which have different dimensional measurement data. It’s assumed that these sensors are asynchronous and the measurement data are transmitted to a central station at different rates. By means of the technique of time matching, two sets of asynchronous data are fused and then the filter is updated according to the fused information. The results show that the accuracy of the filter effect has been improved.

Weight Data Fusion Based on Mutual Support Applied in Large Diameter Measurement

The on-line diameter measurement of larger axis workpieces is hard to achieve high precision detection, because of the bad environment of locale, the problem to amend the measuring error by non-uniform temperature field, and the difficulty to collimate and locate by usual method. By improving the measurement accuracy of larger axis accessories, it is useful to raise axis and hole＇s industry produce level. Because of the influence of complex environment in locale and some influential factors which are hard excluded from the large diameter measurement with multi-rolling-wheels method, the measurement results may not support or even contradict each other. To the situation, this paper puts forward a mutual support deviation distinguish data fusion method, including mutual support deviation detection and weight data fusion. The mutual support deviation detection part can effectively remove or weaken the unexpected impact on the measurement results and the weight data fusion part can get more accurate estimate result to the detected data. So the method can further improve the reliability of measurement results and increase the accuracy of the measurement system. By using the weight data fusion based on the mutual support （DFMS） to the simulation and experiment data, both simulation results and experiment results show that the method can effectively distinguish the data influenced by unexpected impact and improve the stability and reliability of measurement results. The new provided mutual support deviation distinguish method can be used to single sensor measurement and multi-sensor measurement, and can be used as a reference in the data distinguish of other area. The DFMS is helpful to realize the diameter measurement expanded uncertainty in 5 ×10^-6D or even higher when the measured axis workpiece＇s diameter is 1-5 m （ 1 m ≤ D ≤5 m ）.

Location Data Fusion Based on Group Consensus

A new method of multi sensor location data fusion is proposed.The method is based on group consensus approach, which constructs group utility function (or its density) based on uncertainty of each sensor, and the location estimation is obtained based on the group utility function (or its density). The simulation results show that the method is better than those of mean and median estimation, and outlier and sensor failure can not affect the location estimation.

Algorithm for Multi-laser-target Tracking Based on Clustering Fusion

Multi-laser-target tracking is an important subject in the field of signal processing of laser warners. A clustering method is applied to the measurement of laser warner, and the space-time fusion for measurements in the same cluster is accomplished. Real-time tracking of multi-laser-target and real-time picking of multi-laser-signal are introduced using data fusion of the measurements. A prototype device of the algorithm is built up. The results of experiments show that the algorithm is very effective.

Modeling of the Multi-Target Locating and Tracking in the Field Artillery System

A method for the multi target locating and tracking with the multi sensor in a field artillery system is studied. A general modeling structure of the system is established. Based on concepts of cluster and closed ball, an algorithm is put forward for multi sensor multi target data fusion and an optimal solution for state estimation is presented. The simulation results prove the algorithm works well for the multi stationary target locating and the multi moving target tracking under the condition of the sparse target environment. Therefore, this method can be directly applied to the field artillery C 3I system.

基于视觉与文本语义增强的多模态命名实体识别方法

为了解决视觉特征和文本特征融合后存在部分语义缺失从而导致视觉信息对文本信息的补充有较大偏差的问题,提出了一种基于视觉与文本语义增强的多模态命名实体识别方法。融合BERT文本特征提取和CLIP(contrastive language–image pre-training)视觉特征提取方法,设计了基于协同交叉注意力机制的特征交互单元,以增强视觉信息和文本信息之间的语义关系。CLIP通过对比学习框架进行预训练,优化模型以正确匹配视觉和对应的文本描述,最大化正样本(匹配的视觉-文本对)的相似性,同时最小化负样本(不匹配的视觉-文本对)的相似性。采用通用领域数据集TWITTER-2015和TWITTER-2017作为实验数据集。实验结果表明,本模型相比传统方法在多模态命名实体识别任务中的准确率、召回率、F1值均有显著提升。

面向多源异构的电力工程数据融合处理技术研究

随着电力工程中自动化、信息化设备的日益增多,对电力工程数据的分析与处理能力有了更高的要求。针对这一问题,文中开展了面向多源异构的电力工程数据融合处理技术研究。通过预先设计好的数据框架进行关联操作,实现数据监测与处理分析。为了提高整体数据与局部数据之间的协调性,对融合数据进行边缘自适应增强处理,结合电力工程定值数据处理方法将样本数据分解为多个子数据集,利用神经网络模型分类融合,采用Reduce机制对融合后的数据进行合并处理,输出结果,从而提高数据融合的效率。以某地区电力工程数据集为样本进行的分析结果表明,所提方法在处理数据时具有更高的效率,产生的绝对误差仅为1.675%,且更适用于大容量数据的场景。

自适应特征融合的多模态实体对齐研究

多模态数据间交互式任务的兴起对于综合利用不同模态的知识提出了更高的要求,因此融合不同模态知识的多模态知识图谱应运而生.然而,现有多模态知识图谱存在图谱知识不完整的问题,严重阻碍对信息的有效利用.缓解此问题的有效方法是通过实体对齐进行知识图谱补全.当前多模态实体对齐方法以固定权重融合多种模态信息,在融合过程中忽略不同模态信息贡献的差异性.为解决上述问题,设计一套自适应特征融合机制,根据不同模态数据质量动态融合实体结构信息和视觉信息.此外,考虑到视觉信息质量不高、知识图谱之间的结构差异也影响实体对齐的效果,本文分别设计提升视觉信息有效利用率的视觉特征处理模块以及缓和结构差异性的三元组筛选模块.在多模态实体对齐任务上的实验结果表明,提出的多模态实体对齐方法的性能优于当前最好的方法.

大数据环境下多模态融合的大学生异常行为预警

针对“校园大数据”累积的海量数据呈现出离散性、稀疏性等问题,如何从基数大、活动广、个性强的校园学生群体中检测出潜在的、有异常行为的学生,已成为学生异常行为分析亟需解决的问题.本文提出了一种大数据环境下基于多模态融合的大学生异常行为预警方法(early warning method for abnormal behavior of college students based on multi-modal fusion in big data environment,EWMAB).首先,针对学生行为画像的表征不够丰富,行为标签存在时效性、动态性等问题,建立一种基于多模态特征深度学习的跨模态学生行为画像模型;其次,针对学生异常行为预测、预警的时效性和后置性问题,在学生行为画像和学生行为分类预测基础上,提出了一种基于多模态融合的学生异常行为预警方法,通过长短期记忆神经网络(long and short term memory networks,LSTM),结合学生行为多指标数据和文本信息来解决学生异常行为预警问题;最后,本文通过应用实例验证模型以学生学习成绩异常预警为例,与其他预警算法相比,EWMAB方法可以提高预警的准确性,实现学生异常行为预警的时效性和前置性,从而使学生教育工作更具有针对性、个性化和预测性.

三维成矿预测关键问题

三维成矿预测是当前深部找矿预测和勘查的重要方法和手段,其方法体系和实践应用均已取得大量成果,但同时存在若干关键科学技术问题,导致其进一步发展受到制约。本文从多尺度三维成矿预测方法体系不完善、不确定性分析与优化研究薄弱、三维成矿预测要素挖掘存在瓶颈、缺少针对三维成矿预测的三维深度学习模型和方法等关键问题出发,对目前三维成矿预测领域相关方面的研究进展进行综合分析,并提出针对上述关键问题可能的解决方案和研究方向。预期未来三维成矿预测领域的研究工作将创新发展出多种方法,实现对三维预测信息的深度挖掘;构建形成适用的三维深度学习模型和训练方法,有效增强三维成矿预测结果的预测能力;通过系统性地开展三维成矿预测不确定性研究,进一步优化预测过程和结果,有效提高三维成矿预测方法的可靠性和准确性;形成面向多尺度三维成矿预测的方法体系,更有效地指导矿集区-矿田-勘查区块(矿床)等不同级别的深部矿产资源找矿勘查工作。相关关键问题的解决将进一步深化和完善三维成矿预测理论和方法体系,促进三维成矿预测理论方法的实践应用,显著提升深部找矿预测和勘查工作的效率与水平,助力深部找矿突破。

RESEARCH ON THE ACCURACY OF TRACKING LONG RANGE AIRPLANE BY MULTI-SENSOR

This paper mainly studies the influence of the relative position of target-sensors on the tracking accuracy of long range airplane. From theory analysis and simulation results, it is found that the tracking accuracy of long-range airplane can be improved greatly if the extant sensors are rationally placed and multi-sensor data fusion technique is used in the case of