With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation sa...With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation satellite system/inertial navigation system(GNSS/INS)integrated navigation systems can provide high-precision navigation information continuously.However,when this system is applied to indoor or GNSS-denied environments,such as outdoor substations with strong electromagnetic interference and complex dense spaces,it is often unable to obtain high-precision GNSS positioning data.The positioning and orientation errors will diverge and accumulate rapidly,which cannot meet the high-precision localization requirements in large-scale and long-distance navigation scenarios.This paper proposes a method of high-precision state estimation with fusion of GNSS/INS/Vision using a nonlinear optimizer factor graph optimization as the basis for multi-source optimization.Through the collected experimental data and simulation results,this system shows good performance in the indoor environment and the environment with partial GNSS signal loss.展开更多
Laser cleaning is a highly nonlinear physical process for solving poor single-modal(e.g., acoustic or vision)detection performance and low inter-information utilization. In this study, a multi-modal feature fusion net...Laser cleaning is a highly nonlinear physical process for solving poor single-modal(e.g., acoustic or vision)detection performance and low inter-information utilization. In this study, a multi-modal feature fusion network model was constructed based on a laser paint removal experiment. The alignment of heterogeneous data under different modals was solved by combining the piecewise aggregate approximation and gramian angular field. Moreover, the attention mechanism was introduced to optimize the dual-path network and dense connection network, enabling the sampling characteristics to be extracted and integrated. Consequently, the multi-modal discriminant detection of laser paint removal was realized. According to the experimental results, the verification accuracy of the constructed model on the experimental dataset was 99.17%, which is 5.77% higher than the optimal single-modal detection results of the laser paint removal. The feature extraction network was optimized by the attention mechanism, and the model accuracy was increased by 3.3%. Results verify the improved classification performance of the constructed multi-modal feature fusion model in detecting laser paint removal, the effective integration of acoustic data and visual image data, and the accurate detection of laser paint removal.展开更多
In order to solve difficult detection of far and hard objects due to the sparseness and insufficient semantic information of LiDAR point cloud,a 3D object detection network with multi-modal data adaptive fusion is pro...In order to solve difficult detection of far and hard objects due to the sparseness and insufficient semantic information of LiDAR point cloud,a 3D object detection network with multi-modal data adaptive fusion is proposed,which makes use of multi-neighborhood information of voxel and image information.Firstly,design an improved ResNet that maintains the structure information of far and hard objects in low-resolution feature maps,which is more suitable for detection task.Meanwhile,semantema of each image feature map is enhanced by semantic information from all subsequent feature maps.Secondly,extract multi-neighborhood context information with different receptive field sizes to make up for the defect of sparseness of point cloud which improves the ability of voxel features to represent the spatial structure and semantic information of objects.Finally,propose a multi-modal feature adaptive fusion strategy which uses learnable weights to express the contribution of different modal features to the detection task,and voxel attention further enhances the fused feature expression of effective target objects.The experimental results on the KITTI benchmark show that this method outperforms VoxelNet with remarkable margins,i.e.increasing the AP by 8.78%and 5.49%on medium and hard difficulty levels.Meanwhile,our method achieves greater detection performance compared with many mainstream multi-modal methods,i.e.outperforming the AP by 1%compared with that of MVX-Net on medium and hard difficulty levels.展开更多
MRCR could be regarded as a multi-stage compounding real option,based on option theory,assuming the convenience yield of coal reserves to be constant,built a one-factor model of valuating MRCR with the stochastic valu...MRCR could be regarded as a multi-stage compounding real option,based on option theory,assuming the convenience yield of coal reserves to be constant,built a one-factor model of valuating MRCR with the stochastic value of coal reserves.On the basis of our one-factor model,set up a two-factor model of evaluating MRCR assuming the convenience yield follows the mean-reverting process.When applied to valuate the MRCR of a coalmine,this model gives higher values than the one-factor model and the NPV.This is because the increase of convenience yield can improve the executive oppor- tunity of MRCR.展开更多
The traditional open pit mine slope deformation monitoring system can not use the monitoring information coming from many monitoring points at the same time, can only using the monitoring data coming from a key monito...The traditional open pit mine slope deformation monitoring system can not use the monitoring information coming from many monitoring points at the same time, can only using the monitoring data coming from a key monitoring point,and that is to say it can only handle one-dimensional time series.Given this shortage in the monitoring, the multi-sensor information fusion in the state estimation techniques would be intro- duced to the slope deformation monitoring system,and by the dynamic characteristics of deformation slope,the open pit slope would be regarded as a dynamic goal,the condi- tion monitoring of which would be regarded as a dynamic target tracking.Distributed In- formation fusion technology with feedback was used to process the monitoring data and on this basis Klman filtering algorithms was introduced,and the simulation examples was used to prove its effectivenes.展开更多
A smart Human Interface (HCI) replacing conventional mouse interface is proposed. The interface is able to control and command action with only hand. Four finger motions (left click, right dick, hold, drag) are u...A smart Human Interface (HCI) replacing conventional mouse interface is proposed. The interface is able to control and command action with only hand. Four finger motions (left click, right dick, hold, drag) are used to command the interface. Also the authors materialiae cursor movement control using image processing The measure what they use for inference is entropy of Electromyogram (EMG) signal, Gaussian modeling and likelihood estimation. In image processing for cursor control, they use color recognition to get the center point of finger tip from marker, and map the point onto cursor. Accuracy of finger movement inference is over 95% and cursor control works naturally without delay. They materlalize whole system to check its performance and utility.展开更多
Multimodality image registration and fusion are essential steps in building 3-D models from remotesensing data. We present in this paper a neural network technique for the registration and fusion of multimodali-ty rem...Multimodality image registration and fusion are essential steps in building 3-D models from remotesensing data. We present in this paper a neural network technique for the registration and fusion of multimodali-ty remote sensing data for the reconstruction of 3-D models of terrain regions. A FeedForward neural network isused to fuse the intensity data sets with the spatial data set after learning its geometry. Results on real data arepresented. Human performance evaluation is assessed on several perceptual tests in order to evaluate the fusionresults.展开更多
Carbon emissions caused by human activities are closely related to the process of urbanization,and urban land utilization,function vitality and traffic systems are three important factors that may influence the emissi...Carbon emissions caused by human activities are closely related to the process of urbanization,and urban land utilization,function vitality and traffic systems are three important factors that may influence the emission levels.For clarifying the space structure of a low-carbon eco-city,and combining the concept of"Combining Assessment with Construction"to track and contrast the construction of the low-carbon eco-city,this research selects quantifiable low-carbon eco-city spatial characteristics as indicators,and evaluates and analyzes the potential carbon emissions.Taking the Jinan Western New District as an example,diversity of construction land,travel carbon emission potential,and density and accessibility of adjacent road networks in the overall urban planning were measured.After the completion of the new urban area,the evaluation mainly reflected certain factors,such as the mixed degree of urban functions,the density of urban functions,the walking distance to bus stops and the density and number of bus stops.Dividing the levels and adding equal weights after index normalization,the carbon emission potential is evaluated at the two levels of the overall and fragmented areas.The results show that:(1)The low-carbon emission potential areas in the planning scheme basically reached the planned goals.(2)There is inconsistency between districts and indicators in the planning scheme.The diversity of construction land and the accessibility of the adjacent road network are relatively small;however,there is a large difference between the travel carbon emission potential and the road network accessibility.(3)Carbon emission potential after completion did not reach the planned expectation,and the low-carbon emission potential plots were concentrated in the Changqing Old City Area and Central Area of Dangjia Town Area.(4)The carbon emission indicators varied greatly in different areas,and there were serious imbalances in the density of public transportation lines and the mixed degree of urban functions.展开更多
基金supported in part by the Guangxi Power Grid Company’s 2023 Science and Technol-ogy Innovation Project(No.GXKJXM20230169)。
文摘With the development of unmanned driving technology,intelligent robots and drones,high-precision localization,navigation and state estimation technologies have also made great progress.Traditional global navigation satellite system/inertial navigation system(GNSS/INS)integrated navigation systems can provide high-precision navigation information continuously.However,when this system is applied to indoor or GNSS-denied environments,such as outdoor substations with strong electromagnetic interference and complex dense spaces,it is often unable to obtain high-precision GNSS positioning data.The positioning and orientation errors will diverge and accumulate rapidly,which cannot meet the high-precision localization requirements in large-scale and long-distance navigation scenarios.This paper proposes a method of high-precision state estimation with fusion of GNSS/INS/Vision using a nonlinear optimizer factor graph optimization as the basis for multi-source optimization.Through the collected experimental data and simulation results,this system shows good performance in the indoor environment and the environment with partial GNSS signal loss.
基金Project(51875491) supported by the National Natural Science Foundation of ChinaProject(2021T3069) supported by the Fujian Science and Technology Plan STS Project,China。
文摘Laser cleaning is a highly nonlinear physical process for solving poor single-modal(e.g., acoustic or vision)detection performance and low inter-information utilization. In this study, a multi-modal feature fusion network model was constructed based on a laser paint removal experiment. The alignment of heterogeneous data under different modals was solved by combining the piecewise aggregate approximation and gramian angular field. Moreover, the attention mechanism was introduced to optimize the dual-path network and dense connection network, enabling the sampling characteristics to be extracted and integrated. Consequently, the multi-modal discriminant detection of laser paint removal was realized. According to the experimental results, the verification accuracy of the constructed model on the experimental dataset was 99.17%, which is 5.77% higher than the optimal single-modal detection results of the laser paint removal. The feature extraction network was optimized by the attention mechanism, and the model accuracy was increased by 3.3%. Results verify the improved classification performance of the constructed multi-modal feature fusion model in detecting laser paint removal, the effective integration of acoustic data and visual image data, and the accurate detection of laser paint removal.
基金National Youth Natural Science Foundation of China(No.61806006)Innovation Program for Graduate of Jiangsu Province(No.KYLX160-781)Jiangsu University Superior Discipline Construction Project。
文摘In order to solve difficult detection of far and hard objects due to the sparseness and insufficient semantic information of LiDAR point cloud,a 3D object detection network with multi-modal data adaptive fusion is proposed,which makes use of multi-neighborhood information of voxel and image information.Firstly,design an improved ResNet that maintains the structure information of far and hard objects in low-resolution feature maps,which is more suitable for detection task.Meanwhile,semantema of each image feature map is enhanced by semantic information from all subsequent feature maps.Secondly,extract multi-neighborhood context information with different receptive field sizes to make up for the defect of sparseness of point cloud which improves the ability of voxel features to represent the spatial structure and semantic information of objects.Finally,propose a multi-modal feature adaptive fusion strategy which uses learnable weights to express the contribution of different modal features to the detection task,and voxel attention further enhances the fused feature expression of effective target objects.The experimental results on the KITTI benchmark show that this method outperforms VoxelNet with remarkable margins,i.e.increasing the AP by 8.78%and 5.49%on medium and hard difficulty levels.Meanwhile,our method achieves greater detection performance compared with many mainstream multi-modal methods,i.e.outperforming the AP by 1%compared with that of MVX-Net on medium and hard difficulty levels.
基金the National Natural Science Foundation of China(90410014)
文摘MRCR could be regarded as a multi-stage compounding real option,based on option theory,assuming the convenience yield of coal reserves to be constant,built a one-factor model of valuating MRCR with the stochastic value of coal reserves.On the basis of our one-factor model,set up a two-factor model of evaluating MRCR assuming the convenience yield follows the mean-reverting process.When applied to valuate the MRCR of a coalmine,this model gives higher values than the one-factor model and the NPV.This is because the increase of convenience yield can improve the executive oppor- tunity of MRCR.
基金Liaoning Province Technology Key Project(2007231003,2006220019)Liaoning Province Talent Fund Projects(2005219005,2007R24)Liaoning Province Innovative Team Projects(2007T071,2006T076)
文摘The traditional open pit mine slope deformation monitoring system can not use the monitoring information coming from many monitoring points at the same time, can only using the monitoring data coming from a key monitoring point,and that is to say it can only handle one-dimensional time series.Given this shortage in the monitoring, the multi-sensor information fusion in the state estimation techniques would be intro- duced to the slope deformation monitoring system,and by the dynamic characteristics of deformation slope,the open pit slope would be regarded as a dynamic goal,the condi- tion monitoring of which would be regarded as a dynamic target tracking.Distributed In- formation fusion technology with feedback was used to process the monitoring data and on this basis Klman filtering algorithms was introduced,and the simulation examples was used to prove its effectivenes.
基金supported by the MKE(The Ministry of Knowledge Economy),Koreathe ITRC(Information Technology Research Center)support program supervised by the NIPA(National IT Industry Promotion Agency)(NIPA-2010-C1090-1021-0010)
文摘A smart Human Interface (HCI) replacing conventional mouse interface is proposed. The interface is able to control and command action with only hand. Four finger motions (left click, right dick, hold, drag) are used to command the interface. Also the authors materialiae cursor movement control using image processing The measure what they use for inference is entropy of Electromyogram (EMG) signal, Gaussian modeling and likelihood estimation. In image processing for cursor control, they use color recognition to get the center point of finger tip from marker, and map the point onto cursor. Accuracy of finger movement inference is over 95% and cursor control works naturally without delay. They materlalize whole system to check its performance and utility.
文摘Multimodality image registration and fusion are essential steps in building 3-D models from remotesensing data. We present in this paper a neural network technique for the registration and fusion of multimodali-ty remote sensing data for the reconstruction of 3-D models of terrain regions. A FeedForward neural network isused to fuse the intensity data sets with the spatial data set after learning its geometry. Results on real data arepresented. Human performance evaluation is assessed on several perceptual tests in order to evaluate the fusionresults.
基金The National Key Research and Development Program of China(2019YFD1100803)。
文摘Carbon emissions caused by human activities are closely related to the process of urbanization,and urban land utilization,function vitality and traffic systems are three important factors that may influence the emission levels.For clarifying the space structure of a low-carbon eco-city,and combining the concept of"Combining Assessment with Construction"to track and contrast the construction of the low-carbon eco-city,this research selects quantifiable low-carbon eco-city spatial characteristics as indicators,and evaluates and analyzes the potential carbon emissions.Taking the Jinan Western New District as an example,diversity of construction land,travel carbon emission potential,and density and accessibility of adjacent road networks in the overall urban planning were measured.After the completion of the new urban area,the evaluation mainly reflected certain factors,such as the mixed degree of urban functions,the density of urban functions,the walking distance to bus stops and the density and number of bus stops.Dividing the levels and adding equal weights after index normalization,the carbon emission potential is evaluated at the two levels of the overall and fragmented areas.The results show that:(1)The low-carbon emission potential areas in the planning scheme basically reached the planned goals.(2)There is inconsistency between districts and indicators in the planning scheme.The diversity of construction land and the accessibility of the adjacent road network are relatively small;however,there is a large difference between the travel carbon emission potential and the road network accessibility.(3)Carbon emission potential after completion did not reach the planned expectation,and the low-carbon emission potential plots were concentrated in the Changqing Old City Area and Central Area of Dangjia Town Area.(4)The carbon emission indicators varied greatly in different areas,and there were serious imbalances in the density of public transportation lines and the mixed degree of urban functions.