Simultaneous localization and mapping(SLAM)is one of the most attractive research hotspots in the field of robotics,and it is also a prerequisite for the autonomous navigation of robots.It can significantly improve th...Simultaneous localization and mapping(SLAM)is one of the most attractive research hotspots in the field of robotics,and it is also a prerequisite for the autonomous navigation of robots.It can significantly improve the autonomous navigation ability of mobile robots and their adaptability to different application environments and contribute to the realization of real-time obstacle avoidance and dynamic path planning.Moreover,the application of SLAM technology has expanded from industrial production,intelligent transportation,special operations and other fields to agricultural environments,such as autonomous navigation,independent weeding,three-dimen-sional(3D)mapping,and independent harvesting.This paper mainly introduces the principle,sys-tem framework,latest development and application of SLAM technology,especially in agricultural environments.Firstly,the system framework and theory of the SLAM algorithm are introduced,and the SLAM algorithm is described in detail according to different sensor types.Then,the devel-opment and application of SLAM in the agricultural environment are summarized from two aspects:environment map construction,and localization and navigation of agricultural robots.Finally,the challenges and future research directions of SLAM in the agricultural environment are discussed.展开更多
Simultaneous localization and mapping (SLAM) is a key technology for mobile robots operating under unknown environment. While FastSLAM algorithm is a popular solution to the SLAM problem, it suffers from two major d...Simultaneous localization and mapping (SLAM) is a key technology for mobile robots operating under unknown environment. While FastSLAM algorithm is a popular solution to the SLAM problem, it suffers from two major drawbacks: one is particle set degeneracy due to lack of observation information in proposal distribution design of the particle filter; the other is errors accumulation caused by linearization of the nonlinear robot motion model and the nonlinear environment observation model. For the purpose of overcoming the above problems, a new iterated sigma point FastSLAM (ISP-FastSLAM) algorithm is proposed. The main contribution of the algorithm lies in the utilization of iterated sigma point Kalman filter (ISPKF), which minimizes statistical linearization error through Gaussian-Newton iteration, to design an optimal proposal distribution of the particle filter and to estimate the environment landmarks. On the basis of Rao-Blackwellized particle filter, the proposed ISP-FastSLAM algorithm is comprised by two main parts: in the first part, an iterated sigma point particle filter (ISPPF) to localize the robot is proposed, in which the proposal distribution is accurately estimated by the ISPKF; in the second part, a set of ISPKFs is used to estimate the environment landmarks. The simulation test of the proposed ISP-FastSLAM algorithm compared with FastSLAM2.0 algorithm and Unscented FastSLAM algorithm is carried out, and the performances of the three algorithms are compared. The simulation and comparing results show that the proposed ISP-FastSLAM outperforms other two algorithms both in accuracy and in robustness. The proposed algorithm provides reference for the optimization research of FastSLAM algorithm.展开更多
At present,simultaneous localization and mapping(SLAM) for an autonomous underwater vehicle(AUV)is a research hotspot.Aiming at the problem of non-linear model and non-Gaussian noise in AUV motion,an improved method o...At present,simultaneous localization and mapping(SLAM) for an autonomous underwater vehicle(AUV)is a research hotspot.Aiming at the problem of non-linear model and non-Gaussian noise in AUV motion,an improved method of variance reduction fast simultaneous localization and mapping(FastSLAM) with simulated annealing is proposed to solve the problems of particle degradation,particle depletion and particle loss in traditional FastSLAM,which lead to the reduction of AUV location estimation accuracy.The adaptive exponential fading factor is generated by the anneal function of simulated annealing algorithm to improve the effective particle number and replace resampling.By increasing the weight of small particles and decreasing the weight of large particles,the variance of particle weight can be reduced,the number of effective particles can be increased,and the accuracy of AUV location and feature location estimation can be improved to some extent by retaining more information carried by particles.The experimental results based on trial data show that the proposed simulated annealing variance reduction FastSLAM method avoids particle degradation,maintains the diversity of particles,weakened the degeneracy and improves the accuracy and stability of AUV navigation and localization system.展开更多
Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance o...Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.展开更多
A novel mobile robot simultaneous localization and mapping (SLAM) method is implemented by using the Rao- Blackwellized particle filter (RBPF) for monocular vision-based autonomous robot in unknown indoor environment....A novel mobile robot simultaneous localization and mapping (SLAM) method is implemented by using the Rao- Blackwellized particle filter (RBPF) for monocular vision-based autonomous robot in unknown indoor environment. The particle filter combined with unscented Kalman filter (UKF) for extending the path posterior by sampling new poses integrating the current observation. Landmark position estimation and update is implemented through UKF. Furthermore, the number of resampling steps is determined adaptively, which greatly reduces the particle depletion problem. Monocular CCD camera mounted on the robot tracks the 3D natural point landmarks structured with matching image feature pairs extracted through Scale Invariant Feature Transform (SIFT). The matching for multi-dimension SIFT features which are highly distinctive due to a special descriptor is implemented with a KD-Tree. Experiments on the robot Pioneer3 showed that our method is very precise and stable.展开更多
A hierarchical mobile robot simultaneous localization and mapping (SLAM) method that allows us to obtain accurate maps was presented. The local map level is composed of a set of local metric feature maps that are guar...A hierarchical mobile robot simultaneous localization and mapping (SLAM) method that allows us to obtain accurate maps was presented. The local map level is composed of a set of local metric feature maps that are guaranteed to be statistically independent. The global level is a topological graph whose arcs are labeled with the relative location between local maps. An estimation of these relative locations is maintained with local map alignment algorithm, and more accurate estimation is calculated through a global minimization procedure using the loop closure constraint. The local map is built with Rao-Blackwellised particle filter (RBPF), where the particle filter is used to extending the path posterior by sampling new poses. The landmark position estimation and update is implemented through extended Kalman filter (EKF). Monocular vision mounted on the robot tracks the 3D natural point landmarks, which are structured with matching scale invariant feature transform (SIFT) feature pairs. The matching for multi-dimension SIFT features is implemented with a KD-tree in the time cost of O(lbN). Experiment results on Pioneer mobile robot in a real indoor environment show the superior performance of our proposed method.展开更多
A new method for speeding up the state augment operations involved in the compressed extended Kalman filter-based simultaneous localization and mapping (CEKF-SLAM) algorithm was proposed. State augment usually requi...A new method for speeding up the state augment operations involved in the compressed extended Kalman filter-based simultaneous localization and mapping (CEKF-SLAM) algorithm was proposed. State augment usually requires a fully-updated state eovariance so as to append the information of newly observed landmarks, thus computational volume increases quadratically with the number of landmarks in the whole map. It was proved that state augment can also be achieved by augmenting just one auxiliary coefficient ma- trix. This method can yield identical estimation results as those using EKF-SLAM algorithm, and computa- tional amount grows only linearly with number of increased landmarks in the local map. The efficiency of this quick state augment for CEKF-SLAM algorithm has been validated by a sophisticated simulation project.展开更多
In order to meet the application requirements of autonomous vehicles, this paper proposes a simultaneous localization and mapping (SLAM) algorithm, which uses a VoxelGrid filter to down sample the point cloud data, ...In order to meet the application requirements of autonomous vehicles, this paper proposes a simultaneous localization and mapping (SLAM) algorithm, which uses a VoxelGrid filter to down sample the point cloud data, with the combination of iterative closest points (ICP) algorithm and Gaussian model for particles updating, the matching between the local map and the global map to quantify particles' importance weight. The crude estimation by using ICP algorithm can find the high probability area of autonomous vehicles' poses, which would decrease particle numbers, increase algorithm speed and restrain particles' impoverishment. The calculation of particles' importance weight based on matching of attribute between grid maps is simple and practicable. Experiments carried out with the autonomous vehicle platform validate the effectiveness of our approaches.展开更多
In this paper a label-based simultaneous localization and mapping( SLAM) system is proposed to provide localization to indoor autonomous robots. In the system quick response( QR) codes encoded with serial numbers ...In this paper a label-based simultaneous localization and mapping( SLAM) system is proposed to provide localization to indoor autonomous robots. In the system quick response( QR) codes encoded with serial numbers are utilized as labels. These labels are captured by two webcams,then the distances and angles between the labels and webcams are computed. Motion estimated from the two rear wheel encoders is adjusted by observing QR codes. Our system uses the extended Kalman filter( EKF) for the back-end state estimation. The number of deployed labels controls the state estimation dimension. The label-based EKF-SLAM system eliminates complicated processes,such as data association and loop closure detection in traditional feature-based visual SLAM systems. Our experiments include software-simulation and robot-platform test in a real environment. Results demonstrate that the system has the capability of correcting accumulated errors of dead reckoning and therefore has the advantage of superior precision.展开更多
A method of underwater simultaneous localization and mapping (SLAM) based on forward-looking sonar was proposed in this paper. Positions of objects were obtained by the forward-looking sonar, and an improved associa...A method of underwater simultaneous localization and mapping (SLAM) based on forward-looking sonar was proposed in this paper. Positions of objects were obtained by the forward-looking sonar, and an improved association method based on an ant colony algorithm was introduced to estimate the positions. In order to improve the precision of the positions, the extended Kalman filter (EKF) was adopted. The presented algorithm was tested in a tank, and the maximum estimation error of SLAM gained was 0.25 m. The tests verify that this method can maintain better association efficiency and reduce navigatioJ~ error.展开更多
视觉同步定位与建图技术常用于室内智能机器人的导航,但是其位姿是以静态环境为前提进行估计的。为了提升视觉即时定位与建图(Simultaneous Localization And Mapping,SLAM)在动态场景中的定位与建图的鲁棒性和实时性,在原ORB-SLAM2基...视觉同步定位与建图技术常用于室内智能机器人的导航,但是其位姿是以静态环境为前提进行估计的。为了提升视觉即时定位与建图(Simultaneous Localization And Mapping,SLAM)在动态场景中的定位与建图的鲁棒性和实时性,在原ORB-SLAM2基础上新增动态区域检测线程和语义点云线程。动态区域检测线程由实例分割网络和光流估计网络组成,实例分割赋予动态场景语义信息的同时生成先验性动态物体的掩膜。为了解决实例分割网络的欠分割问题,采用轻量级光流估计网络辅助检测动态区域,生成准确性更高的动态区域掩膜。将生成的动态区域掩膜传入到跟踪线程中进行实时剔除动态区域特征点,然后使用地图中剩余的静态特征点进行相机的位姿估计并建立语义点云地图。在公开TUM数据集上的实验结果表明,改进后的SLAM系统在保证实时性的前提下,提升了其在动态场景中的定位与建图的鲁棒性。展开更多
In recent years, reconstructing a sparse map from a simultaneous localization and mapping(SLAM) system on a conventional CPU has undergone remarkable progress. However,obtaining a dense map from the system often requi...In recent years, reconstructing a sparse map from a simultaneous localization and mapping(SLAM) system on a conventional CPU has undergone remarkable progress. However,obtaining a dense map from the system often requires a highperformance GPU to accelerate computation. This paper proposes a dense mapping approach which can remove outliers and obtain a clean 3D model using a CPU in real-time. The dense mapping approach processes keyframes and establishes data association by using multi-threading technology. The outliers are removed by changing detections of associated vertices between keyframes. The implicit surface data of inliers is represented by a truncated signed distance function and fused with an adaptive weight. A global hash table and a local hash table are used to store and retrieve surface data for data-reuse. Experiment results show that the proposed approach can precisely remove the outliers in scene and obtain a dense 3D map with a better visual effect in real-time.展开更多
基金supported by the National Key Research and Development Program(No.2022YFD2001704).
文摘Simultaneous localization and mapping(SLAM)is one of the most attractive research hotspots in the field of robotics,and it is also a prerequisite for the autonomous navigation of robots.It can significantly improve the autonomous navigation ability of mobile robots and their adaptability to different application environments and contribute to the realization of real-time obstacle avoidance and dynamic path planning.Moreover,the application of SLAM technology has expanded from industrial production,intelligent transportation,special operations and other fields to agricultural environments,such as autonomous navigation,independent weeding,three-dimen-sional(3D)mapping,and independent harvesting.This paper mainly introduces the principle,sys-tem framework,latest development and application of SLAM technology,especially in agricultural environments.Firstly,the system framework and theory of the SLAM algorithm are introduced,and the SLAM algorithm is described in detail according to different sensor types.Then,the devel-opment and application of SLAM in the agricultural environment are summarized from two aspects:environment map construction,and localization and navigation of agricultural robots.Finally,the challenges and future research directions of SLAM in the agricultural environment are discussed.
基金supported by Open Foundation of State Key Laboratory of Robotics and System, China (Grant No. SKLRS-2009-ZD-04)National Natural Science Foundation of China (Grant No. 60909055, Grant No.61005070)Fundamental Research Funds for the Central Universities of China (Grant No. 2009JBZ001-2)
文摘Simultaneous localization and mapping (SLAM) is a key technology for mobile robots operating under unknown environment. While FastSLAM algorithm is a popular solution to the SLAM problem, it suffers from two major drawbacks: one is particle set degeneracy due to lack of observation information in proposal distribution design of the particle filter; the other is errors accumulation caused by linearization of the nonlinear robot motion model and the nonlinear environment observation model. For the purpose of overcoming the above problems, a new iterated sigma point FastSLAM (ISP-FastSLAM) algorithm is proposed. The main contribution of the algorithm lies in the utilization of iterated sigma point Kalman filter (ISPKF), which minimizes statistical linearization error through Gaussian-Newton iteration, to design an optimal proposal distribution of the particle filter and to estimate the environment landmarks. On the basis of Rao-Blackwellized particle filter, the proposed ISP-FastSLAM algorithm is comprised by two main parts: in the first part, an iterated sigma point particle filter (ISPPF) to localize the robot is proposed, in which the proposal distribution is accurately estimated by the ISPKF; in the second part, a set of ISPKFs is used to estimate the environment landmarks. The simulation test of the proposed ISP-FastSLAM algorithm compared with FastSLAM2.0 algorithm and Unscented FastSLAM algorithm is carried out, and the performances of the three algorithms are compared. The simulation and comparing results show that the proposed ISP-FastSLAM outperforms other two algorithms both in accuracy and in robustness. The proposed algorithm provides reference for the optimization research of FastSLAM algorithm.
基金supported by the National Science Fund of China under Grants 61603034China Postdoctoral Science Foundation under Grant 2019M653870XB+1 种基金Beijing Municipal Natural Science Foundation (3182027)Fundamental Research Funds for the Central Universities,China,FRF-GF-17-B44,and XJS191315
文摘At present,simultaneous localization and mapping(SLAM) for an autonomous underwater vehicle(AUV)is a research hotspot.Aiming at the problem of non-linear model and non-Gaussian noise in AUV motion,an improved method of variance reduction fast simultaneous localization and mapping(FastSLAM) with simulated annealing is proposed to solve the problems of particle degradation,particle depletion and particle loss in traditional FastSLAM,which lead to the reduction of AUV location estimation accuracy.The adaptive exponential fading factor is generated by the anneal function of simulated annealing algorithm to improve the effective particle number and replace resampling.By increasing the weight of small particles and decreasing the weight of large particles,the variance of particle weight can be reduced,the number of effective particles can be increased,and the accuracy of AUV location and feature location estimation can be improved to some extent by retaining more information carried by particles.The experimental results based on trial data show that the proposed simulated annealing variance reduction FastSLAM method avoids particle degradation,maintains the diversity of particles,weakened the degeneracy and improves the accuracy and stability of AUV navigation and localization system.
文摘Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.
基金Project (No. 2002AA735041) supported by the Hi-Tech Researchand Development Program (863) of China
文摘A novel mobile robot simultaneous localization and mapping (SLAM) method is implemented by using the Rao- Blackwellized particle filter (RBPF) for monocular vision-based autonomous robot in unknown indoor environment. The particle filter combined with unscented Kalman filter (UKF) for extending the path posterior by sampling new poses integrating the current observation. Landmark position estimation and update is implemented through UKF. Furthermore, the number of resampling steps is determined adaptively, which greatly reduces the particle depletion problem. Monocular CCD camera mounted on the robot tracks the 3D natural point landmarks structured with matching image feature pairs extracted through Scale Invariant Feature Transform (SIFT). The matching for multi-dimension SIFT features which are highly distinctive due to a special descriptor is implemented with a KD-Tree. Experiments on the robot Pioneer3 showed that our method is very precise and stable.
基金The National High Technology Research and Development Program (863) of China (No2006AA04Z259)The National Natural Sci-ence Foundation of China (No60643005)
文摘A hierarchical mobile robot simultaneous localization and mapping (SLAM) method that allows us to obtain accurate maps was presented. The local map level is composed of a set of local metric feature maps that are guaranteed to be statistically independent. The global level is a topological graph whose arcs are labeled with the relative location between local maps. An estimation of these relative locations is maintained with local map alignment algorithm, and more accurate estimation is calculated through a global minimization procedure using the loop closure constraint. The local map is built with Rao-Blackwellised particle filter (RBPF), where the particle filter is used to extending the path posterior by sampling new poses. The landmark position estimation and update is implemented through extended Kalman filter (EKF). Monocular vision mounted on the robot tracks the 3D natural point landmarks, which are structured with matching scale invariant feature transform (SIFT) feature pairs. The matching for multi-dimension SIFT features is implemented with a KD-tree in the time cost of O(lbN). Experiment results on Pioneer mobile robot in a real indoor environment show the superior performance of our proposed method.
基金Sponsored by the Beijing Education Committee Cooperation Building Foundation Project
文摘A new method for speeding up the state augment operations involved in the compressed extended Kalman filter-based simultaneous localization and mapping (CEKF-SLAM) algorithm was proposed. State augment usually requires a fully-updated state eovariance so as to append the information of newly observed landmarks, thus computational volume increases quadratically with the number of landmarks in the whole map. It was proved that state augment can also be achieved by augmenting just one auxiliary coefficient ma- trix. This method can yield identical estimation results as those using EKF-SLAM algorithm, and computa- tional amount grows only linearly with number of increased landmarks in the local map. The efficiency of this quick state augment for CEKF-SLAM algorithm has been validated by a sophisticated simulation project.
基金Supported by the Major Research Plan of the National Natural Science Foundation of China(91120003)Surface Project of the National Natural Science Foundation of China(61173076)
文摘In order to meet the application requirements of autonomous vehicles, this paper proposes a simultaneous localization and mapping (SLAM) algorithm, which uses a VoxelGrid filter to down sample the point cloud data, with the combination of iterative closest points (ICP) algorithm and Gaussian model for particles updating, the matching between the local map and the global map to quantify particles' importance weight. The crude estimation by using ICP algorithm can find the high probability area of autonomous vehicles' poses, which would decrease particle numbers, increase algorithm speed and restrain particles' impoverishment. The calculation of particles' importance weight based on matching of attribute between grid maps is simple and practicable. Experiments carried out with the autonomous vehicle platform validate the effectiveness of our approaches.
基金Supported by Program for Changjiang Scholars and Innovative Research Team in University,National Science Foundation of China(61105092)the National Natural Science Foundation of China(61473042)
文摘In this paper a label-based simultaneous localization and mapping( SLAM) system is proposed to provide localization to indoor autonomous robots. In the system quick response( QR) codes encoded with serial numbers are utilized as labels. These labels are captured by two webcams,then the distances and angles between the labels and webcams are computed. Motion estimated from the two rear wheel encoders is adjusted by observing QR codes. Our system uses the extended Kalman filter( EKF) for the back-end state estimation. The number of deployed labels controls the state estimation dimension. The label-based EKF-SLAM system eliminates complicated processes,such as data association and loop closure detection in traditional feature-based visual SLAM systems. Our experiments include software-simulation and robot-platform test in a real environment. Results demonstrate that the system has the capability of correcting accumulated errors of dead reckoning and therefore has the advantage of superior precision.
基金Supported by the National Natural Science Foundation of China(51009040)National Defence Key Laboratory of Autonomous Underwater Vehicle Technology(2008002)Scientific Service Special Funds of University in China(E091002)
文摘A method of underwater simultaneous localization and mapping (SLAM) based on forward-looking sonar was proposed in this paper. Positions of objects were obtained by the forward-looking sonar, and an improved association method based on an ant colony algorithm was introduced to estimate the positions. In order to improve the precision of the positions, the extended Kalman filter (EKF) was adopted. The presented algorithm was tested in a tank, and the maximum estimation error of SLAM gained was 0.25 m. The tests verify that this method can maintain better association efficiency and reduce navigatioJ~ error.
文摘视觉同步定位与建图技术常用于室内智能机器人的导航,但是其位姿是以静态环境为前提进行估计的。为了提升视觉即时定位与建图(Simultaneous Localization And Mapping,SLAM)在动态场景中的定位与建图的鲁棒性和实时性,在原ORB-SLAM2基础上新增动态区域检测线程和语义点云线程。动态区域检测线程由实例分割网络和光流估计网络组成,实例分割赋予动态场景语义信息的同时生成先验性动态物体的掩膜。为了解决实例分割网络的欠分割问题,采用轻量级光流估计网络辅助检测动态区域,生成准确性更高的动态区域掩膜。将生成的动态区域掩膜传入到跟踪线程中进行实时剔除动态区域特征点,然后使用地图中剩余的静态特征点进行相机的位姿估计并建立语义点云地图。在公开TUM数据集上的实验结果表明,改进后的SLAM系统在保证实时性的前提下,提升了其在动态场景中的定位与建图的鲁棒性。
基金supported by the National Natural Science Foundation of China(61473202)。
文摘In recent years, reconstructing a sparse map from a simultaneous localization and mapping(SLAM) system on a conventional CPU has undergone remarkable progress. However,obtaining a dense map from the system often requires a highperformance GPU to accelerate computation. This paper proposes a dense mapping approach which can remove outliers and obtain a clean 3D model using a CPU in real-time. The dense mapping approach processes keyframes and establishes data association by using multi-threading technology. The outliers are removed by changing detections of associated vertices between keyframes. The implicit surface data of inliers is represented by a truncated signed distance function and fused with an adaptive weight. A global hash table and a local hash table are used to store and retrieve surface data for data-reuse. Experiment results show that the proposed approach can precisely remove the outliers in scene and obtain a dense 3D map with a better visual effect in real-time.