In this paper,a method combining perspective-n-point(PnP) and novel iteration algorithm is developed to measure the pose of a target in high precision for Tele-LightSaber game.The PnP algorithm is used to obtain a rou...In this paper,a method combining perspective-n-point(PnP) and novel iteration algorithm is developed to measure the pose of a target in high precision for Tele-LightSaber game.The PnP algorithm is used to obtain a rough pose,which is taken as the initial value of the iteration algorithm.The iteration algorithm utilizes the unit quaternions to represent the rotations.Then the result is optimized with Kalman filter.Considering the real-time and accuracy of the pose measurement,a fast feature extraction algorithm including object location,edge detection and corner detection is adopted to get the corners in high precision.The experiments and results verify the effectiveness of the proposed method.展开更多
When a vehicle travels in urban areas, onboard global positioning system (GPS) signals may be obstructed by high-rise buildings and thereby cannot provide accurate positions. It is proposed to perform localization b...When a vehicle travels in urban areas, onboard global positioning system (GPS) signals may be obstructed by high-rise buildings and thereby cannot provide accurate positions. It is proposed to perform localization by registering ground images to a 2D building boundary map which is generated from aerial images. Multilayer feature graphs (MFG) is employed to model building facades from the ground images. MFG was reported in the previous work to facilitate the robot scene understand- ing in urhan areas. By constructing MFG, the 2D/3D positions of features can be obtained, inclu- cling line segments, ideal lines, and all primary vertical planes. Finally, a voting-based feature weighted localization method is developed based on MFGs and the 2D building boundary map. The proposed method has been implemented and validated in physical experiments. In the proposed ex- periments, the algorithm has achieved an overall localization accuracy of 2.2m, which is better than commercial GPS working in open environments.展开更多
In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the traject...In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.展开更多
A framework is presented for robustly estimating the location of a mobile robot in urban areas based on images extracted from a monocular onboard camera, given a 2D map with building outlines with neither 3D geometric...A framework is presented for robustly estimating the location of a mobile robot in urban areas based on images extracted from a monocular onboard camera, given a 2D map with building outlines with neither 3D geometric information nor appearance data. The proposed method firstly reconstructs a set of vertical planes by sampling and clustering vertical lines from the image with random sample consensus (RANSAC), using the derived 1D homographies to inform the planar model. Then, an optimal autonomous localization algorithm based on the 2D building boundary map is proposed. The physical experiments are carried out to validate the robustness and accuracy of our localization approach.展开更多
To facilitate scene understanding and robot navigation in large scale urban environment, a two-layer enhanced geometric map(EGMap) is designed using videos from a monocular onboard camera. The 2D layer of EGMap consis...To facilitate scene understanding and robot navigation in large scale urban environment, a two-layer enhanced geometric map(EGMap) is designed using videos from a monocular onboard camera. The 2D layer of EGMap consists of a 2D building boundary map from top-down view and a 2D road map, which can support localization and advanced map-matching when compared with standard polyline-based maps. The 3D layer includes features such as 3D road model,and building facades with coplanar 3D vertical and horizontal line segments, which can provide the 3D metric features to localize the vehicles and flying-robots in 3D space. Starting from the 2D building boundary and road map, EGMap is initially constructed using feature fusion with geometric constraints under a line feature-based simultaneous localization and mapping(SLAM) framework iteratively and progressively. Then, a local bundle adjustment algorithm is proposed to jointly refine the camera localizations and EGMap features. Furthermore, the issues of uncertainty, memory use, time efficiency and obstacle effect in EGMap construction are discussed and analyzed. Physical experiments show that EGMap can be successfully constructed in large scale urban environment and the construction method is demonstrated to be very accurate and robust.展开更多
基金Supported by the National High Technology Research and Development Programme of China(No.2012AA041403)the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method combining perspective-n-point(PnP) and novel iteration algorithm is developed to measure the pose of a target in high precision for Tele-LightSaber game.The PnP algorithm is used to obtain a rough pose,which is taken as the initial value of the iteration algorithm.The iteration algorithm utilizes the unit quaternions to represent the rotations.Then the result is optimized with Kalman filter.Considering the real-time and accuracy of the pose measurement,a fast feature extraction algorithm including object location,edge detection and corner detection is adopted to get the corners in high precision.The experiments and results verify the effectiveness of the proposed method.
基金Supported by the National High Technology Research and Development Program of China(No.2012AA041403)National Natural Science Foundation of China(No.60905061,61305107)+1 种基金the Fundamental Research Funds for the Central Universities(No.ZXH2012N003)the Scientific Research Funds for Civil Aviation University of China(No.2012QD23x)
文摘When a vehicle travels in urban areas, onboard global positioning system (GPS) signals may be obstructed by high-rise buildings and thereby cannot provide accurate positions. It is proposed to perform localization by registering ground images to a 2D building boundary map which is generated from aerial images. Multilayer feature graphs (MFG) is employed to model building facades from the ground images. MFG was reported in the previous work to facilitate the robot scene understand- ing in urhan areas. By constructing MFG, the 2D/3D positions of features can be obtained, inclu- cling line segments, ideal lines, and all primary vertical planes. Finally, a voting-based feature weighted localization method is developed based on MFGs and the 2D building boundary map. The proposed method has been implemented and validated in physical experiments. In the proposed ex- periments, the algorithm has achieved an overall localization accuracy of 2.2m, which is better than commercial GPS working in open environments.
基金Supported by the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.
基金National Nature Science Foundation of China(60905061)
文摘A framework is presented for robustly estimating the location of a mobile robot in urban areas based on images extracted from a monocular onboard camera, given a 2D map with building outlines with neither 3D geometric information nor appearance data. The proposed method firstly reconstructs a set of vertical planes by sampling and clustering vertical lines from the image with random sample consensus (RANSAC), using the derived 1D homographies to inform the planar model. Then, an optimal autonomous localization algorithm based on the 2D building boundary map is proposed. The physical experiments are carried out to validate the robustness and accuracy of our localization approach.
基金National Natural Science Foundation of China(61305107,U1333109)the Fundamental Research Funds for the Central Universities(3122016B006)the Scientific Research Funds for Civil Aviation University of China(2012QD23X)
文摘To facilitate scene understanding and robot navigation in large scale urban environment, a two-layer enhanced geometric map(EGMap) is designed using videos from a monocular onboard camera. The 2D layer of EGMap consists of a 2D building boundary map from top-down view and a 2D road map, which can support localization and advanced map-matching when compared with standard polyline-based maps. The 3D layer includes features such as 3D road model,and building facades with coplanar 3D vertical and horizontal line segments, which can provide the 3D metric features to localize the vehicles and flying-robots in 3D space. Starting from the 2D building boundary and road map, EGMap is initially constructed using feature fusion with geometric constraints under a line feature-based simultaneous localization and mapping(SLAM) framework iteratively and progressively. Then, a local bundle adjustment algorithm is proposed to jointly refine the camera localizations and EGMap features. Furthermore, the issues of uncertainty, memory use, time efficiency and obstacle effect in EGMap construction are discussed and analyzed. Physical experiments show that EGMap can be successfully constructed in large scale urban environment and the construction method is demonstrated to be very accurate and robust.