An effective algorithm of electronic image stabilization (EIS) of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows:① A model of electronic im...An effective algorithm of electronic image stabilization (EIS) of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows:① A model of electronic image stabilization is built by analyzing the imaging theory and the principle of EIS, and the image shift function of unwrapped panoramic image is deduced;② The relationship equation between motion estimation parameters of annular panoramic image and motion estimation parameters of unwrapped panoramic image is developed according to the constrained aspect ratio of real objects, motion parameters of annular panoramic image are firstly estimated, and then motion parameters among the image shift function are carried out according to the relationship equation;③ An excessive stabilization threshold is presented to prevent the phenomena of excessive stabilization, and the Kalman filtering is adopted to smooth the image sequences. Numerical experimental results show that this algorithm can effectively smooth out the unwanted motion and follow the intentional camera movement under certain resolutions.展开更多
Central catadioptric cameras have been extensively adopted in robotics and surveillance due to their extensive field of view.To attain precise 3D information in these applications,it is important to calibrate the cata...Central catadioptric cameras have been extensively adopted in robotics and surveillance due to their extensive field of view.To attain precise 3D information in these applications,it is important to calibrate the catadioptric cameras accurately.The existing calibration techniques either require prior knowledge of the mirror types,or highly depend on a conic estimation procedure,which might be ruined if there are only small portions of the conic visible on calibration images.In this paper,we design a novel planar pattern with concurrent lines as a calibration rig,which is more robust in conic estimation since the relationship among lines is taken into account.Based on the line properties,we propose a rough-to-fine approach suitable for the new planar pattern to calibrate central catadioptric cameras.This method divides the nonlinear optimization calibration problem into several linear sub-problems that are much more robust against noise.Our calibration method can estimate intrinsic parameters and the mirror parameter simultaneously and accurately,without a priori knowledge of the mirror type.The performance is demonstrated by both simulation and a real hyperbolic catadioptric imaging system.展开更多
Accuracy is a key factor in high-resolution remote sensing and photogrammetry. The factors that affect accuracy are imaging system errors and data processing errors. Due to the complexity of aerial camera errors, this...Accuracy is a key factor in high-resolution remote sensing and photogrammetry. The factors that affect accuracy are imaging system errors and data processing errors. Due to the complexity of aerial camera errors, this paper focuses on the design of digital aerial camera systems and the means to reduce system error and data processing inefficiencies. There are many kinds of digital aerial camera systems at present;however, these systems lack a unified physical model, which ultimately leads to more complicated designs and multi-camera modes. Such a system is complex and costly, as it is easily affected by factors such as vibration and temperature. Thus, the installed accuracy can only reach the millimeter level. Here, we describe a unified physical structure for a digital aerial camera that imitates an out-of-field multi-charge-coupled device (CCD), an in-field multi-CCD, and once-imaging and twice-imaging digital camera systems. This model is referred to as the variable baseline-height ratio spatiotemporal model. The variable ratio allows the opto-mechanical spatial parameters to be linked with height accuracy, thus providing a connection to the surface elevation. The twice-imaging digital camera prototype system and the wideband limb imaging spectrometer provide a transformation prototype from the current multi-rigid once-imaging aerial camera to a single rigid structure. Thus, our research lays a theoretical foundation and prototype references for the construction and industrialization of digital aerial systems.展开更多
基金Supported by State Key Laboratory of Explosion Science and Technology Foundation(ZDKT08-05)
文摘An effective algorithm of electronic image stabilization (EIS) of catadioptric panoramic imaging system for track robots is presented. The key techniques of this algorithm are as follows:① A model of electronic image stabilization is built by analyzing the imaging theory and the principle of EIS, and the image shift function of unwrapped panoramic image is deduced;② The relationship equation between motion estimation parameters of annular panoramic image and motion estimation parameters of unwrapped panoramic image is developed according to the constrained aspect ratio of real objects, motion parameters of annular panoramic image are firstly estimated, and then motion parameters among the image shift function are carried out according to the relationship equation;③ An excessive stabilization threshold is presented to prevent the phenomena of excessive stabilization, and the Kalman filtering is adopted to smooth the image sequences. Numerical experimental results show that this algorithm can effectively smooth out the unwanted motion and follow the intentional camera movement under certain resolutions.
基金Project (Nos. 60502006,60534070,and 90820306) supported by the National Natural Science Foundation of China
文摘Central catadioptric cameras have been extensively adopted in robotics and surveillance due to their extensive field of view.To attain precise 3D information in these applications,it is important to calibrate the catadioptric cameras accurately.The existing calibration techniques either require prior knowledge of the mirror types,or highly depend on a conic estimation procedure,which might be ruined if there are only small portions of the conic visible on calibration images.In this paper,we design a novel planar pattern with concurrent lines as a calibration rig,which is more robust in conic estimation since the relationship among lines is taken into account.Based on the line properties,we propose a rough-to-fine approach suitable for the new planar pattern to calibrate central catadioptric cameras.This method divides the nonlinear optimization calibration problem into several linear sub-problems that are much more robust against noise.Our calibration method can estimate intrinsic parameters and the mirror parameter simultaneously and accurately,without a priori knowledge of the mirror type.The performance is demonstrated by both simulation and a real hyperbolic catadioptric imaging system.
基金The National Major Plan Research and Development Project(2017YFB0503003)The National Natural Science Foundation of China(11174017)+1 种基金The National 863 Subject(2007AA12Z111,2006AA12Z119)The Special Research Fund for Doctoral Programs in Colleges and Universities(20130001110046).
文摘Accuracy is a key factor in high-resolution remote sensing and photogrammetry. The factors that affect accuracy are imaging system errors and data processing errors. Due to the complexity of aerial camera errors, this paper focuses on the design of digital aerial camera systems and the means to reduce system error and data processing inefficiencies. There are many kinds of digital aerial camera systems at present;however, these systems lack a unified physical model, which ultimately leads to more complicated designs and multi-camera modes. Such a system is complex and costly, as it is easily affected by factors such as vibration and temperature. Thus, the installed accuracy can only reach the millimeter level. Here, we describe a unified physical structure for a digital aerial camera that imitates an out-of-field multi-charge-coupled device (CCD), an in-field multi-CCD, and once-imaging and twice-imaging digital camera systems. This model is referred to as the variable baseline-height ratio spatiotemporal model. The variable ratio allows the opto-mechanical spatial parameters to be linked with height accuracy, thus providing a connection to the surface elevation. The twice-imaging digital camera prototype system and the wideband limb imaging spectrometer provide a transformation prototype from the current multi-rigid once-imaging aerial camera to a single rigid structure. Thus, our research lays a theoretical foundation and prototype references for the construction and industrialization of digital aerial systems.