A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for por...A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for port wine stain (PWS) when it monitors the position of the treatment region. The corner matching based on Hu moments is used to calculate the fundamental matrix of the binocular vision system. Experimental results are in agreement with the theoretical calculation.展开更多
A plane-based and linear camera calibration technique without considering lens distortion is proposed in a greedy and intuitive framework for the binocular camera system. Characteristic homography matrix and consisten...A plane-based and linear camera calibration technique without considering lens distortion is proposed in a greedy and intuitive framework for the binocular camera system. Characteristic homography matrix and consistency constraints in close range are employed in this calibration. First, in order to calculate the internal geometries of the cameras, total least-square fitting as a robust tool for the geometrical cost function is exploited to recover the accurate principal point of each camera from all the characteristic lines of the homography matrices for all model planes. Secondly, generic prior knowledge of the aspect ratio of pixel cells is incorporated into the system to obtain the exact principal length in each camera. Thirdly, extrinsic geometries are accurately computed for all planar patterns with respect to each monocular camera. Finally, the rigid displacement between binocular cameras can be obtained by imposing the consistency constraints in 3-space geometry. Both simulation and real image experimental results indicate that reasonably reliable results can be obtained by this technique. And the proposed method is sufficient for applications where high precision is not required and can be easily performed by common computer users who are not experts in computer vision.展开更多
Plane detection is a prerequisite for many computer vision tasks. This paper proposes a new method which can automatically detect planes from two projective images. Firstly, we modify Scott’s feature point matching m...Plane detection is a prerequisite for many computer vision tasks. This paper proposes a new method which can automatically detect planes from two projective images. Firstly, we modify Scott’s feature point matching method by post-processing its result with the concept of similarity, and then get the lines matching according to feature points matching based on the approximate invariance of the features’ distribution between two images. Finally, we group all feature points into subsets in terms of their geometric relations with feature lines as initial sets to estimate homography rather than by a random search strategy (like RANSAC) as in most existing methods. The proposed method is especially suitable to detecting planes in man-made scenes. This method is validated on real images.展开更多
Comparison between the NEIC broadband radiated energy catalogue and the Harvard CMT catalogue provides information about apparent stress. In spite of its significant uncertainties and limited reliability, the clues ob...Comparison between the NEIC broadband radiated energy catalogue and the Harvard CMT catalogue provides information about apparent stress. In spite of its significant uncertainties and limited reliability, the clues obtained from this comparison seem interesting in the physics of earthquakes. Scaling of apparent stress provides information about the dynamic friction along an earthquake fault. Relation between reduced energy and seismic moment implies that for strike-slip earthquakes, velocity-dependent friction plays a predominant role, while for non-strike-slip earthquakes, slip-dependent friction is predominant. It is also found that strike-slip events with extremely low apparent stress tend to occur “in single”, which is applied to the prediction of the seismic tendency following the 2001 Qinghai-Xizang (Tibet) border M W7.8 earthquake.展开更多
In this paper,we propose a novel approach to recognise human activities from a different view.Although appearance-based recognition methods have been shown to be unsuitable for action recognition for varying views,the...In this paper,we propose a novel approach to recognise human activities from a different view.Although appearance-based recognition methods have been shown to be unsuitable for action recognition for varying views,there must be some regularity among the same action sequences of different views.Selfsimilarity matrices appear to be relative stable across views.However,the ability to effectively realise this stability is a problem.In this paper,we extract the shape-flow descriptor as the low-level feature and then choose the same number of key frames from the action sequences.Self-similarity matrices are obtained by computing the similarity between any pair of the key frames.The diagonal features of the similarity matrices are extracted as the highlevel feature representation of the action sequence and Support Vector Machines(SVM) is employed for classification.We test our approach on the IXMAS multi-view data set.The proposed approach is simple but effective when compared with other algorithms.展开更多
A bit-panel-plus-weight method has been proposed to realize gray-scale control of synchronous VGA display by passive matrix OLED.The presented VGA controller has been fabricated by FPGAs and can achieve a better resul...A bit-panel-plus-weight method has been proposed to realize gray-scale control of synchronous VGA display by passive matrix OLED.The presented VGA controller has been fabricated by FPGAs and can achieve a better result of gray-scale control by a 96*64 PMOLED panel.展开更多
With the increasing necessities for reliable printed circuit board(PCB) product, there has been a considerable demand for high speed and high precision vision positioning system. To locate a rectangular lead component...With the increasing necessities for reliable printed circuit board(PCB) product, there has been a considerable demand for high speed and high precision vision positioning system. To locate a rectangular lead component with high accuracy and reliability, a new visual positioning method was introduced. Considering the limitations of Ghosal sub-pixel edge detection algorithm, an improved algorithm was proposed, in which Harris corner features were used to coarsely detect the edge points and Zernike moments were adopted to accurately detect the edge points. Besides, two formulas were developed to determine the edge intersections whose sub-pixel coordinates were calculated with bilinear interpolation and conjugate gradient method. The last experimental results show that the proposed method can detect the deflection and offset, and the detection errors are less than 0.04° and 0.02 pixels.展开更多
The problem of geometric non-linearity simulation for spacial cable system was solved by introducing the truss element based on corotational coordinate (CR) system, cable structure materials and node coordinates and a...The problem of geometric non-linearity simulation for spacial cable system was solved by introducing the truss element based on corotational coordinate (CR) system, cable structure materials and node coordinates and automatic refreshing algorithms for element internal force. And the shape-finding problem for maneuvering profile was solved with the Newton-Raphson based on energy convergence criteria with search function. This has avoided the regular truss element assumption extensively used in traditional methods and catenary elements which have difficulties in practical application because of the complicated formulas. The use of CR formulation has taken into account the stiffness outside the cable plane via a geometric stiffness matrix, realizing the 3D space analysis of a cable bridge and improving the efficiency and precision for the space geometric non-linearity analysis and cable structure, and enabling more precised simulation of geometric form finding and internal force of the large span suspension bridge main cable under construction.展开更多
The ability to recognise video events has become increasingly more popular owing to its extensive practical applications.Most events will occur in certain scene with certain people,and the scene context and group cont...The ability to recognise video events has become increasingly more popular owing to its extensive practical applications.Most events will occur in certain scene with certain people,and the scene context and group context provide important information for event recognition.In this paper,we present an algorithm to recognise video events in different scenes in which there are multiple agents.First,we recognise events for each agent based on Stochastic Context Sensitive Grammar(SCSG).Then we propose the model of a scene in order to infer the scene in which the events occur,and we use a co-occurrence matrix of events to represent the group context.Finally,the scene and group context are exploited to distinguish events having similar structures.Experimental results show that by adding the scene and group context,the performance of events recognition can be significantly improved.展开更多
In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the traject...In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.展开更多
The registration of point cloud is important for large object measurement.A measurement method for coordinate system transformation based on robot is proposed in this paper.Firstly,for obtaining extrinsic parameters,t...The registration of point cloud is important for large object measurement.A measurement method for coordinate system transformation based on robot is proposed in this paper.Firstly,for obtaining extrinsic parameters,the robot moves to three different positions to capture the images of three targets.Then the transformation matrix X between camera and tool center point(TCP) coordinate systems can be calculated by using the known parameters of robot and the extrinsic parameters,and finally the multi-view coordinate system can be transformed into robot coordinate system by the transformation matrix X.With the help of robot,the multi-view point cloud can be easily transformed into a unified coordinate system.By using robot,the measurement doesn't need any mark.Experimental results show that the method is effective.展开更多
Omnidirectional imaging sensors have been used in more and more applications when a very large field of view is required.In this paper,we investigate the unwrapping,epipolar geometry and stereo rectification issues fo...Omnidirectional imaging sensors have been used in more and more applications when a very large field of view is required.In this paper,we investigate the unwrapping,epipolar geometry and stereo rectification issues for omnidirectional vision when the particular mirror model and the camera parameters are unknown in priori.First,the omnidirectional camera is calibrated under the Taylor model,and the parameters related to this model are obtained.In order to make the classical computer vision algorithms of conventional perspective cameras applicable,the ring omnidirectional image is unwrapped into two kinds of panoramas:cylinder and cuboid.Then the epipolar geometry of arbitrary camera configuration is analyzed and the essential matrix is deduced with its properties being indicated for ring images.After that,a simple stereo rectification method based on the essential matrix and the conformal mapping is proposed.Simulations and real data experimental results illustrate that our methods are effective for the omnidirectional camera under the constraint of a single view point.展开更多
基金Supported by the National High Technology Research and Development Program of China("863"Program)(2007AA04Z231)~~
文摘A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for port wine stain (PWS) when it monitors the position of the treatment region. The corner matching based on Hu moments is used to calculate the fundamental matrix of the binocular vision system. Experimental results are in agreement with the theoretical calculation.
文摘A plane-based and linear camera calibration technique without considering lens distortion is proposed in a greedy and intuitive framework for the binocular camera system. Characteristic homography matrix and consistency constraints in close range are employed in this calibration. First, in order to calculate the internal geometries of the cameras, total least-square fitting as a robust tool for the geometrical cost function is exploited to recover the accurate principal point of each camera from all the characteristic lines of the homography matrices for all model planes. Secondly, generic prior knowledge of the aspect ratio of pixel cells is incorporated into the system to obtain the exact principal length in each camera. Thirdly, extrinsic geometries are accurately computed for all planar patterns with respect to each monocular camera. Finally, the rigid displacement between binocular cameras can be obtained by imposing the consistency constraints in 3-space geometry. Both simulation and real image experimental results indicate that reasonably reliable results can be obtained by this technique. And the proposed method is sufficient for applications where high precision is not required and can be easily performed by common computer users who are not experts in computer vision.
文摘Plane detection is a prerequisite for many computer vision tasks. This paper proposes a new method which can automatically detect planes from two projective images. Firstly, we modify Scott’s feature point matching method by post-processing its result with the concept of similarity, and then get the lines matching according to feature points matching based on the approximate invariance of the features’ distribution between two images. Finally, we group all feature points into subsets in terms of their geometric relations with feature lines as initial sets to estimate homography rather than by a random search strategy (like RANSAC) as in most existing methods. The proposed method is especially suitable to detecting planes in man-made scenes. This method is validated on real images.
文摘Comparison between the NEIC broadband radiated energy catalogue and the Harvard CMT catalogue provides information about apparent stress. In spite of its significant uncertainties and limited reliability, the clues obtained from this comparison seem interesting in the physics of earthquakes. Scaling of apparent stress provides information about the dynamic friction along an earthquake fault. Relation between reduced energy and seismic moment implies that for strike-slip earthquakes, velocity-dependent friction plays a predominant role, while for non-strike-slip earthquakes, slip-dependent friction is predominant. It is also found that strike-slip events with extremely low apparent stress tend to occur “in single”, which is applied to the prediction of the seismic tendency following the 2001 Qinghai-Xizang (Tibet) border M W7.8 earthquake.
基金supported by a Project Funded by the Priority Academic Program Development of Jiangsu Higher Education Institutions(Information and Communication Engineering)the Natural Science Foundation of Jiangsu Province under Grant No.BK2010523+2 种基金the National Natural Science Foundation of China under Grants No.61172118,No.61001152the University Natural Science Research Project of Jiangsu Province under Grant No.11KJB510012the Scientific Research Foundation of Nanjing University of Posts and Telecommunications under Grant No.NY210073
文摘In this paper,we propose a novel approach to recognise human activities from a different view.Although appearance-based recognition methods have been shown to be unsuitable for action recognition for varying views,there must be some regularity among the same action sequences of different views.Selfsimilarity matrices appear to be relative stable across views.However,the ability to effectively realise this stability is a problem.In this paper,we extract the shape-flow descriptor as the low-level feature and then choose the same number of key frames from the action sequences.Self-similarity matrices are obtained by computing the similarity between any pair of the key frames.The diagonal features of the similarity matrices are extracted as the highlevel feature representation of the action sequence and Support Vector Machines(SVM) is employed for classification.We test our approach on the IXMAS multi-view data set.The proposed approach is simple but effective when compared with other algorithms.
文摘A bit-panel-plus-weight method has been proposed to realize gray-scale control of synchronous VGA display by passive matrix OLED.The presented VGA controller has been fabricated by FPGAs and can achieve a better result of gray-scale control by a 96*64 PMOLED panel.
基金Project(51175242)supported by the National Natural Science Foundation of ChinaProject(BA2012031)supported by the Jiangsu Province Science and Technology Foundation of China
文摘With the increasing necessities for reliable printed circuit board(PCB) product, there has been a considerable demand for high speed and high precision vision positioning system. To locate a rectangular lead component with high accuracy and reliability, a new visual positioning method was introduced. Considering the limitations of Ghosal sub-pixel edge detection algorithm, an improved algorithm was proposed, in which Harris corner features were used to coarsely detect the edge points and Zernike moments were adopted to accurately detect the edge points. Besides, two formulas were developed to determine the edge intersections whose sub-pixel coordinates were calculated with bilinear interpolation and conjugate gradient method. The last experimental results show that the proposed method can detect the deflection and offset, and the detection errors are less than 0.04° and 0.02 pixels.
基金National Science and Technology Support Program of China(No.2009BAG15B01)Key Programs for Science and Technology Development of Chinese Transportation Industry(No.2008-353-332-190)
文摘The problem of geometric non-linearity simulation for spacial cable system was solved by introducing the truss element based on corotational coordinate (CR) system, cable structure materials and node coordinates and automatic refreshing algorithms for element internal force. And the shape-finding problem for maneuvering profile was solved with the Newton-Raphson based on energy convergence criteria with search function. This has avoided the regular truss element assumption extensively used in traditional methods and catenary elements which have difficulties in practical application because of the complicated formulas. The use of CR formulation has taken into account the stiffness outside the cable plane via a geometric stiffness matrix, realizing the 3D space analysis of a cable bridge and improving the efficiency and precision for the space geometric non-linearity analysis and cable structure, and enabling more precised simulation of geometric form finding and internal force of the large span suspension bridge main cable under construction.
基金partially supported by the National Natural Science Foundation of China under Grant No.61203291the Specialised Research Fund for the Doctoral Program under Grant No.20121101110035
文摘The ability to recognise video events has become increasingly more popular owing to its extensive practical applications.Most events will occur in certain scene with certain people,and the scene context and group context provide important information for event recognition.In this paper,we present an algorithm to recognise video events in different scenes in which there are multiple agents.First,we recognise events for each agent based on Stochastic Context Sensitive Grammar(SCSG).Then we propose the model of a scene in order to infer the scene in which the events occur,and we use a co-occurrence matrix of events to represent the group context.Finally,the scene and group context are exploited to distinguish events having similar structures.Experimental results show that by adding the scene and group context,the performance of events recognition can be significantly improved.
基金Supported by the National Natural Science Foundation of China(No.60905061)the National Natural Science Foundation of Tianjin(No.08JCYBJC12700)
文摘In this paper,a method with an eye-in-hand configuration is developed to hit targets during visual tracking for the TLS(Tele-Light Saber) game.It is not necessary to calibrate camera parameters and predict the trajectory of the moving object.Firstly,the expression of the image Jacobian matrix for the eye-in-hand configuration is proposed,and then an update law is designed to estimate the image Jacobian online.Furthermore,a control scheme is presented and the Lyapunov method is employed to prove asymptotic convergence of image errors.No assumption for the moving objects is needed.Finally,both simulation and experimental results are shown to support the approach in this paper.
基金supported by the National Natural Science Foundation of China(Nos.60808020 and 61078041)the National Science and Technology Support Program(No.2014BAH03F01)+2 种基金the Tianjin Research Program of Application Foundation and Advanced Technology(No.10JCYBJC07200)the Tianjin Small and Medium Enterprise Innovation Fund(No.12ZXCXGX11800)the Technology Program of Tianjin Municipal Education Commission(No.20130324)
文摘The registration of point cloud is important for large object measurement.A measurement method for coordinate system transformation based on robot is proposed in this paper.Firstly,for obtaining extrinsic parameters,the robot moves to three different positions to capture the images of three targets.Then the transformation matrix X between camera and tool center point(TCP) coordinate systems can be calculated by using the known parameters of robot and the extrinsic parameters,and finally the multi-view coordinate system can be transformed into robot coordinate system by the transformation matrix X.With the help of robot,the multi-view point cloud can be easily transformed into a unified coordinate system.By using robot,the measurement doesn't need any mark.Experimental results show that the method is effective.
基金supported by the National Natural Science Foundation of China (Nos.60502006,60534070 and 90820306)the Science and Technology Plan of Zhejiang Province,China (No.2007C21007)
文摘Omnidirectional imaging sensors have been used in more and more applications when a very large field of view is required.In this paper,we investigate the unwrapping,epipolar geometry and stereo rectification issues for omnidirectional vision when the particular mirror model and the camera parameters are unknown in priori.First,the omnidirectional camera is calibrated under the Taylor model,and the parameters related to this model are obtained.In order to make the classical computer vision algorithms of conventional perspective cameras applicable,the ring omnidirectional image is unwrapped into two kinds of panoramas:cylinder and cuboid.Then the epipolar geometry of arbitrary camera configuration is analyzed and the essential matrix is deduced with its properties being indicated for ring images.After that,a simple stereo rectification method based on the essential matrix and the conformal mapping is proposed.Simulations and real data experimental results illustrate that our methods are effective for the omnidirectional camera under the constraint of a single view point.