Microscopic vision has been widely applied in precision assembly.To achieve sufficiently high resolution in measurements for precision assembly when the sizes of the parts involved exceed the field of view of the visi...Microscopic vision has been widely applied in precision assembly.To achieve sufficiently high resolution in measurements for precision assembly when the sizes of the parts involved exceed the field of view of the vision system,an image mosaic technique must be used.In this paper,a method for constructing an image mosaic with non-overlapping areas with enhanced efficiency is proposed.First,an image mosaic model for the part is created using a geometric model of the measurement system installed on a X-Y-Z precision stages with high repeatability,and a path for image acquisition is established.Second,images are captured along the same path for a specified calibration plate,and an entire image is formed based on the given model.The measurement results obtained from the specified calibration plate are utilized to identify mosaic errors and apply compensation for the part requiring measurement.Experimental results show that the maximum error is less than 4μm for a camera with pixel equivalent 2.46μm,thereby demonstrating the accuracy of the proposed method.This image mosaic technique with non-overlapping regions can simplify image acquisition and reduce the workload involved in constructing an image mosaic.展开更多
To improve the performance of the scale invariant feature transform ( SIFT), a modified SIFT (M-SIFT) descriptor is proposed to realize fast and robust key-point extraction and matching. In descriptor generation, ...To improve the performance of the scale invariant feature transform ( SIFT), a modified SIFT (M-SIFT) descriptor is proposed to realize fast and robust key-point extraction and matching. In descriptor generation, 3 rotation-invariant concentric-ring grids around the key-point location are used instead of 16 square grids used in the original SIFT. Then, 10 orientations are accumulated for each grid, which results in a 30-dimension descriptor. In descriptor matching, rough rejection mismatches is proposed based on the difference of grey information between matching points. The per- formance of the proposed method is tested for image mosaic on simulated and real-worid images. Experimental results show that the M-SIFT descriptor inherits the SIFT' s ability of being invariant to image scale and rotation, illumination change and affine distortion. Besides the time cost of feature extraction is reduced by 50% compared with the original SIFT. And the rough rejection mismatches can reject at least 70% of mismatches. The results also demonstrate that the performance of the pro- posed M-SIFT method is superior to other improved SIFT methods in speed and robustness.展开更多
Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours...Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours of the target object are generated by colorful liquid or laser scanning, these images from different views are fused into a set of complete cross-sectional images, thereby the whole practical model is reconstructed in 3D space.展开更多
This essay concentrates on two key procedures of image mosaic--image registration and imagefusion.Becauseof the character of geometric transformation invariance of edge points, wecalculate the angle difference of the ...This essay concentrates on two key procedures of image mosaic--image registration and imagefusion.Becauseof the character of geometric transformation invariance of edge points, wecalculate the angle difference of the direction vector ofedge points in different images anddraw an angle difference histogramto adjust the rotationproblem. Through this way, algorithm based on gray information is expandedandcan be used in images withdisplacementand rotation. Inthe term of image fusion, wavelet multi-scale analysis is used to fuse spliced images. In order to choose the best method of imagefusion,weevaluate the results of different methods of image fusion by cross entropy.展开更多
To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this syste...To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this system to imitate the small eyes of a compound eye. Based on the optical analysis of this system, a direct panoramic image mosaic algorithm was proposed. Several sub-images were collected by the bionic compound eye visual system, and then the system obtained the overlapping proportions of these sub-images and cut the overlap sections of the neighboring images. Thus, a panoramic image with a large field of view was directly mosaicked, which expanded the field and guaranteed the high resolution. The experimental results show that the time consumed by the direct mosaic algorithm is only 2.2% of that by the traditional image mosaic algorithm while guaranteeing mosaic quality. Furthermore, the proposed method effectively solved the problem of misalignment of the mosaic image and eliminated mosaic cracks as a result of the illumination factor and other factors. This method has better real-time properties compared to other methods.展开更多
Fingerprint identification is one of the most important biometric authentication methods. However, current devices for recording digital fingerprints can only capture plain-touch fingerprints. Rolled fingerprints hav...Fingerprint identification is one of the most important biometric authentication methods. However, current devices for recording digital fingerprints can only capture plain-touch fingerprints. Rolled fingerprints have much more information for recognition, so a method is needed to construct a rolled fingerprint from a series of plain-touch fingerprints. This paper presents a novel algorithm for image mosaicing for real time rolled fingerprint construction in which the images are assembled with corrections to create a smooth, non-fragmented rolled fingerprint in real time. Experimental results demonstrate its effectiveness by comparing it with other conventional algorithms.展开更多
We propose a video image mosaic method based on multi-module cooperation. This method stitches the video into a panorama with a large field of view, divided into three modules: the key frame selection module, the imag...We propose a video image mosaic method based on multi-module cooperation. This method stitches the video into a panorama with a large field of view, divided into three modules: the key frame selection module, the image mosaic module, and the optimization module. The key frame selection module obtains key frames by comprehensively evaluating the overlap rate and image quality. The image mosaic module stitches the key frames into a panoramic image to generate an initial mosaic result. The optimization module makes the mosaic result more natural and eliminates ghosts by using object detection advantages. Our method is tested on videos taken in real scenes, and the results have a more comprehensive and natural description.展开更多
When locating the leakage of thermal field of a certain container, it is hard for us to evaluate the leakage with one or several separate thermal infrared images. Instead, panoramic imagery with a wide visual angle an...When locating the leakage of thermal field of a certain container, it is hard for us to evaluate the leakage with one or several separate thermal infrared images. Instead, panoramic imagery with a wide visual angle and high distinguishability is always needed. However, we can only get images for part of the scene because of the limited visual field of thermography and the large size of the measured object in practical. What is more, the hardware that can be used to get panoramic images is always expensive and cannot be used in large scale. Therefore, this paper introduces image mosaic technology, which can be used to get the intact thermal infrared image of the measured and increase the efficiency of detection. The experiment results demonstrate its effectiveness.展开更多
Quality inspection of a PCB (Printed Circuit Board) always requires us to stitch some separated images into an integral one. However, during image acquisition, some environmental influences such as vibration, noise ...Quality inspection of a PCB (Printed Circuit Board) always requires us to stitch some separated images into an integral one. However, during image acquisition, some environmental influences such as vibration, noise and illumination will cause image degradation. An efficient image mosaic method has been urgently required to obtain a high-quality PCB panorama. Hence, an image mosaic method based on Gaussian-Hermite moments is presented in this paper. The characteristic points in the neighborhood of a PCB are represented by Gaussian-Hermite moment in- variants. They are characterized by independence to translation or rotation transformations. Meanwhile, such feature representation shows better noise robustness. Experimental results show that the proposed method produces a qualified mosaic of PCB image.展开更多
A machine vision based system to estimate the nursery plug tray sowing quantity is necessary in the rice seedling nursery.Because the super hybrid rice is of small diameter,in order to obtain better estimation results...A machine vision based system to estimate the nursery plug tray sowing quantity is necessary in the rice seedling nursery.Because the super hybrid rice is of small diameter,in order to obtain better estimation results of sowing quantity,only part of the tray scene is captured by machine vision system.Therefore,nursery tray image sequence mosaic algorithm is required so as to obtain the whole nursery tray sowing performance.In this paper,a fast nursery plug tray image mosaic technique based on Phase Correlation and Speeded up Robust Features(the PC-SURF)algorithm was introduced.To reduce huge computational complexity in feature extraction and avoid wrong match points from non-overlapping regions between two adjacent images,firstly the proposed method used Phase Correlation to approximately locate the overlapping regions between two sequential images so as to narrow down the processing area for further feature extraction.Then,the SURF algorithm was implemented in the overlapping region of the images to perform image registration and image blending.Image registration and blending were then performed using the RANSAC algorithm and transition smoothing method.Finally,sequential images were warped into a single frame to produce a panoramic tray image with high resolution and better quality.The test results showed that the PC-SURF algorithm greatly outperforms the SURF algorithm in point matching accuracy,time consumption,and image mosaic accuracy.The average feature point matching accuracy of the PC-SURF algorithm was improved by approximately 7.14%.The implementation time was almost three times faster.The Root Mean Squared Error(RMSE)of image blending in the R,G,B channels(RMSEr,RMSEg,and RMSEb)decreased by approximately 8.4%,6.9%,6.9%respectively.The RMSE of image registration RMSEreg decreased by 33.8%.In addition,the speed of the nursery tray image mosaic technology could meet the requirements for real-time implementation in super hybrid rice automated sowing machines.展开更多
基金supported by the Liaoning Revitalization Talents Program(Grant No.XLYC2002020)the Major Project of Basic Scientific Research of Chinese Ministry(Grant No.JCYK2016205A003).
文摘Microscopic vision has been widely applied in precision assembly.To achieve sufficiently high resolution in measurements for precision assembly when the sizes of the parts involved exceed the field of view of the vision system,an image mosaic technique must be used.In this paper,a method for constructing an image mosaic with non-overlapping areas with enhanced efficiency is proposed.First,an image mosaic model for the part is created using a geometric model of the measurement system installed on a X-Y-Z precision stages with high repeatability,and a path for image acquisition is established.Second,images are captured along the same path for a specified calibration plate,and an entire image is formed based on the given model.The measurement results obtained from the specified calibration plate are utilized to identify mosaic errors and apply compensation for the part requiring measurement.Experimental results show that the maximum error is less than 4μm for a camera with pixel equivalent 2.46μm,thereby demonstrating the accuracy of the proposed method.This image mosaic technique with non-overlapping regions can simplify image acquisition and reduce the workload involved in constructing an image mosaic.
基金Supported by the National Natural Science Foundation of China(60905012)
文摘To improve the performance of the scale invariant feature transform ( SIFT), a modified SIFT (M-SIFT) descriptor is proposed to realize fast and robust key-point extraction and matching. In descriptor generation, 3 rotation-invariant concentric-ring grids around the key-point location are used instead of 16 square grids used in the original SIFT. Then, 10 orientations are accumulated for each grid, which results in a 30-dimension descriptor. In descriptor matching, rough rejection mismatches is proposed based on the difference of grey information between matching points. The per- formance of the proposed method is tested for image mosaic on simulated and real-worid images. Experimental results show that the M-SIFT descriptor inherits the SIFT' s ability of being invariant to image scale and rotation, illumination change and affine distortion. Besides the time cost of feature extraction is reduced by 50% compared with the original SIFT. And the rough rejection mismatches can reject at least 70% of mismatches. The results also demonstrate that the performance of the pro- posed M-SIFT method is superior to other improved SIFT methods in speed and robustness.
基金Supported by Construction of Key Disciplines in Shanghai (B503)
文摘Reverse engineering dealing with images is traditionally based on image processing and contour recognition. A new method is presented based on the combination of sectional slicing with image mosaic. Sectional contours of the target object are generated by colorful liquid or laser scanning, these images from different views are fused into a set of complete cross-sectional images, thereby the whole practical model is reconstructed in 3D space.
基金Supported by National Natural Science Foundation of China(No.11001017)
文摘This essay concentrates on two key procedures of image mosaic--image registration and imagefusion.Becauseof the character of geometric transformation invariance of edge points, wecalculate the angle difference of the direction vector ofedge points in different images anddraw an angle difference histogramto adjust the rotationproblem. Through this way, algorithm based on gray information is expandedandcan be used in images withdisplacementand rotation. Inthe term of image fusion, wavelet multi-scale analysis is used to fuse spliced images. In order to choose the best method of imagefusion,weevaluate the results of different methods of image fusion by cross entropy.
文摘To satisfy the requirements of real-time and high quality mosaics, a bionic compound eye visual system was designed by simulating the visual mechanism of a fly compound eye. Several CCD cameras were used in this system to imitate the small eyes of a compound eye. Based on the optical analysis of this system, a direct panoramic image mosaic algorithm was proposed. Several sub-images were collected by the bionic compound eye visual system, and then the system obtained the overlapping proportions of these sub-images and cut the overlap sections of the neighboring images. Thus, a panoramic image with a large field of view was directly mosaicked, which expanded the field and guaranteed the high resolution. The experimental results show that the time consumed by the direct mosaic algorithm is only 2.2% of that by the traditional image mosaic algorithm while guaranteeing mosaic quality. Furthermore, the proposed method effectively solved the problem of misalignment of the mosaic image and eliminated mosaic cracks as a result of the illumination factor and other factors. This method has better real-time properties compared to other methods.
文摘Fingerprint identification is one of the most important biometric authentication methods. However, current devices for recording digital fingerprints can only capture plain-touch fingerprints. Rolled fingerprints have much more information for recognition, so a method is needed to construct a rolled fingerprint from a series of plain-touch fingerprints. This paper presents a novel algorithm for image mosaicing for real time rolled fingerprint construction in which the images are assembled with corrections to create a smooth, non-fragmented rolled fingerprint in real time. Experimental results demonstrate its effectiveness by comparing it with other conventional algorithms.
基金supported by the National Natural Science Foundation of China (Nos.61906135, 62020106004 and 92048301)the Tianjin Science and Technology Plan Project (No.20JCQNJC01350)。
文摘We propose a video image mosaic method based on multi-module cooperation. This method stitches the video into a panorama with a large field of view, divided into three modules: the key frame selection module, the image mosaic module, and the optimization module. The key frame selection module obtains key frames by comprehensively evaluating the overlap rate and image quality. The image mosaic module stitches the key frames into a panoramic image to generate an initial mosaic result. The optimization module makes the mosaic result more natural and eliminates ghosts by using object detection advantages. Our method is tested on videos taken in real scenes, and the results have a more comprehensive and natural description.
文摘When locating the leakage of thermal field of a certain container, it is hard for us to evaluate the leakage with one or several separate thermal infrared images. Instead, panoramic imagery with a wide visual angle and high distinguishability is always needed. However, we can only get images for part of the scene because of the limited visual field of thermography and the large size of the measured object in practical. What is more, the hardware that can be used to get panoramic images is always expensive and cannot be used in large scale. Therefore, this paper introduces image mosaic technology, which can be used to get the intact thermal infrared image of the measured and increase the efficiency of detection. The experiment results demonstrate its effectiveness.
基金Supported by the National Natural Science Foundation of China(61502389)the Foundation Research Funds for Central University(3102015ZY047)
文摘Quality inspection of a PCB (Printed Circuit Board) always requires us to stitch some separated images into an integral one. However, during image acquisition, some environmental influences such as vibration, noise and illumination will cause image degradation. An efficient image mosaic method has been urgently required to obtain a high-quality PCB panorama. Hence, an image mosaic method based on Gaussian-Hermite moments is presented in this paper. The characteristic points in the neighborhood of a PCB are represented by Gaussian-Hermite moment in- variants. They are characterized by independence to translation or rotation transformations. Meanwhile, such feature representation shows better noise robustness. Experimental results show that the proposed method produces a qualified mosaic of PCB image.
基金The authors gratefully acknowledge the financial support from the National Key Research and Development Program of China(Grant No.2017YFD0700802)the National Natural Science Foundation of China(Grant No.51505156)the Earmarked Fund for Modern Agro-industry Technology Research System(Grant No.CARS-01-43).
文摘A machine vision based system to estimate the nursery plug tray sowing quantity is necessary in the rice seedling nursery.Because the super hybrid rice is of small diameter,in order to obtain better estimation results of sowing quantity,only part of the tray scene is captured by machine vision system.Therefore,nursery tray image sequence mosaic algorithm is required so as to obtain the whole nursery tray sowing performance.In this paper,a fast nursery plug tray image mosaic technique based on Phase Correlation and Speeded up Robust Features(the PC-SURF)algorithm was introduced.To reduce huge computational complexity in feature extraction and avoid wrong match points from non-overlapping regions between two adjacent images,firstly the proposed method used Phase Correlation to approximately locate the overlapping regions between two sequential images so as to narrow down the processing area for further feature extraction.Then,the SURF algorithm was implemented in the overlapping region of the images to perform image registration and image blending.Image registration and blending were then performed using the RANSAC algorithm and transition smoothing method.Finally,sequential images were warped into a single frame to produce a panoramic tray image with high resolution and better quality.The test results showed that the PC-SURF algorithm greatly outperforms the SURF algorithm in point matching accuracy,time consumption,and image mosaic accuracy.The average feature point matching accuracy of the PC-SURF algorithm was improved by approximately 7.14%.The implementation time was almost three times faster.The Root Mean Squared Error(RMSE)of image blending in the R,G,B channels(RMSEr,RMSEg,and RMSEb)decreased by approximately 8.4%,6.9%,6.9%respectively.The RMSE of image registration RMSEreg decreased by 33.8%.In addition,the speed of the nursery tray image mosaic technology could meet the requirements for real-time implementation in super hybrid rice automated sowing machines.