Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board f...Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.展开更多
Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube's endpoints and then ...Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube's endpoints and then fix any geometric errors correspondingly. However, the traditional tube inspection method is time-consuming and complex operations. Therefore, a new measurement method for a tube's endpoints based on machine vision is proposed. First, reflected light on tube's surface can be removed by using photometric linearization. Then, based on the optimization model for the tube's endpoint measurements and the principle of stereo matching, the global coordinates and the relative distance of the tube's endpoint are obtained. To confirm the feasibility, ll tubes are processed to remove the reflected light and then the endpoint's positions of tubes are measured. The experiment results show that the measurement repeatability accuracy is 0.167 mm, and the absolute accuracy is 0.328 ram. The measurement takes less than 1 min. The proposed method based on machine vision can measure the tube's endpoints without any surface treatment or any tools and can realize on line measurement.展开更多
When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of mate...When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of material properties on the flow can be characterized. A machine vision based system to measure the contact angle of front or rear menisci of a moving liquid plug is described in this article. In this research, transparent flow channels fabricated on thermoplastic polymer and sealed with an adhesive tape are used. The transparency of the channels enables image based monitoring and measurement of flow variables, including the dynamic contact angle. It is shown that the dynamic angle can be measured from a liquid flow in a channel using the image based measurement system. An image processing algorithm has been developed in a MATLAB environment. Images are taken using a CCD camera and the channels are illuminated using a custom made ring light. Two fitting methods, a circle and two parabolas, are experimented and the results are compared in the measurement of the dynamic contact angles.展开更多
Common displays such as CRT or LCD screens have limited capabilities in displaying most color spectra correctly. The main disadvantage of these devices is that they work with three primaries and the colors displayed a...Common displays such as CRT or LCD screens have limited capabilities in displaying most color spectra correctly. The main disadvantage of these devices is that they work with three primaries and the colors displayed are the mixture of these three colours. Consequently these devices can be confusing in testing human color identification, because the spectral distribution of the colors displayed is the combined spectrum of the three primaries. We have developed a new instrument for spectrally correct color vision measurement. This instrument uses light emitting diodes (LEDs) and is capable of producing all spectra of perceivable colors, thus with appropriate test methods this instrument can be a reliable and useful tool in test~ing human color vision and in verifying color vision correction.展开更多
In this paper,we present a robot vision based system for coordinate measurement of feature points on large scale automobile parts.Our system consists of an industrial 6-DOF robot mounted with a CCD camera and a PC.The...In this paper,we present a robot vision based system for coordinate measurement of feature points on large scale automobile parts.Our system consists of an industrial 6-DOF robot mounted with a CCD camera and a PC.The system controls the robot into the area of feature points.The images of measuring feature points are acquired by the camera mounted on the robot.3D positions of the feature points are obtained from a model based pose estimation that applies to the images.The measured positions of all feature points are then transformed to the reference coordinate of feature points whose positions are obtained from the coordinate measuring machine(CMM).Finally,the point-to-point distances between the measured feature points and the reference feature points are calculated and reported.The results show that the root mean square error(RMSE) of measure values obtained by our system is less than 0.5 mm.Our system is adequate for automobile assembly and can perform faster than conventional methods.展开更多
A new vision coordinate measuring system--single camera 3 D coordinate measuring system based on optical probe imaging is presented. A new idea in vision coordinate measurement is proposed. A linear model is deduced w...A new vision coordinate measuring system--single camera 3 D coordinate measuring system based on optical probe imaging is presented. A new idea in vision coordinate measurement is proposed. A linear model is deduced which can distinguish six freedom degrees of optical probe to realize coordinate measurement of the object surface. The effects of some factors on the resolution of the system are analyzed. The simulating experiments have shown that the system model is available.展开更多
The working processes, machining devices and tools, cutting amount, consumption of materials, productivity and quality of products are directly affected by wood surface roughness. This paper gives an extensive review ...The working processes, machining devices and tools, cutting amount, consumption of materials, productivity and quality of products are directly affected by wood surface roughness. This paper gives an extensive review of methods used previously to measure wood surface roughness, and concludes that computer vision is the most suitable technique. The preliminary study shows that computer vision method has the advantages of a noncontact, three-dimensional measurement, high speed and well correlates with stylus tracing method. This method can be used in classification and in-time measurement of wood surface roughness after being improved.展开更多
A lower bound to errors of measuring object position is constructed as a function of parameters of a monocular computer vision system (CVS) as well as of observation conditions and a shape of an observed marker. This ...A lower bound to errors of measuring object position is constructed as a function of parameters of a monocular computer vision system (CVS) as well as of observation conditions and a shape of an observed marker. This bound justifies the specification of the CVS parameters and allows us to formulate constraints for an object trajectory based on required measurement accuracy. For making the measurement, the boundaries of marker image are used.展开更多
The accurate measurement of kinematic parameters in satellite separation tests has great significance in evaluating separation performance. A novel study is made on the measuring accuracy of monocular and binocular, w...The accurate measurement of kinematic parameters in satellite separation tests has great significance in evaluating separation performance. A novel study is made on the measuring accuracy of monocular and binocular, which are the two main vision measurement methods used for kinematic parameters. As satellite separation process is transient and high-dynamic, it will bring more extraction errors to the binocular. Based on the design approach of intersection measure and variance ratio, the monocular method reflects higher precision, simpler structure and easier calibration for level satellite separation. In ground separation tests, a high-speed monocular system is developed to gain and analyze twelve kinematic parameters of a small satellite. Research shows that this monocular method can be widely applied for its high precision, with position accuracy of 0.5 mm, speed accuracy of 5 mm/s, and angular velocity accuracy of 1 (°)/s.展开更多
Microscopic vision has been widely applied in precision assembly.To achieve sufficiently high resolution in measurements for precision assembly when the sizes of the parts involved exceed the field of view of the visi...Microscopic vision has been widely applied in precision assembly.To achieve sufficiently high resolution in measurements for precision assembly when the sizes of the parts involved exceed the field of view of the vision system,an image mosaic technique must be used.In this paper,a method for constructing an image mosaic with non-overlapping areas with enhanced efficiency is proposed.First,an image mosaic model for the part is created using a geometric model of the measurement system installed on a X-Y-Z precision stages with high repeatability,and a path for image acquisition is established.Second,images are captured along the same path for a specified calibration plate,and an entire image is formed based on the given model.The measurement results obtained from the specified calibration plate are utilized to identify mosaic errors and apply compensation for the part requiring measurement.Experimental results show that the maximum error is less than 4μm for a camera with pixel equivalent 2.46μm,thereby demonstrating the accuracy of the proposed method.This image mosaic technique with non-overlapping regions can simplify image acquisition and reduce the workload involved in constructing an image mosaic.展开更多
Although convolutional neural networks have become the mainstream segmentation model,the locality of convolution makes them cannot well learn global and long-range semantic information.To further improve the performan...Although convolutional neural networks have become the mainstream segmentation model,the locality of convolution makes them cannot well learn global and long-range semantic information.To further improve the performance of segmentation models,we propose U-shaped vision Transformer(UsViT),a model based on Transformer and convolution.Specifically,residual Transformer blocks are designed in the encoder of UsViT,which take advantages of residual network and Transformer backbone at the same time.What is more,transpositions in each Transformer layer achieve the information interaction between spatial locations and feature channels,enhancing the capability of feature learning.In the decoder,for enhancing receptive field,different dilation rates are introduced to each convolutional layer.In addition,residual connections are applied to make the information propagation smoother when training the model.We first verify the superiority of UsViT on automatic portrait matting public dataset,which achieves 90.43%accuracy(Acc),95.56%Dice similarity coefficient,and 94.66%Intersection over Union with relatively fewer parameters.Finally,UsViT is applied to gear pitting measurement in gear contact fatigue test,and the comparative results indicate that UsViT can improve the Acc of pitting detection.展开更多
Single-camera mobile-vision coordinate measurement is one of the primary methods of 3D-coordinate vision measurement, and coded target plays an important role in this system. A multifunctional coded target and its rec...Single-camera mobile-vision coordinate measurement is one of the primary methods of 3D-coordinate vision measurement, and coded target plays an important role in this system. A multifunctional coded target and its recognition algorithm is developed, which can realize automatic match of feature points, calculation of camera initial exterior orientation and space scale factor constraint in measurement system. The uniqueness and scalability of coding are guaranteed by the rational arrangement of code bits. The recognition of coded targets is realized by cross-ratio invariance restriction, space coordinates transform of feature points based on spacial pose estimation algorithm, recognition of code bits and computation of coding values. The experiment results demonstrate the uniqueness of the coding form and the reliability of recognition.展开更多
This research introduces a challenge in integrating and cleaning the data,which is a crucial task in object matching.While the object is detected and then measured,the vibration at different light intensities may influ...This research introduces a challenge in integrating and cleaning the data,which is a crucial task in object matching.While the object is detected and then measured,the vibration at different light intensities may influence the durability and reliability of mechanical systems or structures and cause problems such as damage,abnormal stopping,and disaster.Recent research failed to improve the accuracy rate and the computation time in tracking an object and in the vibration measurement.To solve all these problems,this proposed research simplifies the scaling factor determination by assigning a known real-world dimension to a predetermined portion of the image.A novel white color sticker of the known dimensions marked with a color dot is pasted on the surface of an object for the best result in the template matching using the Improved Up-Sampled Cross-Correlation(UCC)algorithm.The vibration measurement is calculated using the Finite-Difference Algorithm(FDA),a machine vision systemfitted with a macro lens sensor that is capable of capturing the image at a closer range,which does not affect the quality of displacement measurement from the video frames.Thefield test was conducted on the TAFE(Tractors and Farm Equipment Limited)tractor parts,and the percentage of error was recorded between 30%and 50%at very low vibration values close to zero,whereas it was recorded between 5%and 10%error in most high-accelerations,the essential range for vibration analysis.Finally,the suggested system is more suitable for measuring the vibration of stationary machinery having low frequency ranges.The use of a macro lens enables to capture of image frames at very close-ups.A 30%to 50%error percentage has been reported when the vibration amplitude is very small.Therefore,this study is not suitable for Nano vibration analysis.展开更多
单目三维视觉测量在视觉测量领域具有低成本、简便性、结构紧凑等优势,是以智能化、网络化制造为特征的先进制造典型技术之一。经过不断发展,单目三维视觉测量技术已成功应用于无人机导航、智能机器人、工业检测、医疗健康等领域,如今...单目三维视觉测量在视觉测量领域具有低成本、简便性、结构紧凑等优势,是以智能化、网络化制造为特征的先进制造典型技术之一。经过不断发展,单目三维视觉测量技术已成功应用于无人机导航、智能机器人、工业检测、医疗健康等领域,如今呈现出精准化、快捷化、微型化、自动化、动态化等发展趋势。以孔径数量为标准,将单目三维视觉测量技术分为单孔径及多孔径两大类,分别综述两类方法的研究现状和发展历程,重点论述了应用较广的运动恢复结构法(Structure From Motion,SFM)和光场三维测量方法,并对单目三维视觉测量技术的未来方向进行了展望。展开更多
基金Project supported by the National Science Fund for Distinguished Young Scholars(Grant No.T2125014)the Special Fund for Research on National Major Research Instruments of the National Natural Science Foundation of China(Grant No.11927808)the CAS Key Technology Research and Development Team Project(Grant No.GJJSTD20200005)。
文摘Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.
基金Supported by National Natural Science Foundation of China(Grant No51305031)
文摘Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube's endpoints and then fix any geometric errors correspondingly. However, the traditional tube inspection method is time-consuming and complex operations. Therefore, a new measurement method for a tube's endpoints based on machine vision is proposed. First, reflected light on tube's surface can be removed by using photometric linearization. Then, based on the optimization model for the tube's endpoint measurements and the principle of stereo matching, the global coordinates and the relative distance of the tube's endpoint are obtained. To confirm the feasibility, ll tubes are processed to remove the reflected light and then the endpoint's positions of tubes are measured. The experiment results show that the measurement repeatability accuracy is 0.167 mm, and the absolute accuracy is 0.328 ram. The measurement takes less than 1 min. The proposed method based on machine vision can measure the tube's endpoints without any surface treatment or any tools and can realize on line measurement.
基金This research was done as part of TEKES-funded PanFlow project and as part of a project OPTIMI funded by the Academy of Finland (grant number 117587) in Micro- and Nanosystems Research Group, Tampere University of Technology, Finland.
文摘When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of material properties on the flow can be characterized. A machine vision based system to measure the contact angle of front or rear menisci of a moving liquid plug is described in this article. In this research, transparent flow channels fabricated on thermoplastic polymer and sealed with an adhesive tape are used. The transparency of the channels enables image based monitoring and measurement of flow variables, including the dynamic contact angle. It is shown that the dynamic angle can be measured from a liquid flow in a channel using the image based measurement system. An image processing algorithm has been developed in a MATLAB environment. Images are taken using a CCD camera and the channels are illuminated using a custom made ring light. Two fitting methods, a circle and two parabolas, are experimented and the results are compared in the measurement of the dynamic contact angles.
文摘Common displays such as CRT or LCD screens have limited capabilities in displaying most color spectra correctly. The main disadvantage of these devices is that they work with three primaries and the colors displayed are the mixture of these three colours. Consequently these devices can be confusing in testing human color identification, because the spectral distribution of the colors displayed is the combined spectrum of the three primaries. We have developed a new instrument for spectrally correct color vision measurement. This instrument uses light emitting diodes (LEDs) and is capable of producing all spectra of perceivable colors, thus with appropriate test methods this instrument can be a reliable and useful tool in test~ing human color vision and in verifying color vision correction.
基金wsupported by the Thailand Research Fund and Solimac Automation Co.,Ltd.under the Research and Researchers for Industry Program(RRI)under Grant No.MSD56I0098Office of the Higher Education Commission under the National Research University Project of Thailand
文摘In this paper,we present a robot vision based system for coordinate measurement of feature points on large scale automobile parts.Our system consists of an industrial 6-DOF robot mounted with a CCD camera and a PC.The system controls the robot into the area of feature points.The images of measuring feature points are acquired by the camera mounted on the robot.3D positions of the feature points are obtained from a model based pose estimation that applies to the images.The measured positions of all feature points are then transformed to the reference coordinate of feature points whose positions are obtained from the coordinate measuring machine(CMM).Finally,the point-to-point distances between the measured feature points and the reference feature points are calculated and reported.The results show that the root mean square error(RMSE) of measure values obtained by our system is less than 0.5 mm.Our system is adequate for automobile assembly and can perform faster than conventional methods.
文摘A new vision coordinate measuring system--single camera 3 D coordinate measuring system based on optical probe imaging is presented. A new idea in vision coordinate measurement is proposed. A linear model is deduced which can distinguish six freedom degrees of optical probe to realize coordinate measurement of the object surface. The effects of some factors on the resolution of the system are analyzed. The simulating experiments have shown that the system model is available.
文摘The working processes, machining devices and tools, cutting amount, consumption of materials, productivity and quality of products are directly affected by wood surface roughness. This paper gives an extensive review of methods used previously to measure wood surface roughness, and concludes that computer vision is the most suitable technique. The preliminary study shows that computer vision method has the advantages of a noncontact, three-dimensional measurement, high speed and well correlates with stylus tracing method. This method can be used in classification and in-time measurement of wood surface roughness after being improved.
文摘A lower bound to errors of measuring object position is constructed as a function of parameters of a monocular computer vision system (CVS) as well as of observation conditions and a shape of an observed marker. This bound justifies the specification of the CVS parameters and allows us to formulate constraints for an object trajectory based on required measurement accuracy. For making the measurement, the boundaries of marker image are used.
基金Project(50975280)supported by the National Natural Science Foundation of ChinaProject(NCET-08-0149)supported by Program for New Century Excellent Talents in Universities of China
文摘The accurate measurement of kinematic parameters in satellite separation tests has great significance in evaluating separation performance. A novel study is made on the measuring accuracy of monocular and binocular, which are the two main vision measurement methods used for kinematic parameters. As satellite separation process is transient and high-dynamic, it will bring more extraction errors to the binocular. Based on the design approach of intersection measure and variance ratio, the monocular method reflects higher precision, simpler structure and easier calibration for level satellite separation. In ground separation tests, a high-speed monocular system is developed to gain and analyze twelve kinematic parameters of a small satellite. Research shows that this monocular method can be widely applied for its high precision, with position accuracy of 0.5 mm, speed accuracy of 5 mm/s, and angular velocity accuracy of 1 (°)/s.
基金supported by the Liaoning Revitalization Talents Program(Grant No.XLYC2002020)the Major Project of Basic Scientific Research of Chinese Ministry(Grant No.JCYK2016205A003).
文摘Microscopic vision has been widely applied in precision assembly.To achieve sufficiently high resolution in measurements for precision assembly when the sizes of the parts involved exceed the field of view of the vision system,an image mosaic technique must be used.In this paper,a method for constructing an image mosaic with non-overlapping areas with enhanced efficiency is proposed.First,an image mosaic model for the part is created using a geometric model of the measurement system installed on a X-Y-Z precision stages with high repeatability,and a path for image acquisition is established.Second,images are captured along the same path for a specified calibration plate,and an entire image is formed based on the given model.The measurement results obtained from the specified calibration plate are utilized to identify mosaic errors and apply compensation for the part requiring measurement.Experimental results show that the maximum error is less than 4μm for a camera with pixel equivalent 2.46μm,thereby demonstrating the accuracy of the proposed method.This image mosaic technique with non-overlapping regions can simplify image acquisition and reduce the workload involved in constructing an image mosaic.
基金supported in part by National Natural Science Foundation of China under Grants 62033001 and 52175075.
文摘Although convolutional neural networks have become the mainstream segmentation model,the locality of convolution makes them cannot well learn global and long-range semantic information.To further improve the performance of segmentation models,we propose U-shaped vision Transformer(UsViT),a model based on Transformer and convolution.Specifically,residual Transformer blocks are designed in the encoder of UsViT,which take advantages of residual network and Transformer backbone at the same time.What is more,transpositions in each Transformer layer achieve the information interaction between spatial locations and feature channels,enhancing the capability of feature learning.In the decoder,for enhancing receptive field,different dilation rates are introduced to each convolutional layer.In addition,residual connections are applied to make the information propagation smoother when training the model.We first verify the superiority of UsViT on automatic portrait matting public dataset,which achieves 90.43%accuracy(Acc),95.56%Dice similarity coefficient,and 94.66%Intersection over Union with relatively fewer parameters.Finally,UsViT is applied to gear pitting measurement in gear contact fatigue test,and the comparative results indicate that UsViT can improve the Acc of pitting detection.
文摘Single-camera mobile-vision coordinate measurement is one of the primary methods of 3D-coordinate vision measurement, and coded target plays an important role in this system. A multifunctional coded target and its recognition algorithm is developed, which can realize automatic match of feature points, calculation of camera initial exterior orientation and space scale factor constraint in measurement system. The uniqueness and scalability of coding are guaranteed by the rational arrangement of code bits. The recognition of coded targets is realized by cross-ratio invariance restriction, space coordinates transform of feature points based on spacial pose estimation algorithm, recognition of code bits and computation of coding values. The experiment results demonstrate the uniqueness of the coding form and the reliability of recognition.
文摘This research introduces a challenge in integrating and cleaning the data,which is a crucial task in object matching.While the object is detected and then measured,the vibration at different light intensities may influence the durability and reliability of mechanical systems or structures and cause problems such as damage,abnormal stopping,and disaster.Recent research failed to improve the accuracy rate and the computation time in tracking an object and in the vibration measurement.To solve all these problems,this proposed research simplifies the scaling factor determination by assigning a known real-world dimension to a predetermined portion of the image.A novel white color sticker of the known dimensions marked with a color dot is pasted on the surface of an object for the best result in the template matching using the Improved Up-Sampled Cross-Correlation(UCC)algorithm.The vibration measurement is calculated using the Finite-Difference Algorithm(FDA),a machine vision systemfitted with a macro lens sensor that is capable of capturing the image at a closer range,which does not affect the quality of displacement measurement from the video frames.Thefield test was conducted on the TAFE(Tractors and Farm Equipment Limited)tractor parts,and the percentage of error was recorded between 30%and 50%at very low vibration values close to zero,whereas it was recorded between 5%and 10%error in most high-accelerations,the essential range for vibration analysis.Finally,the suggested system is more suitable for measuring the vibration of stationary machinery having low frequency ranges.The use of a macro lens enables to capture of image frames at very close-ups.A 30%to 50%error percentage has been reported when the vibration amplitude is very small.Therefore,this study is not suitable for Nano vibration analysis.
文摘单目三维视觉测量在视觉测量领域具有低成本、简便性、结构紧凑等优势,是以智能化、网络化制造为特征的先进制造典型技术之一。经过不断发展,单目三维视觉测量技术已成功应用于无人机导航、智能机器人、工业检测、医疗健康等领域,如今呈现出精准化、快捷化、微型化、自动化、动态化等发展趋势。以孔径数量为标准,将单目三维视觉测量技术分为单孔径及多孔径两大类,分别综述两类方法的研究现状和发展历程,重点论述了应用较广的运动恢复结构法(Structure From Motion,SFM)和光场三维测量方法,并对单目三维视觉测量技术的未来方向进行了展望。