Fringe Projection Measurement System in Reverse Engineering

Acquisition of physical data with high precision is a key step in reverse engineering (RE). It is an important stimulative for the progress of reverse engineering with which various digitizing devices are invent ed, developed and made applicable. This paper introduces a three dimensional opt ical measurement method based on digital fringe projection technique in RE to im prove the technique through its application. A practical example is presented an d the result demonstrates the applicability and feasibility of the measurement s ystem as well as the reliability and validity of relevant methods and algorithms .

A study of making use of computer-aided projection fringe system to measure breast dimension

To measure breast basic dimension by using computer-aided projection fringe system.Methods A system has been developed for measuring breast basic dimension based on computer-aided projection fringe measurement and programming software.Plastic manikins breast’s SN-N (sternal notch to nipple distance),N-ML (nipple to midline distance),N-N (internipple distance),MBW (base width of breast) and N-IMF (nipple to inframammary fold distance) are measured with this system.At the same time,these items are also measured with routine ruler.Results This study indicate that the system has some merits:① non-touching measurement;② it is very rapid,the patient measured need hold his breath only 0.5 second,and all the time it takes is about 2.5 minutes;③ the measurement’s sensitivity is as high as to 0.6 mm,which meets the clinic requirement entirely;④ the measurement’s accuracy of the system is not significantly when comparing to the routine ruler’s.Conclusion Computer-adided projection fringe system for measuring breast basic dimension is feasible and advanced.14 refs,1 fig.

Systematic Radio Telescope Alignment Using Portable Fringe Projection Profilometry

In 2019,the Event Horizon Telescope(EHT)released the first-ever image of a black hole event horizon.Astronomers are now aiming for higher angular resolutions of distant targets,like black holes,to understand more about the fundamental laws of gravity that govern our universe.To achieve this higher resolution and increased sensitivity,larger radio telescopes are needed to operate at higher frequencies and in larger quantities.Projects like the next-generation Very Large Array(ngVLA)and the Square-Kilometer Array(SKA)require building hundreds of telescopes with diameters greater than 10 ms over the next decade.This has a twofold effect.Radio telescope surfaces need to be more accurate to operate at higher frequencies,and the logistics involved in maintaining a radio telescope need to be simplified to support them properly in large quantities.Both of these problems can be solved with improved methods for surface metrology that are faster and more accurate with a higher resolution.This leads to faster and more accurate panel alignment and,therefore,a more productive observatory.In this paper,we present the use of binocular fringe projection profilometry as a solution to this problem and demonstrate it by aligning two panels on a 3-m radio telescope dish.The measurement takes only 10 min and directly delivers feedback on the tip,tilt,and piston of each panel to create the ideal reflector shape.

Research and development of fringe projection-based methods in 3D shape reconstruction

This paper discusses current research and development of fringe projection-based techniques. A system based on Fourier transform profilometry (FTP) is proposed for three-dimensional (3D) shape recovery. The system improves the method of phase unwrapping to gain accurate 3D shapes of objects. The method uses a region-growing algorithm for the path prediction guided by the quality map to increase the recovering accuracy and provides a fast and simple tool for 3D shape recovery. The shape measurement and data recovery are integrated to offer a new method of 3D modelling. Examples are presented to verify the feasibility of the proposed method.

Deep-learning-enabled dual-frequency composite fringe projection profilometry for single-shot absolute 3D shape measurement

Single-shot high-speed 3D imaging is important for reconstructions of dynamic objects.For fringe projection profilometry(FPP),however,it is still challenging to recover accurate 3D shapes of isolated objects by a single fringe image.In this paper,we demonstrate that the deep neural networks can be trained to directly recover the absolute phase from a unique fringe image that involves spatially multiplexed fringe patterns of different frequencies.The extracted phase is free from spectrum-aliasing problem which is hard to avoid for traditional spatial-multiplexing methods.Experiments on both static and dynamic scenes show that the proposed approach is robust to object motion and can obtain high-quality 3D reconstructions of isolated objects within a single fringe image.

A convenient look-up-table based method for the compensation of non-linear error in digital fringe projection

Although the structured light system that uses digital fringe projection has been widely implemented in three-dimensional surface profile measurement, the measurement system is susceptible to non-linear error. In this work, we propose a convenient look-up-table-based （LUT-based） method to compensate for the non-linear error in captured fringe patterns. Without extra calibration, this LUT-based method completely utilizes the captured fringe pattern by recording the full-field differences. Then, a phase compensation map is established to revise the measured phase. Experimental results demonstrate that this method works effectively.

Measuring the kinematics of a free-flying hawk-moth(Macroglossum stellatarum)by a comb-fringe projection method

We describe a 2D fringe projection method that involves projecting two groups of sharp comb fringes onto a free-flying hawk-moth from different directions and recording the images of distorted fringes by two high speed cameras from two orthogonal views. By calculating the 3D coordinates of the points on the hawk-moth and three-dimensional reconstruction of the wing, the flight trajectory, body attitude and wing kinematics including flapping angle, elevation angle, torsion angle, and camber deformation are obtained.

Phase unwrapping based on deep learning in light field fringe projection 3D measurement

Phase unwrapping is one of the key roles in fringe projection three-dimensional(3D)measurement technology.We propose a new method to achieve phase unwrapping in camera array light filed fringe projection 3D measurement based on deep learning.A multi-stream convolutional neural network(CNN)is proposed to learn the mapping relationship between camera array light filed wrapped phases and fringe orders of the expected central view,and is used to predict the fringe order to achieve the phase unwrapping.Experiments are performed on the light field fringe projection data generated by the simulated camera array fringe projection measurement system in Blender and by the experimental 3×3 camera array light field fringe projection system.The performance of the proposed network with light field wrapped phases using multiple directions as network input data is studied,and the advantages of phase unwrapping based on deep learning in light filed fringe projection are demonstrated.

High-speed three-dimensional shape measurement with inner shifting-phase fringe projection profilometry

Fringe projection profilometry(FPP)has been extensively studied in the field of three-dimensional(3D)measurement.Although FPP always uses high-frequency fringes to ensure high measurement accuracy,too many patterns are projected to unwrap the phase,which affects the speed of 3D reconstruction.We propose a high-speed 3D shape measurement method using only three high-frequency inner shifting-phase patterns(70 periods),which satisfies both high precision and high measuring speed requirements.Besides,our proposed method obtains the wrapped phase and the fringe order simultaneously without any other information and constraints.The proposed method has successfully reconstructed moving objects with high speed at the camera's full frame rate(1700 frames per second).

A correction method of color projection fringes in 3D contour measurement

In the three-dimensional(3D) contour measurement,the phase shift profilometry(PSP) method is the most widely used one.However,the measurement speed of PSP is very low because of the multiple projections.In order to improve the measurement speed,color grating stripes are used for measurement in this paper.During the measurement,only one color sinusoidal fringe is projected on the measured object.Therefore,the measurement speed is greatly improved.Since there is coupling or interference phenomenon between the adjacent color grating stripes,a color correction method is used to improve the measurement results.A method for correcting nonlinear error of measurement system is proposed in this paper,and the sinusoidal property of acquired image after correction is better than that before correction.Experimental results show that with these correction methods,the measurement errors can be reduced.Therefore,it can support a good foundation for the high-precision 3D reconstruction.

MULTIPARAMETER MEASUREMENT FOR RACEWAY GROOVE OF BEARING BASED ON 3D RECONSTRUCTION WITH DIGITAL STRUCTURED LIGHT

A fast 3D reconstruction method based on structured light to measure various parameters of the raceway groove is presented. Digital parallel grating stripes distributed with sine density are projected onto the raceway groove by a DLP projector, and distorting of stripes is happened on the raceway. Simultaneously, aided by three-step phase-shifting approach, three images covered by different stripes are obtained by a high-resolution CCD camera at the same location, thus a more accuracy local topography can be obtained. And then the bearing is rotated on a high precision computer controlled rotational stage. Three images are also obtained as the former step at next planned location triggered by the motor. After one cycle, all images information is combined through the mosaics. As a result, the 3D information of raceway groove can be gained. Not only geometric properties but also surface flaws can be extracted by software. A preliminary hardware system has been built, with which some geometric parameters have been extracted from reconstructed local topography.

A 3D measurement method based on multi-view fringe projection by using a turntable

In order to get the entire data in the optical measurement, a multi-view three-dimensional(3D) measurement method based on turntable is proposed. In the method, a turntable is used to rotate the object and obtain multi-view point cloud data, and then multi-view point cloud data are registered and integrated into a 3D model. The measurement results are compared with that of the sticking marked point method. Experimental results show that the measurement process of the proposed method is simpler, and the scanning speed and accuracy are improved.

Measurement on Camber Deformation of Wings of Free-flying Dragonflies and Beating-flying Dragonflies

The knowledge of wing orientation and deformation during flapping flight is necessary for a complete aerodynamic analysis, but to date those kinematic features have not been simultaneously quantified for free-flying insects. A projected comb-fringe (PCF) method has been developed for measuring spanwise camber changes on free-flying dragonflies and on beating-flying dragonflies through the course of a wingbeat, which bases on projecting a fringe pattern over the whole measurement area and then measuring the wing deformation from the distorted fringe pattern. Experimental results demonstrate substantial camber changes both along the wingspan and through the course of a wingbeat. The ratio of camber deformation to chord length for hind wing is up to 0.11 at 75% spanwise with a flapping angle of -0.66 degree for a free-flying dragonfly.

Recent Progress of Full‑Field Three‑Dimensional Shape Measurement Based on Phase Information

Full-field three-dimensional(3D)measurement technology based on phase information has become an indispensable part of geometric dimension measurement in modern scientific research and engineering applications.This field has been developing and evolving for the study of highly reflective phenomena,diffuse reflections,and specular surfaces,and many novel methods have emerged to increase the speed of measurements,enhance data accuracy,and broaden the robustness of the system.Herein,we will discuss the latest research progress in full-field 3D shape measurement based on phase information systematically and comprehensively.First,the fundamentals of 3D shape measurement based on phase information are introduced,namely,phase-shifting and transform-based methods.Second,recent technological innovations are highlighted,including increases in measurement speed and automation and improvements in robustness in complex environments.In particular,the challenges faced by these technological advances in solving highly dynamic,composite surface measurement problems are presented,i.e.,with multiexposure techniques proposed for high dynamics that extend the dynamic range of the camera to reduce the effects of overexposure but increase the cost of time and have high hardware requirements,fringe adaptive techniques that overcome light variations but are computationally complex,and multipolarized camera techniques that reduce the effects of light variations but are sensitive to the light source.Third,the phase-shifting method combined with coding is proposed to improve the measurement speed,but the accuracy is slightly reduced.Deep learning techniques are proposed to cope with measurements in complex environments,but the dataset computation process is cumbersome.Finally,future research directions are suggested,and the challenges are presented.Overall,this work provides a reference for researchers and engineers.

Dual-frequency fringe for improving measurement accuracy of three-dimensional shape measurement

A new phase unwrapping method based on dual-frequency fringe is proposed to improve both high accuracy and large measurement range of three-dimensional shape measurement by synthesizing the projected dual-frequency fringes obtaining higher and lower frequencies.The lower-frequency one is their phase difference,which can help unwrap the wrapped phase of the higher-frequency one from their phase sum.In addition,the relationship between the measuring accuracy and the frequencies of the projected fringes is studied to guide the frequency selection in actual measurement.It is found that the closer the two frequencies are,the higher the measurement accuracy will be.The computer simulation and experiment results show the viability of this method.

A Novel Method for Human Expression Rapid Reconstruction

Human expression rapid reconstruction has many potential applications in entertainment and social security. In this work, a rapid human expression measurement system based on a digital fringe projection and phase-shift technique is developed. The measurement system consists of a digital light processing (DLP) projector and a high-speed change-coupled device (CCD) camera. The DLP projector is used to project computer-generated fringe patterns onto the human face, and the high-speed CCD camera synchronized with the projector acquires the fringe images at a frame rate of 30 frames/s. Based on a three-step phase-shifting method and an accurate phase-height mapping algorithm, each frame of the 3-D human expression can be reconstructed. The principle of the proposed method is described and some experimental results are presented to demonstrate its performance. The experiment results show that the measurement system can reconstruct accurate 3-D human expression. An obvious merit of this method is that it can reconstruct the 3-D human expression in a very short time and it is not sensitive to the movement of the face during the measurement processing.

Ultra-high speed holographic shape and displacement measurements in the hearing sciences

The auditory system of mammals enables the perception of sound from our surrounding world.Containing some of the smallest bones in the body,the ear transduces complex acoustic signals with high-temporal sensitivity to complex mechanical vibrations with magnitudes as small as tens of picometers.Measurements of the shape and acoustically induced motions of different components of the ear are essential if we are to expand our understanding of hearing mechanisms,and also provide quantitative information for the development of numerical ear models that can be used to improve hearing protection,clinical diagnosis,and repair of damaged or diseased ears.We are developing digital holographic methods and instrumentation using an ultra-high speed camera to measure shape and acoustically-induced motions in the middle ear.Specifically we study the eardrum,the first structure of the middle ear which initializes the acoustic-mechanical transduction of sound for hearing.Our measurement system is capable of performing holographic measurement at rates up to 2.1 M frames per second.Two shape measurement modalities had previously been implemented into our holographic systems:(1)a multi-wavelength method with a wavelength tunable laser;and(2)a multi-angle illumination method with a single wavelength laser.In this paper,we present a third method using a miniaturized fringe projection system with a microelectromechanical system(MEMS)mirror.Further,we optimize the processing of large data sets of holographic displacement measurements using a vectorized Pearson's correlation algorithm.We validate and compare the shape and displacement measurements of our methodologies using a National Institute of Standards and Technology(NIST)traceable gauge and sound-activated latex membranes and human eardrums.

Generative deep-learning-embedded asynchronous structured light for three-dimensional imaging

Three-dimensional(3D)imaging with structured light is crucial in diverse scenarios,ranging from intelligent manufacturing and medicine to entertainment.However,current structured light methods rely on projector-camera synchronization,limiting the use of affordable imaging devices and their consumer applications.In this work,we introduce an asynchronous structured light imaging approach based on generative deep neural networks to relax the synchronization constraint,accomplishing the challenges of fringe pattern aliasing,without relying on any a priori constraint of the projection system.To overcome this need,we propose a generative deep neural network with U-Net-like encoder-decoder architecture to learn the underlying fringe features directly by exploring the intrinsic prior principles in the fringe pattern aliasing.We train within an adversarial learning framework and supervise the network training via a statisticsinformed loss function.We demonstrate that by evaluating the performance on fields of intensity,phase,and 3D reconstruction.It is shown that the trained network can separate aliased fringe patterns for producing comparable results with the synchronous one:the absolute error is no greater than 8μm,and the standard deviation does not exceed 3μm.Evaluation results on multiple objects and pattern types show it could be generalized for any asynchronous structured light scene.