To enhance the applicability and measurement accuracy of phase-based optical flow method using complex steerable pyramids in structural displacement measurement engineering applications, an improved method of optimizi...To enhance the applicability and measurement accuracy of phase-based optical flow method using complex steerable pyramids in structural displacement measurement engineering applications, an improved method of optimizing parameter settings is proposed. The optimized parameters include the best measurement points of the Region of Interest (ROI) and the levels of pyramid filters. Additionally, to address the issue of updating reference frames in practical applications due to the difficulty in estimating the maximum effective measurement value, a mechanism for dynamically updating reference frames is introduced. Experimental results demonstrate that compared to representative image gradient-based displacement measurement methods, the proposed method exhibits higher measurement accuracy in engineering applications. This provides reliable data support for structural damage identification research based on vibration signals and is expected to broaden the engineering application prospects for structural health monitoring.展开更多
Rainbow particle image velocimetry(PIV)can restore the three-dimensional velocity field of particles with a single camera;however,it requires a relatively long time to complete the reconstruction.This paper proposes a...Rainbow particle image velocimetry(PIV)can restore the three-dimensional velocity field of particles with a single camera;however,it requires a relatively long time to complete the reconstruction.This paper proposes a hybrid algorithm that combines the fast Fourier transform(FFT)based co-correlation algorithm and the Horn–Schunck(HS)optical flow pyramid iterative algorithm to increase the reconstruction speed.The Rankine vortex simulation experiment was performed,in which the particle velocity field was reconstructed using the proposed algorithm and the rainbow PIV method.The average endpoint error and average angular error of the proposed algorithm were roughly the same as those of the rainbow PIV algorithm;nevertheless,the reconstruction time was 20%shorter.Furthermore,the effect of velocity magnitude and particle density on the reconstruction results was analyzed.In the end,the performance of the proposed algorithm was verified using real experimental single-vortex and double-vortex datasets,from which a similar particle velocity field was obtained compared with the rainbow PIV algorithm.The results show that the reconstruction speed of the proposed hybrid algorithm is approximately 25%faster than that of the rainbow PIV algorithm.展开更多
The ORB-SLAM2 based on the constant velocity model is difficult to determine the search window of the reprojection of map points when the objects are in variable velocity motion,which leads to a false matching,with an...The ORB-SLAM2 based on the constant velocity model is difficult to determine the search window of the reprojection of map points when the objects are in variable velocity motion,which leads to a false matching,with an inaccurate pose estimation or failed tracking.To address the challenge above,a new method of feature point matching is proposed in this paper,which combines the variable velocity model with the reverse optical flow method.First,the constant velocity model is extended to a new variable velocity model,and the expanded variable velocity model is used to provide the initial pixel shifting for the reverse optical flow method.Then the search range of feature points is accurately determined according to the results of the reverse optical flow method,thereby improving the accuracy and reliability of feature matching,with strengthened interframe tracking effects.Finally,we tested on TUM data set based on the RGB-D camera.Experimental results show that this method can reduce the probability of tracking failure and improve localization accuracy on SLAM(Simultaneous Localization and Mapping)systems.Compared with the traditional ORB-SLAM2,the test error of this method on each sequence in the TUM data set is significantly reduced,and the root mean square error is only 63.8%of the original system under the optimal condition.展开更多
Because of its characteristics of simple algorithm and hardware, optical flow-based motion estimation has become a hot research field, especially in GPS-denied environment. Optical flow could be used to obtain the air...Because of its characteristics of simple algorithm and hardware, optical flow-based motion estimation has become a hot research field, especially in GPS-denied environment. Optical flow could be used to obtain the aircraft motion information, but the six-(degree of freedom)(6-DOF) motion still couldn't be accurately estimated by existing methods. The purpose of this work is to provide a motion estimation method based on optical flow from forward and down looking cameras, which doesn't rely on the assumption of level flight. First, the distribution and decoupling method of optical flow from forward camera are utilized to get attitude. Then, the resulted angular velocities are utilized to obtain the translational optical flow of the down camera, which can eliminate the influence of rotational motion on velocity estimation. Besides, the translational motion estimation equation is simplified by establishing the relation between the depths of feature points and the aircraft altitude. Finally, simulation results show that the method presented is accurate and robust.展开更多
A modification of Horn and Schunk's approach is investigated, which leads to a better preservation of flow discontinuities. It improves Horn-Schunk model in three aspects: (1) It replaces the smooth weight coeffic...A modification of Horn and Schunk's approach is investigated, which leads to a better preservation of flow discontinuities. It improves Horn-Schunk model in three aspects: (1) It replaces the smooth weight coefficient in the energy equation by the variable weight coefficient. (2) It adopts a novel method to compute the mean velocity. The novel method also reflects the effect of the intensity difference on the image velocity diffusion. (3) It introduces a more efficient iterative method than the Gauss-Seidel method to solve the associated Euler-Lagrange equation. The experiment results validate the better effect of the improved method on preserving discontinuities.展开更多
To improve the detection accuracy and robustness of crowd anomaly detection,especially crowd emergency evacuation detection,the abnormal crowd behavior detection method is proposed.This method is based on the improved...To improve the detection accuracy and robustness of crowd anomaly detection,especially crowd emergency evacuation detection,the abnormal crowd behavior detection method is proposed.This method is based on the improved statistical global optical flow entropy which can better describe the degree of chaos of crowd.First,the optical flow field is extracted from the video sequences and a 2D optical flow histogram is gained.Then,the improved optical flow entropy,combining information theory with statistical physics is calculated from 2D optical flow histograms.Finally,the anomaly can be detected according to the abnormality judgment formula.The experimental results show that the detection accuracy achieved over 95%in three public video datasets,which indicates that the proposed algorithm outperforms other state-of-the-art algorithms.展开更多
In the process of human behavior recognition, the traditional dense optical flow method has too many pixels and too much overhead, which limits the running speed. This paper proposed a method combing YOLOv3 (You Only ...In the process of human behavior recognition, the traditional dense optical flow method has too many pixels and too much overhead, which limits the running speed. This paper proposed a method combing YOLOv3 (You Only Look Once v3) and local optical flow method. Based on the dense optical flow method, the optical flow modulus of the area where the human target is detected is calculated to reduce the amount of computation and save the cost in terms of time. And then, a threshold value is set to complete the human behavior identification. Through design algorithm, experimental verification and other steps, the walking, running and falling state of human body in real life indoor sports video was identified. Experimental results show that this algorithm is more advantageous for jogging behavior recognition.展开更多
As one of the important sea state parameters for navigation safety and coastal resource management, the ocean wave direction represents the propagation direction of the wave. A novel algorithm based on an optical flow...As one of the important sea state parameters for navigation safety and coastal resource management, the ocean wave direction represents the propagation direction of the wave. A novel algorithm based on an optical flow method is developed for the ocean wave direction inversion of the ocean wave fields imaged by the X-band radar continuously. The proposed algorithm utilizes the echo images received by the X-band wave monitoring radar to estimate the optical flow motion, and then the actual wave propagation direction can be obtained by taking a weighted average of the motion vector for each pixel. Compared with the traditional ocean wave direction inversion method based on frequency-domain, the novel algorithm is fully using a time-domain signal processing method without determination of a current velocity and a modulation transfer function(MTF). In the meantime,the novel algorithm is simple, efficient and there is no need to do something more complicated here. Compared with traditional ocean wave direction inversion method, the ocean wave direction of derived by using this proposed method matches well with that measured by an in situ buoy nearby and the simulation data. These promising results demonstrate the efficiency and accuracy of the algorithm proposed in the paper.展开更多
Sea ice velocity impacts the distribution of sea ice,and the flux of exported sea ice through the Fram Strait increases with increasing ice velocity.Therefore,improving the accuracy of estimates of the sea ice velocit...Sea ice velocity impacts the distribution of sea ice,and the flux of exported sea ice through the Fram Strait increases with increasing ice velocity.Therefore,improving the accuracy of estimates of the sea ice velocity is important.We introduce a pyramid algorithm into the Horn-Schunck optical flow(HS-OF)method(to develop the PHS-OF method).Before calculating the sea ice velocity,we generate multilayer pyramid images from an original brightness temperature image.Then,the sea ice velocity of the pyramid layer is calculated,and the ice velocity in the original image is calculated by layer iteration.Winter Arctic sea ice velocities from 2014 to 2016 are obtained and used to discuss the accuracy of the HS-OF method and PHS-OF(specifically the 2-layer PHS-OF(2 LPHS-OF)and 4-layer PHS-OF(4 LPHS-OF))methods.The results prove that the PHS-OF method indeed improves the accuracy of sea ice velocity estimates,and the 2 LPHS-OF scheme is more appropriate for estimating ice velocity.The error is smaller for the 2 LPHS-OF velocity estimates than values from the Ocean and Sea Ice Satellite Application Facility and the Copernicus Marine Environment Monitoring Service,and estimates of changes in velocity by the 2 LPHS-OF method are consistent with those from the National Snow and Ice Data Center.Sea ice undergoes two main motion patterns,i.e.,transpolar drift and the Beaufort Gyre.In addition,cyclonic and anticyclonic ice drift occurred during winter 2016.Variations in sea ice velocity are related to the open water area,sea ice retreat time and length of the open water season.展开更多
The velocity and direction of internal waves(IWs) are important parameters of the ocean,however,traditional observation methods can only obtain the average parameters of IWs for a single location or large area.Herein,...The velocity and direction of internal waves(IWs) are important parameters of the ocean,however,traditional observation methods can only obtain the average parameters of IWs for a single location or large area.Herein,a new method based on optical flow is proposed to derive the phase velocity vectors of IWs from X-band marine radar images.First,the X-band marine radar image sequence is averaged,and ramp correction is used to reduce the attenuation of gray values with increasing radial range.Second,the average propagation direction of the IWs is determined using the two-dimensional Fourier transform of the radar images;two radial profiles along this direction are selected from two adjacent radar images;and then,the average phase velocity of the IWs is estimated from these radial profiles.Third,the averaged radar images are processed via histogram equalization and binarization to reduce the influence of noise on the radar images.Fourth,a weighting factor is determined using the average phase velocity of a reference point;the phase velocities on the wave crest of the IWs are subsequently estimated via the optical flow method.Finally,the proposed method is validated using X-band marine radar image sequences observed on an oil platform in the South China Sea,and the error of the phase velocity is calculated to be 0.000 3–0.073 8 m/s.The application conditions of the proposed method are also discussed using two different types of IW packets.展开更多
Deformable medical image registration plays a vital role in medical image applications,such as placing different temporal images at the same time point or different modality images into the same coordinate system.Vari...Deformable medical image registration plays a vital role in medical image applications,such as placing different temporal images at the same time point or different modality images into the same coordinate system.Various strategies have been developed to satisfy the increasing needs of deformable medical image registration.One popular registration method is estimating the displacement field by computing the optical flow between two images.The motion field(flow field)is computed based on either gray-value or handcrafted descriptors such as the scale-invariant feature transform(SIFT).These methods assume that illumination is constant between images.However,medical images may not always satisfy this assumption.In this study,we propose a metric learning-based motion estimation method called Siamese Flow for deformable medical image registration.We train metric learners using a Siamese network,which produces an image patch descriptor that guarantees a smaller feature distance in two similar anatomical structures and a larger feature distance in two dissimilar anatomical structures.In the proposed registration framework,the flow field is computed based on such features and is close to the real deformation field due to the excellent feature representation ability of the Siamese network.Experimental results demonstrate that the proposed method outperforms the Demons,SIFT Flow,Elastix,and VoxelMorph networks regarding registration accuracy and robustness,particularly with large deformations.展开更多
The optical flow analysis of the image sequence based on the formal lattice Boltzmann equation, with different DdQm models, is discussed in this paper. The Mgorithm is based on the lattice Boltzmann method (LBM), wh...The optical flow analysis of the image sequence based on the formal lattice Boltzmann equation, with different DdQm models, is discussed in this paper. The Mgorithm is based on the lattice Boltzmann method (LBM), which is used in computational fluid dynamics theory for the simulation of fluid dynamics. At first, a generalized approximation to the formal lattice Boltzmann equation is discussed. Then the effects of different DdQm models on the results of the optical flow estimation are compared with each other, while calculating the movement vectors of pixels in the image sequence. The experimental results show that the higher dimension DdQm models, e.g., D3Q15 are more effective than those lower dimension ones.展开更多
In this study, we apply the optical flow method to the time-series shadowgraph images of impinging jets using a high-speed video camera with high spatial and temporal resolution. This image analysis provides quantitat...In this study, we apply the optical flow method to the time-series shadowgraph images of impinging jets using a high-speed video camera with high spatial and temporal resolution. This image analysis provides quantitative velocity vector fields in the object space without tracer particles. The analysis results clearly capture the details of the coherent vortex structure and its advection from the shear layer of the free jet. Although the results still leave challenges for the quantitative validation, the results show that this analysis method is effective for understanding the details of the physical phenomenon based on the quantitative values extracted from the shadowgraph images.展开更多
The in-cylinder flow field of the internal combustion engine is an important factor affecting the quality and combustion quality of the fuel mixture in the cylinder. In order to calculate the high-precision flow field...The in-cylinder flow field of the internal combustion engine is an important factor affecting the quality and combustion quality of the fuel mixture in the cylinder. In order to calculate the high-precision flow field, the paper presents a flow field calculation method based on the optical flow algorithm. The motion of the point was calculated using the change in pixel intensity within two temporally adjacent frame images. The results show the high accuracy and resolution of the flow field at small displacement conditions.展开更多
Important in many different sectors of the industry, the determination of stream velocity has become more and more important due to measurements precision necessity, in order to determine the right production rates, d...Important in many different sectors of the industry, the determination of stream velocity has become more and more important due to measurements precision necessity, in order to determine the right production rates, determine the volumetric production of undesired fluid, establish automated controls based on these measurements avoiding over-flooding or over-production, guaranteeing accurate predictive maintenance, etc. Difficulties being faced have been the determination of the velocity of specific fluids embedded in some others, for example, determining the gas bubbles stream velocity flowing throughout liquid fluid phase. Although different and already applicable methods have been researched and already implemented within the industry, a non-intrusive automated way of providing those stream velocities has its importance, and may have a huge impact in projects budget. Knowing the importance of its determination, this developed script uses a methodology of breaking-down real-time videos media into frame images, analyzing by pixel correlations possible superposition matches for further gas bubbles stream velocity estimation. In raw sense, the script bases itself in functions and procedures already available in MatLab, which can be used for image processing and treatments, allowing the methodology to be implemented. Its accuracy after the running test was of around 97% (ninety-seven percent);the raw source code with comments had almost 3000 (three thousand) characters;and the hardware placed for running the code was an Intel Core Duo 2.13 [Ghz] and 2 [Gb] RAM memory capable workstation. Even showing good results, it could be stated that just the end point correlations were actually getting to the final solution. So that, making use of self-learning functions or neural network, one could surely enhance the capability of the application to be run in real-time without getting exhaust by iterative loops.展开更多
Underwater target motion estimation is a challenge for ocean military and scientific research.In this work,we propose a method based on the combination of polarization imaging and optical flow for turbid underwater ta...Underwater target motion estimation is a challenge for ocean military and scientific research.In this work,we propose a method based on the combination of polarization imaging and optical flow for turbid underwater target detection.Polarization imaging can reduce the influence of backscattered light and obtain high-quality images underwater.The optical flow shows the motion and structural information of the target.We use polarized optical flow to obtain the optical flow field and estimate the target motion.The experimental results of different targets under varying water turbidity levels illustrate that our method is realizable and robust.The precision is verified by comparing the results with the precise displacement data and calculating two error measures.The proposed method based on polarized optical flow can obtain accurate displacement information and a good recognition effect.Moving target segmentation based on the Otsu method further proves the superiority of the polarized optical flow under turbid water.This study is valuable for target detection and motion estimation in scattering environments.展开更多
Optical flow estimation in human facial video,which provides 2D correspondences between adjacent frames,is a fundamental pre-processing step for many applications,like facial expression capture and recognition.However...Optical flow estimation in human facial video,which provides 2D correspondences between adjacent frames,is a fundamental pre-processing step for many applications,like facial expression capture and recognition.However,it is quite challenging as human facial images contain large areas of similar textures,rich expressions,and large rotations.These characteristics also result in the scarcity of large,annotated realworld datasets.We propose a robust and accurate method to learn facial optical flow in a self-supervised manner.Specifically,we utilize various shape priors,including face depth,landmarks,and parsing,to guide the self-supervised learning task via a differentiable nonrigid registration framework.Extensive experiments demonstrate that our method achieves remarkable improvements for facial optical flow estimation in the presence of significant expressions and large rotations.展开更多
Current deformation measurement techniques suffer from limited spatial resolution. In this work, a highly accurate and high-resolution Horn Schunck optical flow method is developed and then applied to measuring the st...Current deformation measurement techniques suffer from limited spatial resolution. In this work, a highly accurate and high-resolution Horn Schunck optical flow method is developed and then applied to measuring the static deformation of a birdlike flexible airfoil at a series of angles of attack at Reynolds number 100,000 in a low speed, low noise wind tunnel. To allow relatively large displacements, a nonlinear Horn-Schunck model and a coarse-to-fine warping process are adopted. To preserve optical flow discontinuities, a nonquadratic penalization function, a multi- cue driven bilateral filtering and a principle component analysis of local image patterns are used. First, the accuracy and convergence of this Horn-Schunck technique are verified on a benchmark. Then, the maximum displacement that can be reliably calculated by this technique is studied on synthetic images. Both studies are compared with the performance of a Lucas-Kanade optical flow method. Finally, the Horn-Schunck technique is used to estimate the 3-D deformation of the birdlike airfoil through a stereoscopic camera setup. The results are compared with those computed by Lucas-Kanade optical flow, image correlation and numerical simulation.展开更多
This paper focuses mainly on semi-strapdown image homing guided (SSIHG) system design based on optical flow for a six-degree-of-freedom (6-DOF) axial-symmetric skid-to-turn missile. Three optical flow algorithms s...This paper focuses mainly on semi-strapdown image homing guided (SSIHG) system design based on optical flow for a six-degree-of-freedom (6-DOF) axial-symmetric skid-to-turn missile. Three optical flow algorithms suitable for large displacements are introduced and compared. The influence of different displacements on computational accuracy of the three algorithms is analyzed statistically. The total optical flow of the SSIHG missile is obtained using the Scale Invariant Feature Transform (SIFT) algorithm, which is the best among the three for large displacements. After removing the rotational optical flow caused by rotation of the gimbal and missile body from the total optical flow, the remaining translational optical flow is smoothed via Kalman filtering. The circular navigation guidance (CNG) law with impact angle constraint is then obtained utilizing the smoothed translational optical flow and position of the target image. Simulations are carried out under both disturbed and undisturbed conditions, and results indicate the proposed guidance strategy for SSIHG missiles can result in a precise target hit with a desired impact angle without the need for the time-to-go parameter.展开更多
A rain-type adaptive pyramid Kanade-Lucas-Tomasi(A-PKLT)optical flow method for radar echo extrapolation is proposed.This method introduces a rain-type classification algorithm that can classify radar echoes into six ...A rain-type adaptive pyramid Kanade-Lucas-Tomasi(A-PKLT)optical flow method for radar echo extrapolation is proposed.This method introduces a rain-type classification algorithm that can classify radar echoes into six types:convective,stratiform,surrounding convective,isolated convective core,isolated convective fringe,and weak echoes.Then,new schemes are designed to optimize specific parameters of the PKLT optical flow based on the rain type of the echo.At the same time,the gradients of radar reflectivity in the fringe positions corresponding to all types of rain echoes are increased.As a result,corner points that are characteristic points used for PKLT optical flow tracking in the surrounding area will be increased.Therefore,more motion vectors are purposefully obtained in the whole radar echo area.This helps to describe the motion characteristics of the precipitation more precisely.Then,the motion vectors corresponding to each type of rain echo are merged,and a denser motion vector field is generated by an interpolation algorithm on the basis of merged motion vectors.Finally,the dense motion vectors are used to extrapolate rain echoes into 0-60-min nowcasts by a semi-Lagrangian scheme.Compared with other nowcasting methods for four landfalling typhoons in or near Shanghai,the new optical flow method is found to be more accurate than the traditional cross-correlation and optical flow methods,particularly showing a clear improvement in the nowcasting of convective echoes on the spiral rainbands of typhoons.展开更多
文摘To enhance the applicability and measurement accuracy of phase-based optical flow method using complex steerable pyramids in structural displacement measurement engineering applications, an improved method of optimizing parameter settings is proposed. The optimized parameters include the best measurement points of the Region of Interest (ROI) and the levels of pyramid filters. Additionally, to address the issue of updating reference frames in practical applications due to the difficulty in estimating the maximum effective measurement value, a mechanism for dynamically updating reference frames is introduced. Experimental results demonstrate that compared to representative image gradient-based displacement measurement methods, the proposed method exhibits higher measurement accuracy in engineering applications. This provides reliable data support for structural damage identification research based on vibration signals and is expected to broaden the engineering application prospects for structural health monitoring.
基金the National Natural Science Foundation of China(Grant Nos.51874264 and 52076200)。
文摘Rainbow particle image velocimetry(PIV)can restore the three-dimensional velocity field of particles with a single camera;however,it requires a relatively long time to complete the reconstruction.This paper proposes a hybrid algorithm that combines the fast Fourier transform(FFT)based co-correlation algorithm and the Horn–Schunck(HS)optical flow pyramid iterative algorithm to increase the reconstruction speed.The Rankine vortex simulation experiment was performed,in which the particle velocity field was reconstructed using the proposed algorithm and the rainbow PIV method.The average endpoint error and average angular error of the proposed algorithm were roughly the same as those of the rainbow PIV algorithm;nevertheless,the reconstruction time was 20%shorter.Furthermore,the effect of velocity magnitude and particle density on the reconstruction results was analyzed.In the end,the performance of the proposed algorithm was verified using real experimental single-vortex and double-vortex datasets,from which a similar particle velocity field was obtained compared with the rainbow PIV algorithm.The results show that the reconstruction speed of the proposed hybrid algorithm is approximately 25%faster than that of the rainbow PIV algorithm.
基金This work was supported by The National Natural Science Foundation of China under Grant No.61304205 and NO.61502240The Natural Science Foundation of Jiangsu Province under Grant No.BK20191401 and No.BK20201136Postgraduate Research&Practice Innovation Program of Jiangsu Province under Grant No.SJCX21_0364 and No.SJCX21_0363.
文摘The ORB-SLAM2 based on the constant velocity model is difficult to determine the search window of the reprojection of map points when the objects are in variable velocity motion,which leads to a false matching,with an inaccurate pose estimation or failed tracking.To address the challenge above,a new method of feature point matching is proposed in this paper,which combines the variable velocity model with the reverse optical flow method.First,the constant velocity model is extended to a new variable velocity model,and the expanded variable velocity model is used to provide the initial pixel shifting for the reverse optical flow method.Then the search range of feature points is accurately determined according to the results of the reverse optical flow method,thereby improving the accuracy and reliability of feature matching,with strengthened interframe tracking effects.Finally,we tested on TUM data set based on the RGB-D camera.Experimental results show that this method can reduce the probability of tracking failure and improve localization accuracy on SLAM(Simultaneous Localization and Mapping)systems.Compared with the traditional ORB-SLAM2,the test error of this method on each sequence in the TUM data set is significantly reduced,and the root mean square error is only 63.8%of the original system under the optimal condition.
基金Project(2012CB720003)supported by the National Basic Research Program of ChinaProjects(61320106010,61127007,61121003,61573019)supported by the National Natural Science Foundation of ChinaProject(2013DFE13040)supported by the Special Program for International Science and Technology Cooperation from Ministry of Science and Technology of China
文摘Because of its characteristics of simple algorithm and hardware, optical flow-based motion estimation has become a hot research field, especially in GPS-denied environment. Optical flow could be used to obtain the aircraft motion information, but the six-(degree of freedom)(6-DOF) motion still couldn't be accurately estimated by existing methods. The purpose of this work is to provide a motion estimation method based on optical flow from forward and down looking cameras, which doesn't rely on the assumption of level flight. First, the distribution and decoupling method of optical flow from forward camera are utilized to get attitude. Then, the resulted angular velocities are utilized to obtain the translational optical flow of the down camera, which can eliminate the influence of rotational motion on velocity estimation. Besides, the translational motion estimation equation is simplified by establishing the relation between the depths of feature points and the aircraft altitude. Finally, simulation results show that the method presented is accurate and robust.
文摘A modification of Horn and Schunk's approach is investigated, which leads to a better preservation of flow discontinuities. It improves Horn-Schunk model in three aspects: (1) It replaces the smooth weight coefficient in the energy equation by the variable weight coefficient. (2) It adopts a novel method to compute the mean velocity. The novel method also reflects the effect of the intensity difference on the image velocity diffusion. (3) It introduces a more efficient iterative method than the Gauss-Seidel method to solve the associated Euler-Lagrange equation. The experiment results validate the better effect of the improved method on preserving discontinuities.
基金National Natural Science Foundation of China(61701029)。
文摘To improve the detection accuracy and robustness of crowd anomaly detection,especially crowd emergency evacuation detection,the abnormal crowd behavior detection method is proposed.This method is based on the improved statistical global optical flow entropy which can better describe the degree of chaos of crowd.First,the optical flow field is extracted from the video sequences and a 2D optical flow histogram is gained.Then,the improved optical flow entropy,combining information theory with statistical physics is calculated from 2D optical flow histograms.Finally,the anomaly can be detected according to the abnormality judgment formula.The experimental results show that the detection accuracy achieved over 95%in three public video datasets,which indicates that the proposed algorithm outperforms other state-of-the-art algorithms.
文摘In the process of human behavior recognition, the traditional dense optical flow method has too many pixels and too much overhead, which limits the running speed. This paper proposed a method combing YOLOv3 (You Only Look Once v3) and local optical flow method. Based on the dense optical flow method, the optical flow modulus of the area where the human target is detected is calculated to reduce the amount of computation and save the cost in terms of time. And then, a threshold value is set to complete the human behavior identification. Through design algorithm, experimental verification and other steps, the walking, running and falling state of human body in real life indoor sports video was identified. Experimental results show that this algorithm is more advantageous for jogging behavior recognition.
基金The National Key Research and Development Program of China under contract No.2016YFC0800405the Shanghai Municipal Science and Technology Project of China under contract No.15DZ0500600the Specialized Research Fund for the Doctoral Program of Higher Education of China under contract No.2014212020203
文摘As one of the important sea state parameters for navigation safety and coastal resource management, the ocean wave direction represents the propagation direction of the wave. A novel algorithm based on an optical flow method is developed for the ocean wave direction inversion of the ocean wave fields imaged by the X-band radar continuously. The proposed algorithm utilizes the echo images received by the X-band wave monitoring radar to estimate the optical flow motion, and then the actual wave propagation direction can be obtained by taking a weighted average of the motion vector for each pixel. Compared with the traditional ocean wave direction inversion method based on frequency-domain, the novel algorithm is fully using a time-domain signal processing method without determination of a current velocity and a modulation transfer function(MTF). In the meantime,the novel algorithm is simple, efficient and there is no need to do something more complicated here. Compared with traditional ocean wave direction inversion method, the ocean wave direction of derived by using this proposed method matches well with that measured by an in situ buoy nearby and the simulation data. These promising results demonstrate the efficiency and accuracy of the algorithm proposed in the paper.
基金The National Key Research and Development Program of China under contract Nos 2018YFC1407200 and 2018YFC1407203the National Natural Science Foundation of China under contract No.41976212
文摘Sea ice velocity impacts the distribution of sea ice,and the flux of exported sea ice through the Fram Strait increases with increasing ice velocity.Therefore,improving the accuracy of estimates of the sea ice velocity is important.We introduce a pyramid algorithm into the Horn-Schunck optical flow(HS-OF)method(to develop the PHS-OF method).Before calculating the sea ice velocity,we generate multilayer pyramid images from an original brightness temperature image.Then,the sea ice velocity of the pyramid layer is calculated,and the ice velocity in the original image is calculated by layer iteration.Winter Arctic sea ice velocities from 2014 to 2016 are obtained and used to discuss the accuracy of the HS-OF method and PHS-OF(specifically the 2-layer PHS-OF(2 LPHS-OF)and 4-layer PHS-OF(4 LPHS-OF))methods.The results prove that the PHS-OF method indeed improves the accuracy of sea ice velocity estimates,and the 2 LPHS-OF scheme is more appropriate for estimating ice velocity.The error is smaller for the 2 LPHS-OF velocity estimates than values from the Ocean and Sea Ice Satellite Application Facility and the Copernicus Marine Environment Monitoring Service,and estimates of changes in velocity by the 2 LPHS-OF method are consistent with those from the National Snow and Ice Data Center.Sea ice undergoes two main motion patterns,i.e.,transpolar drift and the Beaufort Gyre.In addition,cyclonic and anticyclonic ice drift occurred during winter 2016.Variations in sea ice velocity are related to the open water area,sea ice retreat time and length of the open water season.
基金The National Natural Science Foundation of China under contract Nos 41620104003 and 42027805the National Natural Science Youth Foundation of China under contract No.41506199。
文摘The velocity and direction of internal waves(IWs) are important parameters of the ocean,however,traditional observation methods can only obtain the average parameters of IWs for a single location or large area.Herein,a new method based on optical flow is proposed to derive the phase velocity vectors of IWs from X-band marine radar images.First,the X-band marine radar image sequence is averaged,and ramp correction is used to reduce the attenuation of gray values with increasing radial range.Second,the average propagation direction of the IWs is determined using the two-dimensional Fourier transform of the radar images;two radial profiles along this direction are selected from two adjacent radar images;and then,the average phase velocity of the IWs is estimated from these radial profiles.Third,the averaged radar images are processed via histogram equalization and binarization to reduce the influence of noise on the radar images.Fourth,a weighting factor is determined using the average phase velocity of a reference point;the phase velocities on the wave crest of the IWs are subsequently estimated via the optical flow method.Finally,the proposed method is validated using X-band marine radar image sequences observed on an oil platform in the South China Sea,and the error of the phase velocity is calculated to be 0.000 3–0.073 8 m/s.The application conditions of the proposed method are also discussed using two different types of IW packets.
基金This study was supported in part by the Sichuan Science and Technology Program(2019YFH0085,2019ZDZX0005,2019YFG0196)in part by the Foundation of Chengdu University of Information Technology(No.KYTZ202008).
文摘Deformable medical image registration plays a vital role in medical image applications,such as placing different temporal images at the same time point or different modality images into the same coordinate system.Various strategies have been developed to satisfy the increasing needs of deformable medical image registration.One popular registration method is estimating the displacement field by computing the optical flow between two images.The motion field(flow field)is computed based on either gray-value or handcrafted descriptors such as the scale-invariant feature transform(SIFT).These methods assume that illumination is constant between images.However,medical images may not always satisfy this assumption.In this study,we propose a metric learning-based motion estimation method called Siamese Flow for deformable medical image registration.We train metric learners using a Siamese network,which produces an image patch descriptor that guarantees a smaller feature distance in two similar anatomical structures and a larger feature distance in two dissimilar anatomical structures.In the proposed registration framework,the flow field is computed based on such features and is close to the real deformation field due to the excellent feature representation ability of the Siamese network.Experimental results demonstrate that the proposed method outperforms the Demons,SIFT Flow,Elastix,and VoxelMorph networks regarding registration accuracy and robustness,particularly with large deformations.
基金Project supported by the National Natural Science Foundation of China(Grant No.40976108)the Shanghai Leading Academic Discipline Project(Grant No.J50103)the Innovation Program of Municipal Education Commission of Shanghai Municipality(Grant No.11YZ03)
文摘The optical flow analysis of the image sequence based on the formal lattice Boltzmann equation, with different DdQm models, is discussed in this paper. The Mgorithm is based on the lattice Boltzmann method (LBM), which is used in computational fluid dynamics theory for the simulation of fluid dynamics. At first, a generalized approximation to the formal lattice Boltzmann equation is discussed. Then the effects of different DdQm models on the results of the optical flow estimation are compared with each other, while calculating the movement vectors of pixels in the image sequence. The experimental results show that the higher dimension DdQm models, e.g., D3Q15 are more effective than those lower dimension ones.
文摘In this study, we apply the optical flow method to the time-series shadowgraph images of impinging jets using a high-speed video camera with high spatial and temporal resolution. This image analysis provides quantitative velocity vector fields in the object space without tracer particles. The analysis results clearly capture the details of the coherent vortex structure and its advection from the shear layer of the free jet. Although the results still leave challenges for the quantitative validation, the results show that this analysis method is effective for understanding the details of the physical phenomenon based on the quantitative values extracted from the shadowgraph images.
文摘The in-cylinder flow field of the internal combustion engine is an important factor affecting the quality and combustion quality of the fuel mixture in the cylinder. In order to calculate the high-precision flow field, the paper presents a flow field calculation method based on the optical flow algorithm. The motion of the point was calculated using the change in pixel intensity within two temporally adjacent frame images. The results show the high accuracy and resolution of the flow field at small displacement conditions.
基金financial support from the Brazilian Federal Agency for Support and Evaluation of Graduate Education(Coordenacao de Aperfeicoamento de Pessoal de Nivel Superior—CAPES,scholarship process no BEX 0506/15-0)the Brazilian National Agency of Petroleum,Natural Gas and Biofuels(Agencia Nacional do Petroleo,Gas Natural e Biocombustiveis—ANP),in cooperation with the Brazilian Financier of Studies and Projects(Financiadora de Estudos e Projetos—FINEP)the Brazilian Ministry of Science,Technology and Innovation(Ministério da Ciencia,Tecnologia e Inovacao—MCTI)through the ANP’s Human Resources Program of the State University of Sao Paulo(Universidade Estadual Paulista—UNESP)for the Oil and Gas Sector PRH-ANP/MCTI no 48(PRH48).
文摘Important in many different sectors of the industry, the determination of stream velocity has become more and more important due to measurements precision necessity, in order to determine the right production rates, determine the volumetric production of undesired fluid, establish automated controls based on these measurements avoiding over-flooding or over-production, guaranteeing accurate predictive maintenance, etc. Difficulties being faced have been the determination of the velocity of specific fluids embedded in some others, for example, determining the gas bubbles stream velocity flowing throughout liquid fluid phase. Although different and already applicable methods have been researched and already implemented within the industry, a non-intrusive automated way of providing those stream velocities has its importance, and may have a huge impact in projects budget. Knowing the importance of its determination, this developed script uses a methodology of breaking-down real-time videos media into frame images, analyzing by pixel correlations possible superposition matches for further gas bubbles stream velocity estimation. In raw sense, the script bases itself in functions and procedures already available in MatLab, which can be used for image processing and treatments, allowing the methodology to be implemented. Its accuracy after the running test was of around 97% (ninety-seven percent);the raw source code with comments had almost 3000 (three thousand) characters;and the hardware placed for running the code was an Intel Core Duo 2.13 [Ghz] and 2 [Gb] RAM memory capable workstation. Even showing good results, it could be stated that just the end point correlations were actually getting to the final solution. So that, making use of self-learning functions or neural network, one could surely enhance the capability of the application to be run in real-time without getting exhaust by iterative loops.
基金supported by the National Natural Science Foundation of China (No.52394252)the Postdoctoral Fellowship Program of CPSF (No.GZC20232497)+2 种基金the Key Research and Development Program of Shandong Province,China (No.2021ZLGX04)the Shandong Postdoctoral Science Foundation (No.SDBX2023012)the Qingdao Postdoctoral Program Grant (No.QDBSH20230202009)。
文摘Underwater target motion estimation is a challenge for ocean military and scientific research.In this work,we propose a method based on the combination of polarization imaging and optical flow for turbid underwater target detection.Polarization imaging can reduce the influence of backscattered light and obtain high-quality images underwater.The optical flow shows the motion and structural information of the target.We use polarized optical flow to obtain the optical flow field and estimate the target motion.The experimental results of different targets under varying water turbidity levels illustrate that our method is realizable and robust.The precision is verified by comparing the results with the precise displacement data and calculating two error measures.The proposed method based on polarized optical flow can obtain accurate displacement information and a good recognition effect.Moving target segmentation based on the Otsu method further proves the superiority of the polarized optical flow under turbid water.This study is valuable for target detection and motion estimation in scattering environments.
基金This work was supported by National Natural Science Foundation of China(No.62122071)the Youth Innovation Promotion Association CAS(No.2018495)+1 种基金the Fundamental Research Funds for the Central Universities(No.WK3470000021)through the Alibaba Innovation Research Program(AIR).
文摘Optical flow estimation in human facial video,which provides 2D correspondences between adjacent frames,is a fundamental pre-processing step for many applications,like facial expression capture and recognition.However,it is quite challenging as human facial images contain large areas of similar textures,rich expressions,and large rotations.These characteristics also result in the scarcity of large,annotated realworld datasets.We propose a robust and accurate method to learn facial optical flow in a self-supervised manner.Specifically,we utilize various shape priors,including face depth,landmarks,and parsing,to guide the self-supervised learning task via a differentiable nonrigid registration framework.Extensive experiments demonstrate that our method achieves remarkable improvements for facial optical flow estimation in the presence of significant expressions and large rotations.
文摘Current deformation measurement techniques suffer from limited spatial resolution. In this work, a highly accurate and high-resolution Horn Schunck optical flow method is developed and then applied to measuring the static deformation of a birdlike flexible airfoil at a series of angles of attack at Reynolds number 100,000 in a low speed, low noise wind tunnel. To allow relatively large displacements, a nonlinear Horn-Schunck model and a coarse-to-fine warping process are adopted. To preserve optical flow discontinuities, a nonquadratic penalization function, a multi- cue driven bilateral filtering and a principle component analysis of local image patterns are used. First, the accuracy and convergence of this Horn-Schunck technique are verified on a benchmark. Then, the maximum displacement that can be reliably calculated by this technique is studied on synthetic images. Both studies are compared with the performance of a Lucas-Kanade optical flow method. Finally, the Horn-Schunck technique is used to estimate the 3-D deformation of the birdlike airfoil through a stereoscopic camera setup. The results are compared with those computed by Lucas-Kanade optical flow, image correlation and numerical simulation.
基金supported by the Armament Research Fund of China (No.9020A02010313BQ01)
文摘This paper focuses mainly on semi-strapdown image homing guided (SSIHG) system design based on optical flow for a six-degree-of-freedom (6-DOF) axial-symmetric skid-to-turn missile. Three optical flow algorithms suitable for large displacements are introduced and compared. The influence of different displacements on computational accuracy of the three algorithms is analyzed statistically. The total optical flow of the SSIHG missile is obtained using the Scale Invariant Feature Transform (SIFT) algorithm, which is the best among the three for large displacements. After removing the rotational optical flow caused by rotation of the gimbal and missile body from the total optical flow, the remaining translational optical flow is smoothed via Kalman filtering. The circular navigation guidance (CNG) law with impact angle constraint is then obtained utilizing the smoothed translational optical flow and position of the target image. Simulations are carried out under both disturbed and undisturbed conditions, and results indicate the proposed guidance strategy for SSIHG missiles can result in a precise target hit with a desired impact angle without the need for the time-to-go parameter.
基金This work was supported by National Key Research and Development Program of China(No.2018YFC1507601)National Natural Science Foundation of China(Grant No.41775049)Scientific Research Project of Shanghai Science and Technology Commission(No.18DZ12000403),and Severe Convection S&T Innovation Team of Shanghai Meteorological Service.
文摘A rain-type adaptive pyramid Kanade-Lucas-Tomasi(A-PKLT)optical flow method for radar echo extrapolation is proposed.This method introduces a rain-type classification algorithm that can classify radar echoes into six types:convective,stratiform,surrounding convective,isolated convective core,isolated convective fringe,and weak echoes.Then,new schemes are designed to optimize specific parameters of the PKLT optical flow based on the rain type of the echo.At the same time,the gradients of radar reflectivity in the fringe positions corresponding to all types of rain echoes are increased.As a result,corner points that are characteristic points used for PKLT optical flow tracking in the surrounding area will be increased.Therefore,more motion vectors are purposefully obtained in the whole radar echo area.This helps to describe the motion characteristics of the precipitation more precisely.Then,the motion vectors corresponding to each type of rain echo are merged,and a denser motion vector field is generated by an interpolation algorithm on the basis of merged motion vectors.Finally,the dense motion vectors are used to extrapolate rain echoes into 0-60-min nowcasts by a semi-Lagrangian scheme.Compared with other nowcasting methods for four landfalling typhoons in or near Shanghai,the new optical flow method is found to be more accurate than the traditional cross-correlation and optical flow methods,particularly showing a clear improvement in the nowcasting of convective echoes on the spiral rainbands of typhoons.