A domain decomposition and matching method in the time-domain is outlined for simulating the motions of ships advancing in waves. The flow field is decomposed into inner and outer domains by an imaginary control surfa...A domain decomposition and matching method in the time-domain is outlined for simulating the motions of ships advancing in waves. The flow field is decomposed into inner and outer domains by an imaginary control surface, and the Rankine source method is applied to the inner domain while the transient Green function method is used in the outer domain. Two initial boundary value problems are matched on the control surface. The corresponding numerical codes are developed, and the added masses, wave exciting forces and ship motions advancing in head sea for Series 60 ship and S175 containership, are presented and verified. A good agreement has been obtained when the numerical results are compared with the experimental data and other references. It shows that the present method is more efficient because of the panel discretization only in the inner domain during the numerical calculation, and good numerical stability is proved to avoid divergence problem regarding ships with flare.展开更多
With regard to precision/ultra-precision motion systems,it is important to achieve excellent tracking performance for various trajectory tracking tasks even under uncertain external disturbances.In this paper,to overc...With regard to precision/ultra-precision motion systems,it is important to achieve excellent tracking performance for various trajectory tracking tasks even under uncertain external disturbances.In this paper,to overcome the limitation of robustness to trajectory variations and external disturbances in offline feedforward compensation strategies such as iterative learning control(ILC),a novel real-time iterative compensation(RIC)control framework is proposed for precision motion systems without changing the inner closed-loop controller.Specifically,the RIC method can be divided into two parts,i.e.,accurate model prediction and real-time iterative compensation.An accurate prediction model considering lumped disturbances is firstly established to predict tracking errors at future sampling times.In light of predicted errors,a feedforward compensation term is developed to modify the following reference trajectory by real-time iterative calculation.Both the prediction and compen-sation processes are finished in a real-time motion control sampling period.The stability and convergence of the entire control system after real-time iterative compensation is analyzed for different conditions.Various simulation results consistently demonstrate that the proposed RIC framework possesses satisfactory dynamic regulation capability,which contributes to high tracking accuracy comparable to ILC or even better and strong robustness.展开更多
Voluntary participation of hemiplegic patients is crucial for functional electrical stimulation therapy.A wearable functional electrical stimulation system has been proposed for real-time volitional hand motor functio...Voluntary participation of hemiplegic patients is crucial for functional electrical stimulation therapy.A wearable functional electrical stimulation system has been proposed for real-time volitional hand motor function control using the electromyography bridge method.Through a series of novel design concepts,including the integration of a detecting circuit and an analog-to-digital converter,a miniaturized functional electrical stimulation circuit technique,a low-power super-regeneration chip for wireless receiving,and two wearable armbands,a prototype system has been established with reduced size,power,and overall cost.Based on wrist joint torque reproduction and classification experiments performed on six healthy subjects,the optimized surface electromyography thresholds and trained logistic regression classifier parameters were statistically chosen to establish wrist and hand motion control with high accuracy.Test results showed that wrist flexion/extension,hand grasp,and finger extension could be reproduced with high accuracy and low latency.This system can build a bridge of information transmission between healthy limbs and paralyzed limbs,effectively improve voluntary participation of hemiplegic patients,and elevate efficiency of rehabilitation training.展开更多
Block-in-matrix-soils(bimsoils)are geological mixtures that have distinct structures consisting of relatively strong rock blocks and weak matrix soils.It is still a challenge to evaluate the mechanical behaviors of bi...Block-in-matrix-soils(bimsoils)are geological mixtures that have distinct structures consisting of relatively strong rock blocks and weak matrix soils.It is still a challenge to evaluate the mechanical behaviors of bimsoils because of the heterogeneity,chaotic structure,and lithological variability.As a result,only very limited laboratory studies have been reported on the evolution of their internal deformation.In this study,the deformation evolution of bimsoils under uniaxial loading is investigated using real-time X-ray computed tomography(CT)and image correlation algorithm(with a rock block percentage(RBP)of 40%).Three parameters,i.e.heterogeneity coefficient(K),correlation coefficient(CC),and standard deviation(STD)of displacement fields,are proposed to quantify the heterogeneity of the motion of the rock blocks and the progressive deformation of the bimsoils.Experimental results show that the rock blocks in bimsoils are prone to forming clusters with increasing loading,and the sliding surface goes around only one side of a cluster.Based on the movement of the rock blocks recorded by STD and CC,the progressive deformation of the bimsoils is quantitatively divided into three stages:initialization of the rotation of rock blocks,formation of rock block clusters,and formation of a shear band by rock blocks with significant rotation.Moreover,the experimental results demonstrate that the meso-motion of rock blocks controls the macroscopic mechanical properties of the samples.展开更多
This paper proposes an electronic image stabilization algorithm based on efficient block matching on the plane. This algorithm uses a hexagonal search algorithm, and uses the bit-planes to estimate and compensate for ...This paper proposes an electronic image stabilization algorithm based on efficient block matching on the plane. This algorithm uses a hexagonal search algorithm, and uses the bit-planes to estimate and compensate for the translational motion between video sequences at the same time;As for the rotary motion vector generated in the video sequences, in order to highlight the intensity change of the image sequence, the algorithm firstly conducts Laplace transform for the reference frame, then select a number of characteristics at the image edge to make block matching with the current frame, calculate and compensate for the rotational movement that may exist finally. Through theoretical analysis and simula-tion, we prove that, as for a mixed translational and rotational motion video sequences, the proposed algorithm can reduce required time for block matching computation ,while improving the accuracy of the electronic image stabilization.展开更多
Background Image matching is crucial in numerous computer vision tasks such as 3D reconstruction and simultaneous visual localization and mapping.The accuracy of the matching significantly impacted subsequent studies....Background Image matching is crucial in numerous computer vision tasks such as 3D reconstruction and simultaneous visual localization and mapping.The accuracy of the matching significantly impacted subsequent studies.Because of their local similarity,when image pairs contain comparable patterns but feature pairs are positioned differently,incorrect recognition can occur as global motion consistency is disregarded.Methods This study proposes an image-matching filtering algorithm based on global motion consistency.It can be used as a subsequent matching filter for the initial matching results generated by other matching algorithms based on the principle of motion smoothness.A particular matching algorithm can first be used to perform the initial matching;then,the rotation and movement information of the global feature vectors are combined to effectively identify outlier matches.The principle is that if the matching result is accurate,the feature vectors formed by any matched point should have similar rotation angles and moving distances.Thus,global motion direction and global motion distance consistencies were used to reject outliers caused by similar patterns in different locations.Results Four datasets were used to test the effectiveness of the proposed method.Three datasets with similar patterns in different locations were used to test the results for similar images that could easily be incorrectly matched by other algorithms,and one commonly used dataset was used to test the results for the general image-matching problem.The experimental results suggest that the proposed method is more accurate than other state-of-the-art algorithms in identifying mismatches in the initial matching set.Conclusions The proposed outlier rejection matching method can significantly improve the matching accuracy for similar images with locally similar feature pairs in different locations and can provide more accurate matching results for subsequent computer vision tasks.展开更多
The traditional oriented FAST and rotated BRIEF(ORB) algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB...The traditional oriented FAST and rotated BRIEF(ORB) algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB(MORB) algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi(KLT). By using Kalman, the object's state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.展开更多
Medical imaging plays a key role within modern hospital management systems for diagnostic purposes.Compression methodologies are extensively employed to mitigate storage demands and enhance transmission speed,all whil...Medical imaging plays a key role within modern hospital management systems for diagnostic purposes.Compression methodologies are extensively employed to mitigate storage demands and enhance transmission speed,all while upholding image quality.Moreover,an increasing number of hospitals are embracing cloud computing for patient data storage,necessitating meticulous scrutiny of server security and privacy protocols.Nevertheless,considering the widespread availability of multimedia tools,the preservation of digital data integrity surpasses the significance of compression alone.In response to this concern,we propose a secure storage and transmission solution for compressed medical image sequences,such as ultrasound images,utilizing a motion vector watermarking scheme.The watermark is generated employing an error-correcting code known as Bose-Chaudhuri-Hocquenghem(BCH)and is subsequently embedded into the compressed sequence via block-based motion vectors.In the process of watermark embedding,motion vectors are selected based on their magnitude and phase angle.When embedding watermarks,no specific spatial area,such as a region of interest(ROI),is used in the images.The embedding of watermark bits is dependent on motion vectors.Although reversible watermarking allows the restoration of the original image sequences,we use the irreversible watermarking method.The reason for this is that the use of reversible watermarks may impede the claims of ownership and legal rights.The restoration of original data or images may call into question ownership or other legal claims.The peak signal-to-noise ratio(PSNR)and structural similarity index(SSIM)serve as metrics for evaluating the watermarked image quality.Across all images,the PSNR value exceeds 46 dB,and the SSIM value exceeds 0.92.Experimental results substantiate the efficacy of the proposed technique in preserving data integrity.展开更多
Ship motions induced by waves have a significant impact on the efficiency and safety of offshore operations.Real-time prediction of ship motions in the next few seconds plays a crucial role in performing sensitive act...Ship motions induced by waves have a significant impact on the efficiency and safety of offshore operations.Real-time prediction of ship motions in the next few seconds plays a crucial role in performing sensitive activities.However,the obvious memory effect of ship motion time series brings certain difficulty to rapid and accurate prediction.Therefore,a real-time framework based on the Long-Short Term Memory(LSTM)neural network model is proposed to predict ship motions in regular and irregular head waves.A 15000 TEU container ship model is employed to illustrate the proposed framework.The numerical implementation and the real-time ship motion prediction in irregular head waves corresponding to the different time scales are carried out based on the container ship model.The related experimental data were employed to verify the numerical simulation results.The results show that the proposed method is more robust than the classical extreme short-term prediction method based on potential flow theory in the prediction of nonlinear ship motions.展开更多
This article describes a hybrid simulation method to generate artificial ground motion time histories that are compatible with specified peak seismic acceleration, velocity and displacement as well as the target respo...This article describes a hybrid simulation method to generate artificial ground motion time histories that are compatible with specified peak seismic acceleration, velocity and displacement as well as the target response spectrum of absolute acceleration. First, based on traditional methods that match the target spectrum in the frequency domain, an initial acceleration time history was synthesized to satisfy the specified peak acceleration, target spectral acceleration and intensity envelope. Second, by using the inversion formula of the seismic input to a linear single-degree-of-freedom system and by superimposing a series of narrow-band time histories in the time domain, the initial time history is further modified to allow its peak velocity and displacement to approach the targets and improve its matching precision with the target spectrum. Numerical examples are provided to demonstrate that the proposed method achieves good agreement with the target values.展开更多
Target tracking is very important in computer vision and related areas. It is usually difficult to accurately track fast motion target with appearance variations. Sometimes the tracking algorithms fail for heavy appea...Target tracking is very important in computer vision and related areas. It is usually difficult to accurately track fast motion target with appearance variations. Sometimes the tracking algorithms fail for heavy appearance variations. A multiple template method to track fast motion target with appearance changes is presented under the framework of appearance model with Kalman filter. Firstly, we construct a multiple template appearance model, which includes both the original template and templates affinely transformed from original one. Generally speaking, appearance variations of fast motion target can be covered by affine transformation. Therefore, the affine tr templates match the target of appearance variations better than conventional models. Secondly, we present an improved Kalman filter for approx- imate estimating the motion trail of the target and a modified similarity evaluation function for exact matching. The estimation approach can reduce time complexity of the algorithm and keep accuracy in the meantime. Thirdly, we propose an adaptive scheme for updating template set to alleviate the drift problem. The scheme considers the following differences: the weight differences in two successive frames; different types of affine transformation applied to templates. Finally, experiments demonstrate that the proposed algorithm is robust to appearance varia- tion of fast motion target and achieves real-time performance on middle/low-range computing platform.展开更多
This paper proposes an intelligent controller for motion control of robotic systems to obtain high precision tracking without the need for a real-time trial and error method.In addition, a new self-tuning algorithm ha...This paper proposes an intelligent controller for motion control of robotic systems to obtain high precision tracking without the need for a real-time trial and error method.In addition, a new self-tuning algorithm has been developed based on both the ant colony algorithm and a fuzzy system for real-time tuning of controller parameters. Simulations and experiments using a real robot have been addressed to demonstrate the success of the proposed controller and validate the theoretical analysis. Obtained results confirm that the proposed controller ensures robust performance in the presence of disturbances and parametric uncertainties without the need for adjustment of control law parameters by a trial and error method.展开更多
The present study used electroencephalography to examine mu rhythm suppression (a putative index of human mirror neuron system activation) at frontal sites (F3, Fz and F4), central sites (C3, Cz and C4), parieta...The present study used electroencephalography to examine mu rhythm suppression (a putative index of human mirror neuron system activation) at frontal sites (F3, Fz and F4), central sites (C3, Cz and C4), parietal sites (P3, Pz and P4) and occipital sites (O1 and O2), while subjects observed real hand motion (real hand motion condition) and illustrative depictions of hand motion (drawn hand motion condition). Experimental data revealed that mu rhythm suppression was exhibited in the mirror neuron system when subjects observed both real and drawn hand motion. Moreover, the mu rhythm recorded at the F3, Fz, F4, and Pz poles was significantly suppressed while observing both stimulus types, but no obvious mu suppression occurred at the O1, 02 and 03 poles. These results suggest that the observation of drawings of human hand actions can activate the human mirror neuron system. This evidence supports the hypothesis that the mirror neuron system may be involved in intransitively abstract action understanding.展开更多
A correlation tracking algorithm based on template partition motion estimation proposed for improving real time performance of the conventional correlation matching algorithms. The target trajectory fitted using the l...A correlation tracking algorithm based on template partition motion estimation proposed for improving real time performance of the conventional correlation matching algorithms. The target trajectory fitted using the least square with equal space in whole interval and the target prediction point is found out. According to the requirements of block motion estimation(BME) algorithm,the template divided into some macro blocks. The searching process is conducted by using diamond search algorithm around the prediction point and the optimal motion vector of each block is calculated. A point corresponding to the motion vector with the best matching is taken as a rough matching point of the template. The relation of relative position between the block with matching point and the searching area determined to decide whether to conduct precise matching search or to construct a new search area in the gradient direction. The target tracking experiment results show that over 70% time cost can be reduced caompared with the conventional correlation matching algorithm based on full search method.展开更多
Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s yst...Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s ystem and a method for determining 3D motion parameters of an object from binocu lar sequence images are introduced. The main steps include camera calibration, t he matching of motion and stereo images, 3D feature point correspondences and re solving the motion parameters. Finally, the experimental results of acquiring th e motion parameters of the objects with uniform velocity and acceleration in the straight line based on the real binocular sequence images by the mentioned meth od are presented.展开更多
Recently,stereo matching algorithms based on end-to-end convolutional neural networks achieve excellent performance far exceeding traditional algorithms.Current state-of-the-art stereo matching networks mostly rely on...Recently,stereo matching algorithms based on end-to-end convolutional neural networks achieve excellent performance far exceeding traditional algorithms.Current state-of-the-art stereo matching networks mostly rely on full cost volume and 3D convolutions to regress dense disparity maps.These modules are computationally complex and high consumption of memory,and difficult to deploy in real-time applications.To overcome this problem,we propose multilevel disparity reconstruction network,MDRNet,a lightweight stereo matching network without any 3D convolutions.We use stacked residual pyramids to gradually reconstruct disparity maps from low-level resolution to full-level resolution,replacing common 3D computation and optimization convolutions.Our approach achieves a competitive performance compared with other algorithms on stereo benchmarks and real-time inference at 30 frames per second with 4×104 resolutions.展开更多
In this paper, we proposed a novel Two-layer Motion Estimation(TME) which searches motion vectors on two layers with partial distortion measures in order to reduce the overwhelming computational complexity of Motion E...In this paper, we proposed a novel Two-layer Motion Estimation(TME) which searches motion vectors on two layers with partial distortion measures in order to reduce the overwhelming computational complexity of Motion Estimation(ME) in video coding. A layer is an image which is derived from the reference frame such that the sum of a block of pixels in the reference frame determines the point of a layer. It has been noticed on different video sequences that many motion vectors on the layers are the same as those searched on the reference frame. The proposed TME performs a coarse search on the first layer to identify the small region in which the best candidate block is likely to be positioned and then perform local refined search on the next layer to pick the best candidate block in the located small area. The key feature of TME is its flexibility of mixing with any fast search algorithm. Experimental results on a wide variety of video sequences show that the proposed algorithm has achieved both fast speed and good motion prediction quality when compared to well known as well as the state-of-the-art fast block matching algorithms.展开更多
Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes ...Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.展开更多
This paper presents the approaches to real-time motion planning for robot application inflexible manufacturing systems(FMS).They are based on an algorithm for fast mapping ob-stacles from a workspace(W-space)into a co...This paper presents the approaches to real-time motion planning for robot application inflexible manufacturing systems(FMS).They are based on an algorithm for fast mapping ob-stacles from a workspace(W-space)into a configuration space(C-space)by defining funda-mental obstacles in W-space.To plan a collision-free path in a multiple robot system,sweptvolumes produced during master robot motion are computed as additional moving obstacleswhen a collision-free path for a slave robot is generated.For motion planning with many de-grees of freedom,several types of reactive behavior are defined to coordinate motion conflictsbetween different links.展开更多
基金financially supported by the National Basic Research Program of China(973 Program,Grant No.2014CB046203)
文摘A domain decomposition and matching method in the time-domain is outlined for simulating the motions of ships advancing in waves. The flow field is decomposed into inner and outer domains by an imaginary control surface, and the Rankine source method is applied to the inner domain while the transient Green function method is used in the outer domain. Two initial boundary value problems are matched on the control surface. The corresponding numerical codes are developed, and the added masses, wave exciting forces and ship motions advancing in head sea for Series 60 ship and S175 containership, are presented and verified. A good agreement has been obtained when the numerical results are compared with the experimental data and other references. It shows that the present method is more efficient because of the panel discretization only in the inner domain during the numerical calculation, and good numerical stability is proved to avoid divergence problem regarding ships with flare.
基金This work was supported in part by the National Nature Science Foundation of China(51922059)in part by the Beijing Natural Science Foundation(JQ19010)in part by the China Postdoctoral Science Foundation(2021T140371).
文摘With regard to precision/ultra-precision motion systems,it is important to achieve excellent tracking performance for various trajectory tracking tasks even under uncertain external disturbances.In this paper,to overcome the limitation of robustness to trajectory variations and external disturbances in offline feedforward compensation strategies such as iterative learning control(ILC),a novel real-time iterative compensation(RIC)control framework is proposed for precision motion systems without changing the inner closed-loop controller.Specifically,the RIC method can be divided into two parts,i.e.,accurate model prediction and real-time iterative compensation.An accurate prediction model considering lumped disturbances is firstly established to predict tracking errors at future sampling times.In light of predicted errors,a feedforward compensation term is developed to modify the following reference trajectory by real-time iterative calculation.Both the prediction and compen-sation processes are finished in a real-time motion control sampling period.The stability and convergence of the entire control system after real-time iterative compensation is analyzed for different conditions.Various simulation results consistently demonstrate that the proposed RIC framework possesses satisfactory dynamic regulation capability,which contributes to high tracking accuracy comparable to ILC or even better and strong robustness.
基金supported by the National Natural Science Foundation of China,No.90307013,90707005,61534003the Science&Technology Pillar Program of Jiangsu Province in China,No.BE2013706
文摘Voluntary participation of hemiplegic patients is crucial for functional electrical stimulation therapy.A wearable functional electrical stimulation system has been proposed for real-time volitional hand motor function control using the electromyography bridge method.Through a series of novel design concepts,including the integration of a detecting circuit and an analog-to-digital converter,a miniaturized functional electrical stimulation circuit technique,a low-power super-regeneration chip for wireless receiving,and two wearable armbands,a prototype system has been established with reduced size,power,and overall cost.Based on wrist joint torque reproduction and classification experiments performed on six healthy subjects,the optimized surface electromyography thresholds and trained logistic regression classifier parameters were statistically chosen to establish wrist and hand motion control with high accuracy.Test results showed that wrist flexion/extension,hand grasp,and finger extension could be reproduced with high accuracy and low latency.This system can build a bridge of information transmission between healthy limbs and paralyzed limbs,effectively improve voluntary participation of hemiplegic patients,and elevate efficiency of rehabilitation training.
基金This work was supported by the National Natural Science Foundation of China(Grants Nos.41972287 and 42090023)the Second Tibetan Plateau Scientific Expedition and Research Program(STEP)(Grant No.2019QZKK0904).
文摘Block-in-matrix-soils(bimsoils)are geological mixtures that have distinct structures consisting of relatively strong rock blocks and weak matrix soils.It is still a challenge to evaluate the mechanical behaviors of bimsoils because of the heterogeneity,chaotic structure,and lithological variability.As a result,only very limited laboratory studies have been reported on the evolution of their internal deformation.In this study,the deformation evolution of bimsoils under uniaxial loading is investigated using real-time X-ray computed tomography(CT)and image correlation algorithm(with a rock block percentage(RBP)of 40%).Three parameters,i.e.heterogeneity coefficient(K),correlation coefficient(CC),and standard deviation(STD)of displacement fields,are proposed to quantify the heterogeneity of the motion of the rock blocks and the progressive deformation of the bimsoils.Experimental results show that the rock blocks in bimsoils are prone to forming clusters with increasing loading,and the sliding surface goes around only one side of a cluster.Based on the movement of the rock blocks recorded by STD and CC,the progressive deformation of the bimsoils is quantitatively divided into three stages:initialization of the rotation of rock blocks,formation of rock block clusters,and formation of a shear band by rock blocks with significant rotation.Moreover,the experimental results demonstrate that the meso-motion of rock blocks controls the macroscopic mechanical properties of the samples.
文摘This paper proposes an electronic image stabilization algorithm based on efficient block matching on the plane. This algorithm uses a hexagonal search algorithm, and uses the bit-planes to estimate and compensate for the translational motion between video sequences at the same time;As for the rotary motion vector generated in the video sequences, in order to highlight the intensity change of the image sequence, the algorithm firstly conducts Laplace transform for the reference frame, then select a number of characteristics at the image edge to make block matching with the current frame, calculate and compensate for the rotational movement that may exist finally. Through theoretical analysis and simula-tion, we prove that, as for a mixed translational and rotational motion video sequences, the proposed algorithm can reduce required time for block matching computation ,while improving the accuracy of the electronic image stabilization.
基金Supported by the Natural Science Foundation of China(62072388,62276146)the Industry Guidance Project Foundation of Science technology Bureau of Fujian province(2020H0047)+2 种基金the Natural Science Foundation of Science Technology Bureau of Fujian province(2019J01601)the Creation Fund project of Science Technology Bureau of Fujian province(JAT190596)Putian University Research Project(2022034)。
文摘Background Image matching is crucial in numerous computer vision tasks such as 3D reconstruction and simultaneous visual localization and mapping.The accuracy of the matching significantly impacted subsequent studies.Because of their local similarity,when image pairs contain comparable patterns but feature pairs are positioned differently,incorrect recognition can occur as global motion consistency is disregarded.Methods This study proposes an image-matching filtering algorithm based on global motion consistency.It can be used as a subsequent matching filter for the initial matching results generated by other matching algorithms based on the principle of motion smoothness.A particular matching algorithm can first be used to perform the initial matching;then,the rotation and movement information of the global feature vectors are combined to effectively identify outlier matches.The principle is that if the matching result is accurate,the feature vectors formed by any matched point should have similar rotation angles and moving distances.Thus,global motion direction and global motion distance consistencies were used to reject outliers caused by similar patterns in different locations.Results Four datasets were used to test the effectiveness of the proposed method.Three datasets with similar patterns in different locations were used to test the results for similar images that could easily be incorrectly matched by other algorithms,and one commonly used dataset was used to test the results for the general image-matching problem.The experimental results suggest that the proposed method is more accurate than other state-of-the-art algorithms in identifying mismatches in the initial matching set.Conclusions The proposed outlier rejection matching method can significantly improve the matching accuracy for similar images with locally similar feature pairs in different locations and can provide more accurate matching results for subsequent computer vision tasks.
基金supported by the National Natural Science Foundation of China(61471194)the Fundamental Research Funds for the Central Universities+2 种基金the Science and Technology on Avionics Integration Laboratory and Aeronautical Science Foundation of China(20155552050)the CASC(China Aerospace Science and Technology Corporation) Aerospace Science and Technology Innovation Foundation Projectthe Nanjing University of Aeronautics And Astronautics Graduate School Innovation Base(Laboratory)Open Foundation Program(kfjj20151505)
文摘The traditional oriented FAST and rotated BRIEF(ORB) algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB(MORB) algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi(KLT). By using Kalman, the object's state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.
基金supported by the Yayasan Universiti Teknologi PETRONAS Grants,YUTP-PRG(015PBC-027)YUTP-FRG(015LC0-311),Hilmi Hasan,www.utp.edu.my.
文摘Medical imaging plays a key role within modern hospital management systems for diagnostic purposes.Compression methodologies are extensively employed to mitigate storage demands and enhance transmission speed,all while upholding image quality.Moreover,an increasing number of hospitals are embracing cloud computing for patient data storage,necessitating meticulous scrutiny of server security and privacy protocols.Nevertheless,considering the widespread availability of multimedia tools,the preservation of digital data integrity surpasses the significance of compression alone.In response to this concern,we propose a secure storage and transmission solution for compressed medical image sequences,such as ultrasound images,utilizing a motion vector watermarking scheme.The watermark is generated employing an error-correcting code known as Bose-Chaudhuri-Hocquenghem(BCH)and is subsequently embedded into the compressed sequence via block-based motion vectors.In the process of watermark embedding,motion vectors are selected based on their magnitude and phase angle.When embedding watermarks,no specific spatial area,such as a region of interest(ROI),is used in the images.The embedding of watermark bits is dependent on motion vectors.Although reversible watermarking allows the restoration of the original image sequences,we use the irreversible watermarking method.The reason for this is that the use of reversible watermarks may impede the claims of ownership and legal rights.The restoration of original data or images may call into question ownership or other legal claims.The peak signal-to-noise ratio(PSNR)and structural similarity index(SSIM)serve as metrics for evaluating the watermarked image quality.Across all images,the PSNR value exceeds 46 dB,and the SSIM value exceeds 0.92.Experimental results substantiate the efficacy of the proposed technique in preserving data integrity.
文摘Ship motions induced by waves have a significant impact on the efficiency and safety of offshore operations.Real-time prediction of ship motions in the next few seconds plays a crucial role in performing sensitive activities.However,the obvious memory effect of ship motion time series brings certain difficulty to rapid and accurate prediction.Therefore,a real-time framework based on the Long-Short Term Memory(LSTM)neural network model is proposed to predict ship motions in regular and irregular head waves.A 15000 TEU container ship model is employed to illustrate the proposed framework.The numerical implementation and the real-time ship motion prediction in irregular head waves corresponding to the different time scales are carried out based on the container ship model.The related experimental data were employed to verify the numerical simulation results.The results show that the proposed method is more robust than the classical extreme short-term prediction method based on potential flow theory in the prediction of nonlinear ship motions.
基金National Natural Science Foundation of ChinaUnder Grant No.50278090
文摘This article describes a hybrid simulation method to generate artificial ground motion time histories that are compatible with specified peak seismic acceleration, velocity and displacement as well as the target response spectrum of absolute acceleration. First, based on traditional methods that match the target spectrum in the frequency domain, an initial acceleration time history was synthesized to satisfy the specified peak acceleration, target spectral acceleration and intensity envelope. Second, by using the inversion formula of the seismic input to a linear single-degree-of-freedom system and by superimposing a series of narrow-band time histories in the time domain, the initial time history is further modified to allow its peak velocity and displacement to approach the targets and improve its matching precision with the target spectrum. Numerical examples are provided to demonstrate that the proposed method achieves good agreement with the target values.
基金Supported by the National Science Foundation of China(61472289)Hubei Province Science Foundation(2015CFB254)
文摘Target tracking is very important in computer vision and related areas. It is usually difficult to accurately track fast motion target with appearance variations. Sometimes the tracking algorithms fail for heavy appearance variations. A multiple template method to track fast motion target with appearance changes is presented under the framework of appearance model with Kalman filter. Firstly, we construct a multiple template appearance model, which includes both the original template and templates affinely transformed from original one. Generally speaking, appearance variations of fast motion target can be covered by affine transformation. Therefore, the affine tr templates match the target of appearance variations better than conventional models. Secondly, we present an improved Kalman filter for approx- imate estimating the motion trail of the target and a modified similarity evaluation function for exact matching. The estimation approach can reduce time complexity of the algorithm and keep accuracy in the meantime. Thirdly, we propose an adaptive scheme for updating template set to alleviate the drift problem. The scheme considers the following differences: the weight differences in two successive frames; different types of affine transformation applied to templates. Finally, experiments demonstrate that the proposed algorithm is robust to appearance varia- tion of fast motion target and achieves real-time performance on middle/low-range computing platform.
文摘This paper proposes an intelligent controller for motion control of robotic systems to obtain high precision tracking without the need for a real-time trial and error method.In addition, a new self-tuning algorithm has been developed based on both the ant colony algorithm and a fuzzy system for real-time tuning of controller parameters. Simulations and experiments using a real robot have been addressed to demonstrate the success of the proposed controller and validate the theoretical analysis. Obtained results confirm that the proposed controller ensures robust performance in the presence of disturbances and parametric uncertainties without the need for adjustment of control law parameters by a trial and error method.
基金the Grants from the National Natural Science Foundation of China, No. 60775019, 60970062the Shanghai Pujiang Program, No. 09PJ1410200the Project-sponsored by SRF for ROCS, SEM
文摘The present study used electroencephalography to examine mu rhythm suppression (a putative index of human mirror neuron system activation) at frontal sites (F3, Fz and F4), central sites (C3, Cz and C4), parietal sites (P3, Pz and P4) and occipital sites (O1 and O2), while subjects observed real hand motion (real hand motion condition) and illustrative depictions of hand motion (drawn hand motion condition). Experimental data revealed that mu rhythm suppression was exhibited in the mirror neuron system when subjects observed both real and drawn hand motion. Moreover, the mu rhythm recorded at the F3, Fz, F4, and Pz poles was significantly suppressed while observing both stimulus types, but no obvious mu suppression occurred at the O1, 02 and 03 poles. These results suggest that the observation of drawings of human hand actions can activate the human mirror neuron system. This evidence supports the hypothesis that the mirror neuron system may be involved in intransitively abstract action understanding.
基金Sponsored by the National Defense Pre-Research Foundation of China
文摘A correlation tracking algorithm based on template partition motion estimation proposed for improving real time performance of the conventional correlation matching algorithms. The target trajectory fitted using the least square with equal space in whole interval and the target prediction point is found out. According to the requirements of block motion estimation(BME) algorithm,the template divided into some macro blocks. The searching process is conducted by using diamond search algorithm around the prediction point and the optimal motion vector of each block is calculated. A point corresponding to the motion vector with the best matching is taken as a rough matching point of the template. The relation of relative position between the block with matching point and the searching area determined to decide whether to conduct precise matching search or to construct a new search area in the gradient direction. The target tracking experiment results show that over 70% time cost can be reduced caompared with the conventional correlation matching algorithm based on full search method.
文摘Exactly capturing three dimensional (3D) motion i nf ormation of an object is an essential and important task in computer vision, and is also one of the most difficult problems. In this paper, a binocular vision s ystem and a method for determining 3D motion parameters of an object from binocu lar sequence images are introduced. The main steps include camera calibration, t he matching of motion and stereo images, 3D feature point correspondences and re solving the motion parameters. Finally, the experimental results of acquiring th e motion parameters of the objects with uniform velocity and acceleration in the straight line based on the real binocular sequence images by the mentioned meth od are presented.
文摘Recently,stereo matching algorithms based on end-to-end convolutional neural networks achieve excellent performance far exceeding traditional algorithms.Current state-of-the-art stereo matching networks mostly rely on full cost volume and 3D convolutions to regress dense disparity maps.These modules are computationally complex and high consumption of memory,and difficult to deploy in real-time applications.To overcome this problem,we propose multilevel disparity reconstruction network,MDRNet,a lightweight stereo matching network without any 3D convolutions.We use stacked residual pyramids to gradually reconstruct disparity maps from low-level resolution to full-level resolution,replacing common 3D computation and optimization convolutions.Our approach achieves a competitive performance compared with other algorithms on stereo benchmarks and real-time inference at 30 frames per second with 4×104 resolutions.
文摘In this paper, we proposed a novel Two-layer Motion Estimation(TME) which searches motion vectors on two layers with partial distortion measures in order to reduce the overwhelming computational complexity of Motion Estimation(ME) in video coding. A layer is an image which is derived from the reference frame such that the sum of a block of pixels in the reference frame determines the point of a layer. It has been noticed on different video sequences that many motion vectors on the layers are the same as those searched on the reference frame. The proposed TME performs a coarse search on the first layer to identify the small region in which the best candidate block is likely to be positioned and then perform local refined search on the next layer to pick the best candidate block in the located small area. The key feature of TME is its flexibility of mixing with any fast search algorithm. Experimental results on a wide variety of video sequences show that the proposed algorithm has achieved both fast speed and good motion prediction quality when compared to well known as well as the state-of-the-art fast block matching algorithms.
文摘Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.
基金the High Technology Research and Development Programme of China.
文摘This paper presents the approaches to real-time motion planning for robot application inflexible manufacturing systems(FMS).They are based on an algorithm for fast mapping ob-stacles from a workspace(W-space)into a configuration space(C-space)by defining funda-mental obstacles in W-space.To plan a collision-free path in a multiple robot system,sweptvolumes produced during master robot motion are computed as additional moving obstacleswhen a collision-free path for a slave robot is generated.For motion planning with many de-grees of freedom,several types of reactive behavior are defined to coordinate motion conflictsbetween different links.