Vision-based fatigue crack detection using global motion compensation and video feature tracking

Fatigue cracks that develop in civil infrastructure such as steel bridges due to repetitive loads pose a major threat to structural integrity.Despite being the most common practice for fatigue crack detection,human visual inspection is known to be labor intensive,time-consuming,and prone to error.In this study,a computer vision-based fatigue crack detection approach using a short video recorded under live loads by a moving consumer-grade camera is presented.The method detects fatigue crack by tracking surface motion and identifies the differential motion pattern caused by opening and closing of the fatigue crack.However,the global motion introduced by a moving camera in the recorded video is typically far greater than the actual motion associated with fatigue crack opening/closing,leading to false detection results.To overcome the challenge,global motion compensation(GMC)techniques are introduced to compensate for camera-induced movement.In particular,hierarchical model-based motion estimation is adopted for 2D videos with simple geometry and a new method is developed by extending the bundled camera paths approach for 3D videos with complex geometry.The proposed methodology is validated using two laboratory test setups for both in-plane and out-of-plane fatigue cracks.The results confirm the importance of motion compensation for both 2D and 3D videos and demonstrate the effectiveness of the proposed GMC methods as well as the subsequent crack detection algorithm.

Abnormal Crowd Behavior Detection Using Optimized Pyramidal Lucas-Kanade Technique

Abnormal behavior detection is challenging and one of the growing research areas in computer vision.The main aim of this research work is to focus on panic and escape behavior detections that occur during unexpected/uncertain events.In this work,Pyramidal Lucas Kanade algorithm is optimized using EME-HOs to achieve the objective.First stage,OPLKT-EMEHOs algorithm is used to generate the opticalflow from MIIs.Second stage,the MIIs opticalflow is applied as input to 3 layer CNN for detect the abnormal crowd behavior.University of Minnesota(UMN)dataset is used to evaluate the proposed system.The experi-mental result shows that the proposed method provides better classification accu-racy by comparing with the existing methods.Proposed method provides 95.78%of precision,90.67%of recall,93.09%of f-measure and accuracy with 91.67%.

A New Fire Detection Method Using a Multi-Expert System Based on Color Dispersion, Similarity and Centroid Motion in Indoor Environment

In this paper, a video fire detection method is proposed, which demonstrated good performance in indoor environment. Three main novel ideas have been introduced. Firstly, a flame color model in RGB and HIS color space is used to extract pre-detected regions instead of traditional motion differential method, as it’s more suitable for fire detection in indoor environment. Secondly, according to the flicker characteristic of the flame, similarity and two main values of centroid motion are proposed. At the same time, a simple but effective method for tracking the same regions in consecutive frames is established. Thirdly,a multi-expert system consisting of color component dispersion,similarity and centroid motion is established to identify flames.The proposed method has been tested on a very large dataset of fire videos acquired both in real indoor environment tests and from the Internet. The experimental results show that the proposed approach achieved a balance between the false positive rate and the false negative rate, and demonstrated a better performance in terms of overall accuracy and F standard with respect to other similar fire detection methods in indoor environment.

ACCURATE DETECTION OF HIGH-SPEED MULTI-TARGET VIDEO SEQUENCES MOTION REGIONS BASED ON RECONSTRUCTED BACKGROUND DIFFERENCE

The paper first discusses shortcomings of classical adjacent-frame difference. Sec ondly, based on the image energy and high order statistic(HOS) theory, background reconstruction constraints are setup. Under the help of block-processing technology, background is reconstructed quickly. Finally, background difference is used to detect motion regions instead of adjacent frame difference. The DSP based platform tests indicate the background can be recovered losslessly in about one second, and moving regions are not influenced by moving target speeds. The algorithm has important usage both in theory and applications.

IMAGE OBJECT DETECTION BASED ON FRACTIONAL BROWNIAN MOTION

Fractional Brownian motion, continuous everywhere and differentiable nowhere, offers a convenient modeling for irregular nonstationary stochastic processes with long-term dependencies and power law behavior of spectrum over wide ranges of frequencies. It shows high correlation at coarse scale and varies slightly at fine scale, which is suitable for and successful in describing and modeling natural scenes. On the other hand, man-made objects can be constructively well described by using a set of regular simple shape primitives such as line, cylinder, etc. and are free of fractal. Based on the difference, a method to discriminate man-made objects from natural scenes is provided. Experiments are used to demonstrate the good efficiency of developed technique.

Head Motion Detection in Gaze Based Aiming

Unmanned weapons have great potential to be widely used in future wars.The gaze-based aiming technology can be applied to control pan-tilt weapon systems remotely with high precision and efficiency.Gaze direction is related to head motion,which is a combination of head and eye movements.In this paper,a head motion detection method is proposed,which is based on the fusion of inertial and vision information.The inertial sensors can measure rotation in high-frequency with good performance,while vision sensors are able to eliminate drifts.By combining the characteristics of both sensors,the proposed approach achieves the effect of highfrequency,real-time,and drift-free head motion detection.The experiments show that our method can smooth the outputs,constrain drifts of inertial measurements,and achieve high detection accuracy.

Automatic Anomaly Detection of Respiratory Motion Based on Singular Spectrum Analysis

The realization of automatic anomaly detection of respiratory motion could be very useful to prevent accidental damage during radiation therapy. In this paper, we proposed an automatic anomaly detection method using singular value decomposition analysis. Before applying this method, the investigator needs a normal respiratory motion data of a patient. From these data, a trajectory matrix representing normal time-series feature is created. Decomposing the matrix, we obtained the feature of normal time series. Then, we applied the same procedure to real-time data and obtained real-time features. Calculating the similarity of those feature matrixes, an anomaly score was obtained. Patient motion was observed by a depth camera. In our simulation, two types of motion e.g. cough and sudden stop of breathing were successfully detected, while gradual change of respiratory cycle frequency was not detected clearly.

Design of motion control system of pipeline detection AUV

A great number of pipelines in China are in unsatisfactory condition and faced with problems of corrosion and cracking,but there are very few approaches for underwater pipeline detection.Pipeline detection autonomous underwater vehicle(PDAUV) is hereby designed to solve these problems when working with advanced optical,acoustical and electrical sensors for underwater pipeline detection.PDAUV is a test bed that not only examines the logical rationality of the program,effectiveness of the hardware architecture,accuracy of the software interface protocol as well as the reliability and stability of the control system but also verifies the effectiveness of the control system in tank experiments and sea trials.The motion control system of PDAUV,including both the hardware and software architectures,is introduced in this work.The software module and information flow of the motion control system of PDAUV and a novel neural network-based control(NNC) are also covered.Besides,a real-time identification method based on neural network is used to realize system identification.The tank experiments and sea trials are carried out to verify the feasibility and capability of PDAUV control system to complete underwater pipeline detection task.

Suitable triggering algorithms for detecting strong ground motions using MEMS accelerometers

With the recent development of digital Micro Electro Mechanical System （MEMS） sensors, the cost of monitoring and detecting seismic events in real time can be greatly reduced. Ability of MEMS accelerograph to record a seismic event depends upon the efficiency of triggering algorithm, apart from the sensor＇s sensitivity. There are several classic triggering algorithms developed to detect seismic events, ranging from basic amplitude threshold to more sophisticated pattern recognition. Algorithms based on STA/LTA are reported to be computationally efficient for real time monitoring. In this paper, we analyzed several STA/LTA algorithms to check their efficiency and suitability using data obtained from the Quake Catcher Network （network of MEMS accelerometer stations）. We found that most of the STA/LTA algorithms are suitable for use with MEMS accelerometer data to accurately detect seismic events. However, the efficiency of any particular algorithm is found to be dependent on the parameter set used （i.e., window width of STA, LTA and threshold level）.

Moving object detection method based on complementary multi resolution background models

A novel moving object detection method was proposed in order to adapt the difficulties caused by intermittent object motion,thermal and dynamic background sequences.Two groups of complementary Gaussian mixture models were used.The ghost and real static object could be classified by comparing the similarity of the edge images further.In each group,the multi resolution Gaussian mixture models were used and dual thresholds were applied in every resolution in order to get a complete object mask without much noise.The computational color model was also used to depress illustration variations and light shadows.The proposed method was verified by the public test sequences provided by the IEEE Change Detection Workshop and compared with three state-of-the-art methods.Experimental results demonstrate that the proposed method is better than others for all of the evaluation parameters in intermittent object motion sequences.Four and two in the seven evaluation parameters are better than the others in thermal and dynamic background sequences,respectively.The proposed method shows a relatively good performance,especially for the intermittent object motion sequences.

TARGET DETECTION USING MULTI-RESOLUTION ANALYSIS AND HOLDER CONSTANT

Through analyzing the different height parameter of 3D surface between the artificial target and complex background based on the description of average Holder constant of fractional Brownian motion, a novel method of target detection based on wavelet transformation and Holder constant is proposed. The wavelet Holder constants are calculated and linearly interpolated in a series of images, the target is detected by testing the linearity errof The more accurate localization can be achieved using two images of the same region but with difIerent scaling parameters.The application results of this algorithm for target detection are also given, and show that this method has good performance of noise immunity. This method is also suitable for identifying specific targets in complex background.

Vision-based aerial image mosaicking algorithm with object detection

Aerial image sequence mosaicking is one of the chal-lenging research fields in computer vision.To obtain large-scale orthophoto maps with object detection information,we propose a vision-based image mosaicking algorithm without any extra location data.According to object detection results,we define a complexity factor to describe the importance of each input ima-ge and dynamically optimize the feature extraction process.The feature points extraction and matching processes are mainly guided by the speeded-up robust features(SURF)and the grid motion statistic(GMS)algorithm respectively.A robust refer-ence frame selection method is proposed to eliminate the trans-formation distortion by searching for the center area based on overlaps.Besides,the sparse Levenberg-Marquardt(LM)al-gorithm and the heavy occluded frames removal method are ap-plied to reduce accumulated errors and further improve the mo-saicking performance.The proposed algorithm is performed by using multithreading and graphics processing unit(GPU)accel-eration on several aerial image datasets.Extensive experiment results demonstrate that our algorithm outperforms most of the existing aerial image mosaicking methods in visual quality while guaranteeing a high calculation speed.

Bit Rate Reduction in Cloud Gaming Using Object Detection Technique

The past two decades witnessed a broad-increase in web technology and on-line gaming.Enhancing the broadband confinements is viewed as one of the most significant variables that prompted new gaming technology.The immense utilization of web applications and games additionally prompted growth in the handled devices and moving the limited gaming experience from user devices to online cloud servers.As internet capabilities are enhanced new ways of gaming are being used to improve the gaming experience.In cloud-based video gaming,game engines are hosted in cloud gaming data centers,and compressed gaming scenes are rendered to the players over the internet with updated controls.In such systems,the task of transferring games and video compression imposes huge computational complexity is required on cloud servers.The basic problems in cloud gaming in particular are high encoding time,latency,and low frame rates which require a new methodology for a better solution.To improve the bandwidth issue in cloud games,the compression of video sequences requires an alternative mechanism to improve gaming adaption without input delay.In this paper,the proposed improved methodology is used for automatic unnecessary scene detection,scene removing and bit rate reduction using an adaptive algorithm for object detection in a game scene.As a result,simulations showed without much impact on the players’quality experience,the selective object encoding method and object adaption technique decrease the network latency issue,reduce the game streaming bitrate at a remarkable scale on different games.The proposed algorithm was evaluated for three video game scenes.In this paper,achieved 14.6%decrease in encoding and 45.6%decrease in bit rate for the first video game scene.

Multi-Dimension Support Vector Machine Based Crowd Detection and Localisation Framework for Varying Video Sequences

In this paper, we propose a novel method for anomalous crowd behaviour detection and localization with divergent centers in intelligent video sequence through multiple SVM (support vector machines) based appearance model. In multi-dimension SVM crowd detection, many features are available to track the object robustly with three main features which include 1) identification of an object by gray scale value, 2) histogram of oriented gradients (HOG) and 3) local binary pattern (LBP). We propose two more powerful features namely gray level co-occurrence matrix (GLCM) and Gaber feature for more accurate and authenticate tracking result. To combine and process the corresponding SVMs obtained from each features, a new collaborative strategy is developed on the basis of the confidence distribution of the video samples which are weighted by entropy method. We have adopted subspace evolution strategy for reconstructing the image of the object by constructing an update model. Also, we determine reconstruction error from the samples and again automatically build an update model for the target which is tracked in the video sequences. Considering the movement of the targeted object, occlusion problem is considered and overcome by constructing a collaborative model from that of appearance model and update model. Also if update model is of discriminative model type, binary classification problem is taken into account and overcome by collaborative model. We run the multi-view SVM tracking method in real time with subspace evolution strategy to track and detect the moving objects in the crowded scene accurately. As shown in the result part, our method also overcomes the occlusion problem that occurs frequently while objects under rotation and illumination change due to different environmental conditions.

Fuzzy Logic Recursive Gaussian Denoising of Color Video Sequences via Shot Change Detection

A new technique using fuzzy in a recursive fashion is presented to deal with the Gaussian noise. In this technique, the keyframes and between frames are identified initially and the keyframe is denoised efficiently. This frame is compared with the between frames to remove noise. To do so the frames are partitioned into blocks;the motion vector is calculated;also the difference is measured using the dissimilarity function. If the blocks have no motion vectors in the block, the block of value is copied to the between frames otherwise the difference between the blocks is calculated and this value is filtered with temporal filtering. The blocks are processed in overlapping manner to avoid the blocking effect and also to reduce the additional edges created while processing. The simulation results show that the peak signal to noise ratio of the new technique is improved up to 1 dB and also the execution time is greatly reduced.

Moving Objects Detection Using Intersecting Cortical Model in Enhanced Fish-eye Image

A new method of the moving objects detection using the enhanced fish-eye lens and the intersecting cortical model(ICM) algorithm is proposed. The improved fish-eye lens is designed through controlling the entrance pupils of the lens. This lens has an ultra field of view about 183 degrees,and can image an ellipse picture on the 4∶3 rectangular CCD surface,which increases the CCD utilization and the image resolution. The ICM is a model based on pulse coupled neural network(PCNN) which is especially designed for image processing. It is derived from several visual cortex models and is basically the intersection of these models. The theoretical foundation of the ICM is given. An improved ICM algorithm in which some parameters are modified is used to detect moving objects specially. The experiment indicated that moving objects can be detected reliably and efficiently using ICM algorithm from the elliptical fish-eye image. It can be used in the field of traffic monitoring and other security domains.

利用InSAR形变反演滑坡滑面运动特征——以汶川县布瓦村滑坡为例

当前滑坡滑面运动特征获取多采用接触式手段,费时费力、成本高昂,且仅能获取稀疏点位滑面运动状态。因此,本文提出一种非接触式滑坡滑面运动特征获取方法,其基本思路是:基于位错理论建立滑坡表面形变与滑面运动间的关系模型,同时引入滑面运动平滑约束条件,最终以InSAR等技术获取的地表形变为约束,反演获得滑面运动特征。本文选择四川省汶川县布瓦村滑坡作为研究对象,以时序InSAR技术获取的滑坡坡面升降轨形变数据为约束,基于发展的理论方法反演获得布瓦村滑坡滑面几何与运动学参数,并结合野外勘查、Lidar观测以及模型残差较好地验证了反演结果的可靠性,其中反演升降轨模型残差仅3.1 mm·a^(-1)和3.4 mm·a^(-1)。反演结果显示,布瓦村滑坡滑面位于坡表以下平均~15.0 m深度处,滑面整体以沿坡向运动为主,最大运动量级达~80 mm·a^(-1),同时在坡体西侧中下部发现微量的垂直坡向运动。本文提出方法可方便、快速的获取空间连续的滑坡滑面运动特征,为滑坡灾害预警和失稳风险评估提供更为直接可靠的科学参考。

面向人体运动检测的水凝胶基柔性应变传感器设计

在可穿戴电子设备迅猛发展的背景下,构建面向人体运动检测的可穿戴柔性应变传感器成为目前传感器研究的重点之一。基于聚丙烯酰胺(PAM)、纤维素纳米晶(CNCs)、单宁酸(TA)构建了一种导电水凝胶基柔性应变传感器。机械性能与电学性能测试结果表明,相较于其他柔性应变传感器,聚丙烯酰胺-纤维素纳米晶-单宁酸导电水凝胶基柔性应变传感器具有超长的拉伸范围(0%~2 900%)、较好的黏附性、快速的响应时间(280 ms)和良好的稳定性(超320次加载-卸载循环)。该传感器对人体关节弯曲的大应变与喉部活动的小应变等运动信号具备良好的检测功能,可用作人体运动检测的柔性可穿戴传感器。