Vision-based fatigue crack detection using global motion compensation and video feature tracking

Fatigue cracks that develop in civil infrastructure such as steel bridges due to repetitive loads pose a major threat to structural integrity.Despite being the most common practice for fatigue crack detection,human visual inspection is known to be labor intensive,time-consuming,and prone to error.In this study,a computer vision-based fatigue crack detection approach using a short video recorded under live loads by a moving consumer-grade camera is presented.The method detects fatigue crack by tracking surface motion and identifies the differential motion pattern caused by opening and closing of the fatigue crack.However,the global motion introduced by a moving camera in the recorded video is typically far greater than the actual motion associated with fatigue crack opening/closing,leading to false detection results.To overcome the challenge,global motion compensation(GMC)techniques are introduced to compensate for camera-induced movement.In particular,hierarchical model-based motion estimation is adopted for 2D videos with simple geometry and a new method is developed by extending the bundled camera paths approach for 3D videos with complex geometry.The proposed methodology is validated using two laboratory test setups for both in-plane and out-of-plane fatigue cracks.The results confirm the importance of motion compensation for both 2D and 3D videos and demonstrate the effectiveness of the proposed GMC methods as well as the subsequent crack detection algorithm.

Abnormal Crowd Behavior Detection Using Optimized Pyramidal Lucas-Kanade Technique

Abnormal behavior detection is challenging and one of the growing research areas in computer vision.The main aim of this research work is to focus on panic and escape behavior detections that occur during unexpected/uncertain events.In this work,Pyramidal Lucas Kanade algorithm is optimized using EME-HOs to achieve the objective.First stage,OPLKT-EMEHOs algorithm is used to generate the opticalflow from MIIs.Second stage,the MIIs opticalflow is applied as input to 3 layer CNN for detect the abnormal crowd behavior.University of Minnesota(UMN)dataset is used to evaluate the proposed system.The experi-mental result shows that the proposed method provides better classification accu-racy by comparing with the existing methods.Proposed method provides 95.78%of precision,90.67%of recall,93.09%of f-measure and accuracy with 91.67%.

A New Fire Detection Method Using a Multi-Expert System Based on Color Dispersion, Similarity and Centroid Motion in Indoor Environment

In this paper, a video fire detection method is proposed, which demonstrated good performance in indoor environment. Three main novel ideas have been introduced. Firstly, a flame color model in RGB and HIS color space is used to extract pre-detected regions instead of traditional motion differential method, as it’s more suitable for fire detection in indoor environment. Secondly, according to the flicker characteristic of the flame, similarity and two main values of centroid motion are proposed. At the same time, a simple but effective method for tracking the same regions in consecutive frames is established. Thirdly,a multi-expert system consisting of color component dispersion,similarity and centroid motion is established to identify flames.The proposed method has been tested on a very large dataset of fire videos acquired both in real indoor environment tests and from the Internet. The experimental results show that the proposed approach achieved a balance between the false positive rate and the false negative rate, and demonstrated a better performance in terms of overall accuracy and F standard with respect to other similar fire detection methods in indoor environment.

ACCURATE DETECTION OF HIGH-SPEED MULTI-TARGET VIDEO SEQUENCES MOTION REGIONS BASED ON RECONSTRUCTED BACKGROUND DIFFERENCE

The paper first discusses shortcomings of classical adjacent-frame difference. Sec ondly, based on the image energy and high order statistic(HOS) theory, background reconstruction constraints are setup. Under the help of block-processing technology, background is reconstructed quickly. Finally, background difference is used to detect motion regions instead of adjacent frame difference. The DSP based platform tests indicate the background can be recovered losslessly in about one second, and moving regions are not influenced by moving target speeds. The algorithm has important usage both in theory and applications.

Design of motion control system of pipeline detection AUV

A great number of pipelines in China are in unsatisfactory condition and faced with problems of corrosion and cracking,but there are very few approaches for underwater pipeline detection.Pipeline detection autonomous underwater vehicle(PDAUV) is hereby designed to solve these problems when working with advanced optical,acoustical and electrical sensors for underwater pipeline detection.PDAUV is a test bed that not only examines the logical rationality of the program,effectiveness of the hardware architecture,accuracy of the software interface protocol as well as the reliability and stability of the control system but also verifies the effectiveness of the control system in tank experiments and sea trials.The motion control system of PDAUV,including both the hardware and software architectures,is introduced in this work.The software module and information flow of the motion control system of PDAUV and a novel neural network-based control(NNC) are also covered.Besides,a real-time identification method based on neural network is used to realize system identification.The tank experiments and sea trials are carried out to verify the feasibility and capability of PDAUV control system to complete underwater pipeline detection task.

Gonorrhea cluster detection in Manitoba,Canada:Spatial,temporal,and spatio-temporal analysis

In Canada,Gonorrhea infection ranks as the second most prevalent sexually transmitted infection.In 2018,Manitoba reported an incidence rate three times greater than the national average.This study aims to investigate the spatial,temporal,and spatio-temporal patterns of Gonorrhea infection in Manitoba,using individual-level laboratory-confirmed administrative data provided by Manitoba Health from 2000 to 2016.Age and sex patterns indicate that females are affected by infections at younger ages compared to males.Moreover,there is an increase in repeated infections in 2016,accounting for 16%of the total infections.Spatial analysis at the 96 Manitoba regional health authority districts highlights significant positive spatial autocorrelation,demonstrating a clustered distribution of the infection.Northern districts of Manitoba and central Winnipeg were identified as significant clusters.Temporal analysis shows seasonal patterns,with higher infections in late summer and fall.Additionally,spatio-temporal analysis reveals clusters during high-risk periods,with the most likely cluster in the northern districts of Manitoba from January 2006 to June 2014,and a secondary cluster in central Winnipeg from June 2004 to November 2012.This study identifies that Gonorrhea infection transmission in Manitoba has temporal,spatial,and spatio-temporal variations.The findings provide vital insights for public health and Manitoba Health by revealing high-risk clusters and emphasizing the need for focused and localized prevention,control measures,and resource allocation.

An attention graph stacked autoencoder for anomaly detection of electro-mechanical actuator using spatio-temporal multivariate signals

Health monitoring of electro-mechanical actuator(EMA)is critical to ensure the security of airplanes.It is difficult or even impossible to collect enough labeled failure or degradation data from actual EMA.The autoencoder based on reconstruction loss is a popular model that can carry out anomaly detection with only consideration of normal training data,while it fails to capture spatio-temporal information from multivariate time series signals of multiple monitoring sensors.To mine the spatio-temporal information from multivariate time series signals,this paper proposes an attention graph stacked autoencoder for EMA anomaly detection.Firstly,attention graph con-volution is introduced into autoencoder to convolve temporal information from neighbor features to current features based on different weight attentions.Secondly,stacked autoencoder is applied to mine spatial information from those new aggregated temporal features.Finally,based on the bench-mark reconstruction loss of normal training data,different health thresholds calculated by several statistic indicators can carry out anomaly detection for new testing data.In comparison with tra-ditional stacked autoencoder,the proposed model could obtain higher fault detection rate and lower false alarm rate in EMA anomaly detection experiment.

IMAGE OBJECT DETECTION BASED ON FRACTIONAL BROWNIAN MOTION

Fractional Brownian motion, continuous everywhere and differentiable nowhere, offers a convenient modeling for irregular nonstationary stochastic processes with long-term dependencies and power law behavior of spectrum over wide ranges of frequencies. It shows high correlation at coarse scale and varies slightly at fine scale, which is suitable for and successful in describing and modeling natural scenes. On the other hand, man-made objects can be constructively well described by using a set of regular simple shape primitives such as line, cylinder, etc. and are free of fractal. Based on the difference, a method to discriminate man-made objects from natural scenes is provided. Experiments are used to demonstrate the good efficiency of developed technique.

Head Motion Detection in Gaze Based Aiming

Unmanned weapons have great potential to be widely used in future wars.The gaze-based aiming technology can be applied to control pan-tilt weapon systems remotely with high precision and efficiency.Gaze direction is related to head motion,which is a combination of head and eye movements.In this paper,a head motion detection method is proposed,which is based on the fusion of inertial and vision information.The inertial sensors can measure rotation in high-frequency with good performance,while vision sensors are able to eliminate drifts.By combining the characteristics of both sensors,the proposed approach achieves the effect of highfrequency,real-time,and drift-free head motion detection.The experiments show that our method can smooth the outputs,constrain drifts of inertial measurements,and achieve high detection accuracy.

An improved spatio-temporal-SNR FGS video coding scheme using motion compensation on enhancement layers

In this paper an effective MC ＋ FGSST structure is explored, which is appropriate for scalable video coding. The structure obtains spatio-temporal-SNR fine granular scalability, and achieves high coding efficiency at the same time. Users can acquire their necessary scalability by choosing and combining them. Then, a high-powered codec solution based on this structure is presented. Subsequently, a focus issue on the right number of bit-planes should be used for motion compensation is discussed, and an algorithm is presented for this issue. The proposed codec saves a lot of hardware expense. Simulation results indicate that the performance of MC ＋ FGSST structure is superior to that of FGSST structure.

Automatic Anomaly Detection of Respiratory Motion Based on Singular Spectrum Analysis

The realization of automatic anomaly detection of respiratory motion could be very useful to prevent accidental damage during radiation therapy. In this paper, we proposed an automatic anomaly detection method using singular value decomposition analysis. Before applying this method, the investigator needs a normal respiratory motion data of a patient. From these data, a trajectory matrix representing normal time-series feature is created. Decomposing the matrix, we obtained the feature of normal time series. Then, we applied the same procedure to real-time data and obtained real-time features. Calculating the similarity of those feature matrixes, an anomaly score was obtained. Patient motion was observed by a depth camera. In our simulation, two types of motion e.g. cough and sudden stop of breathing were successfully detected, while gradual change of respiratory cycle frequency was not detected clearly.

Vehicle detection method for expressway by MPEG compressed domain

A method which extracts traffic information from an MPEG-2 compressed video is proposed. According to the features of vehicle motion, the motion vector of a macro-block is used to detect moving vehicles in daytime, and a filter algorithm for removing noises of motion vectors is given. As the brightness of the headlights is higher than that of the background in night images, discrete cosine transform （DCT）coefficient of image block is used to detect headlights of vehicles at night, and an algorithm for calculating the DCT coefficients of P-frames is introduced. In order to prevent moving objects outside the expressway and video shot changes from disturbing the detection, a driveway location method and a video-shot-change detection algorithm are suggested. The detection rate is 97.4% in daytime and 95.4% in nighttime by this method. The results prove that this vehicle detection method is effective.

Suitable triggering algorithms for detecting strong ground motions using MEMS accelerometers

With the recent development of digital Micro Electro Mechanical System （MEMS） sensors, the cost of monitoring and detecting seismic events in real time can be greatly reduced. Ability of MEMS accelerograph to record a seismic event depends upon the efficiency of triggering algorithm, apart from the sensor＇s sensitivity. There are several classic triggering algorithms developed to detect seismic events, ranging from basic amplitude threshold to more sophisticated pattern recognition. Algorithms based on STA/LTA are reported to be computationally efficient for real time monitoring. In this paper, we analyzed several STA/LTA algorithms to check their efficiency and suitability using data obtained from the Quake Catcher Network （network of MEMS accelerometer stations）. We found that most of the STA/LTA algorithms are suitable for use with MEMS accelerometer data to accurately detect seismic events. However, the efficiency of any particular algorithm is found to be dependent on the parameter set used （i.e., window width of STA, LTA and threshold level）.

Moving object detection method based on complementary multi resolution background models

A novel moving object detection method was proposed in order to adapt the difficulties caused by intermittent object motion,thermal and dynamic background sequences.Two groups of complementary Gaussian mixture models were used.The ghost and real static object could be classified by comparing the similarity of the edge images further.In each group,the multi resolution Gaussian mixture models were used and dual thresholds were applied in every resolution in order to get a complete object mask without much noise.The computational color model was also used to depress illustration variations and light shadows.The proposed method was verified by the public test sequences provided by the IEEE Change Detection Workshop and compared with three state-of-the-art methods.Experimental results demonstrate that the proposed method is better than others for all of the evaluation parameters in intermittent object motion sequences.Four and two in the seven evaluation parameters are better than the others in thermal and dynamic background sequences,respectively.The proposed method shows a relatively good performance,especially for the intermittent object motion sequences.

Spatio-temporal Dynamics of Urbanization in China Using DMSP/OLS Nighttime Light Data from 1992–2013

Understanding the dynamics of urbanization is essential to the sustainable development of cities. Meanwhile the analysis of urban development can also provide scientifically and effective information for decision-making. With the long-term Defense Meteorological Satellite Program’s Operational Linescan System(DMSP/OLS) nighttime light images, a pixel level assessment of urbanization of China from 1992 to 2013 was conducted in this study, and the spatio-temporal dynamics and future trends of urban development were fully detected. The results showed that the urbanization and urban dynamics of China experienced drastic fluctuations from 1992 to 2013, especially for those in the coastal and metropolitan areas. From a regional perspective, it was found that the urban dynamics and increasing trends in North Coast China, East Coast China and South Coast China were much more stable and significant than that in other regions. Moreover, with the sustainability estimating of nighttime light dynamics, the regional agglomeration trends of urban regions were also detected. The light intensity in nearly 50% of lighted pixels may continuously decrease in the future, indicating a severe situation of urbanization within these regions. In this study, The results revealed in this study can provided a new insight in long time urbanization detecting and is thus beneficial to the better understanding of trends and dynamics of urban development.

TARGET DETECTION USING MULTI-RESOLUTION ANALYSIS AND HOLDER CONSTANT

Through analyzing the different height parameter of 3D surface between the artificial target and complex background based on the description of average Holder constant of fractional Brownian motion, a novel method of target detection based on wavelet transformation and Holder constant is proposed. The wavelet Holder constants are calculated and linearly interpolated in a series of images, the target is detected by testing the linearity errof The more accurate localization can be achieved using two images of the same region but with difIerent scaling parameters.The application results of this algorithm for target detection are also given, and show that this method has good performance of noise immunity. This method is also suitable for identifying specific targets in complex background.

Video Analysis Based on Volumetric Event Detection

During the past decade, feature extraction and knowledge acquisition based on video analysis have been extensively researched and tested on many applications such as closed-circuit television （CCTV） data analysis, large-scale public event control, and other daily security monitoring and surveillance operations with various degrees of success. However, since the actual video process is a multi-phased one and encompasses extensive theories and techniques ranging from fundamental image processing, computational geometry and graphics, and machine vision, to advanced artificial intelligence, pattern analysis, and even cognitive science, there are still many important problems to resolve before it can be widely applied. Among them, video event identification and detection are two prominent ones. Comparing with the most popular frame-to-frame processing mode of most of today＇s approaches and systems, this project reorganizes video data as a 3D volume structure that provides the hybrid spatial and temporal information in a unified space. This paper reports an innovative technique to transform original video frames to 3D volume structures denoted by spatial and temporal features. It then highlights the volume array structure in a so-called ＂pre-suspicion＂ mechanism for a later process. The focus of this report is the development of an effective and efficient voxel-based segmentation technique suitable to the volumetric nature of video events and ready for deployment in 3D clustering operations. The paper is concluded with a performance evaluation of the devised technique and discussion on the future work for accelerating the pre-processing of the original video data.

Vision-based aerial image mosaicking algorithm with object detection

Aerial image sequence mosaicking is one of the chal-lenging research fields in computer vision.To obtain large-scale orthophoto maps with object detection information,we propose a vision-based image mosaicking algorithm without any extra location data.According to object detection results,we define a complexity factor to describe the importance of each input ima-ge and dynamically optimize the feature extraction process.The feature points extraction and matching processes are mainly guided by the speeded-up robust features(SURF)and the grid motion statistic(GMS)algorithm respectively.A robust refer-ence frame selection method is proposed to eliminate the trans-formation distortion by searching for the center area based on overlaps.Besides,the sparse Levenberg-Marquardt(LM)al-gorithm and the heavy occluded frames removal method are ap-plied to reduce accumulated errors and further improve the mo-saicking performance.The proposed algorithm is performed by using multithreading and graphics processing unit(GPU)accel-eration on several aerial image datasets.Extensive experiment results demonstrate that our algorithm outperforms most of the existing aerial image mosaicking methods in visual quality while guaranteeing a high calculation speed.