A Lightweight Network with Dual Encoder and Cross Feature Fusion for Cement Pavement Crack Detection

Automatic crack detection of cement pavement chiefly benefits from the rapid development of deep learning,with convolutional neural networks(CNN)playing an important role in this field.However,as the performance of crack detection in cement pavement improves,the depth and width of the network structure are significantly increased,which necessitates more computing power and storage space.This limitation hampers the practical implementation of crack detection models on various platforms,particularly portable devices like small mobile devices.To solve these problems,we propose a dual-encoder-based network architecture that focuses on extracting more comprehensive fracture feature information and combines cross-fusion modules and coordinated attention mechanisms formore efficient feature fusion.Firstly,we use small channel convolution to construct shallow feature extractionmodule(SFEM)to extract low-level feature information of cracks in cement pavement images,in order to obtainmore information about cracks in the shallowfeatures of images.In addition,we construct large kernel atrous convolution(LKAC)to enhance crack information,which incorporates coordination attention mechanism for non-crack information filtering,and large kernel atrous convolution with different cores,using different receptive fields to extract more detailed edge and context information.Finally,the three-stage feature map outputs from the shallow feature extraction module is cross-fused with the two-stage feature map outputs from the large kernel atrous convolution module,and the shallow feature and detailed edge feature are fully fused to obtain the final crack prediction map.We evaluate our method on three public crack datasets:DeepCrack,CFD,and Crack500.Experimental results on theDeepCrack dataset demonstrate the effectiveness of our proposed method compared to state-of-the-art crack detection methods,which achieves Precision(P)87.2%,Recall(R)87.7%,and F-score(F1)87.4%.Thanks to our lightweight crack detectionmodel,the parameter count of the model in real-world detection scenarios has been significantly reduced to less than 2M.This advancement also facilitates technical support for portable scene detection.

Pavement Cracks Coupled With Shadows:A New Shadow-Crack Dataset and A Shadow-Removal-Oriented Crack Detection Approach

Automatic pavement crack detection is a critical task for maintaining the pavement stability and driving safety.The task is challenging because the shadows on the pavement may have similar intensity with the crack,which interfere with the crack detection performance.Till to the present,there still lacks efficient algorithm models and training datasets to deal with the interference brought by the shadows.To fill in the gap,we made several contributions as follows.First,we proposed a new pavement shadow and crack dataset,which contains a variety of shadow and pavement pixel size combinations.It also covers all common cracks(linear cracks and network cracks),placing higher demands on crack detection methods.Second,we designed a two-step shadow-removal-oriented crack detection approach:SROCD,which improves the performance of the algorithm by first removing the shadow and then detecting it.In addition to shadows,the method can cope with other noise disturbances.Third,we explored the mechanism of how shadows affect crack detection.Based on this mechanism,we propose a data augmentation method based on the difference in brightness values,which can adapt to brightness changes caused by seasonal and weather changes.Finally,we introduced a residual feature augmentation algorithm to detect small cracks that can predict sudden disasters,and the algorithm improves the performance of the model overall.We compare our method with the state-of-the-art methods on existing pavement crack datasets and the shadow-crack dataset,and the experimental results demonstrate the superiority of our method.

A Novel Detection Method for Pavement Crack with Encoder-Decoder Architecture

As a current popular method,intelligent detection of cracks is of great significance to road safety,so deep learning has gradually attracted attention in the field of crack image detection.The nonlinear structure,low contrast and discontinuity of cracks bring great challenges to existing crack detection methods based on deep learning.Therefore,an end-to-end deep convolutional neural network(AttentionCrack)is proposed for automatic crack detection to overcome the inaccuracy of boundary location between crack and non-crack pixels.The AttentionCrack network is built on U-Net based encoder-decoder architecture,and an attention mechanism is incorporated into the multi-scale convolutional feature to enhance the recognition of crack region.Additionally,a dilated convolution module is introduced in the encoder-decoder architecture to reduce the loss of crack detail due to the pooling operation in the encoder network.Furthermore,since up-sampling will lead to the loss of crack boundary information in the decoder network,a depthwise separable residual module is proposed to capture the boundary information of pavement crack.The AttentionCrack net on public pavement crack image datasets named CrackSegNet and Crack500 is trained and tested,the results demonstrate that the AttentionCrack achieves F1 score over 0.70 on the CrackSegNet and 0.71 on the Crack500 in average and outperforms the current state-of-the-art methods.

Vision-based fatigue crack detection using global motion compensation and video feature tracking

Fatigue cracks that develop in civil infrastructure such as steel bridges due to repetitive loads pose a major threat to structural integrity.Despite being the most common practice for fatigue crack detection,human visual inspection is known to be labor intensive,time-consuming,and prone to error.In this study,a computer vision-based fatigue crack detection approach using a short video recorded under live loads by a moving consumer-grade camera is presented.The method detects fatigue crack by tracking surface motion and identifies the differential motion pattern caused by opening and closing of the fatigue crack.However,the global motion introduced by a moving camera in the recorded video is typically far greater than the actual motion associated with fatigue crack opening/closing,leading to false detection results.To overcome the challenge,global motion compensation(GMC)techniques are introduced to compensate for camera-induced movement.In particular,hierarchical model-based motion estimation is adopted for 2D videos with simple geometry and a new method is developed by extending the bundled camera paths approach for 3D videos with complex geometry.The proposed methodology is validated using two laboratory test setups for both in-plane and out-of-plane fatigue cracks.The results confirm the importance of motion compensation for both 2D and 3D videos and demonstrate the effectiveness of the proposed GMC methods as well as the subsequent crack detection algorithm.

Efficient Crack Severity Level Classification Using Bilayer Detection for Building Structures

Detection of cracks at the early stage is considered as very constructive since precautionary steps need to be taken to avoid the damage to the civil structures.Moreover,identifying and classifying the severity level of cracks is inevitable in order to find the stability of buildings.Hence,this paper proposes an efficient strategy to classify the cracks into fine,medium,and thick using a novel bilayer crack detection algorithm.The bilayer crack detection algorithm helps in extracting the requisite features from the crack for efficient classification.The proposed algorithm works well in the dark background and connects the discontinued cracks too.The first layer is used to detect cracks under texture variations and manufacturing defects,through segmented adaptive thresholding and morphological operations.The residual noise present in the output of the first layer is removed in the second layer of crack detection.The second layer includes the double scan and the noise reduction algorithms and is used to join the missed crack parts.As a result,a segmented crack is formed.Further classification is done using an ensemble classifier with bagging,and decision tree techniques by extracting the geometrical features and the weaker crack criterion from the segmented part.The results of the proposed technique are compared with the existing techniques for different datasets and have obtained a rise in True Positive Rate(TPR),accuracy and precision value.The proposed technique is also implemented in Raspberry Pi for further real-time evaluation.

Automated Pavement Crack Detection Using Deep Feature Selection and Whale Optimization Algorithm

Pavement crack detection plays a crucial role in ensuring road safety and reducing maintenance expenses.Recent advancements in deep learning(DL)techniques have shown promising results in detecting pavement cracks;however,the selection of relevant features for classification remains challenging.In this study,we propose a new approach for pavement crack detection that integrates deep learning for feature extraction,the whale optimization algorithm(WOA)for feature selection,and random forest(RF)for classification.The performance of the models was evaluated using accuracy,recall,precision,F1 score,and area under the receiver operating characteristic curve(AUC).Our findings reveal that Model 2,which incorporates RF into the ResNet-18 architecture,outperforms baseline Model 1 across all evaluation metrics.Nevertheless,our proposed model,which combines ResNet-18 with both WOA and RF,achieves significantly higher accuracy,recall,precision,and F1 score compared to the other two models.These results underscore the effectiveness of integrating RF and WOA into ResNet-18 for pavement crack detection applications.We applied the proposed approach to a dataset of pavement images,achieving an accuracy of 97.16%and an AUC of 0.984.Our results demonstrate that the proposed approach surpasses existing methods for pavement crack detection,offering a promising solution for the automatic identification of pavement cracks.By leveraging this approach,potential safety hazards can be identified more effectively,enabling timely repairs and maintenance measures.Lastly,the findings of this study also emphasize the potential of integrating RF and WOA with deep learning for pavement crack detection,providing road authorities with the necessary tools to make informed decisions regarding road infrastructure maintenance.

Gated Fusion Based Transformer Model for Crack Detection on Wind Turbine Blade

Harsh working environments and wear between blades and other unit components can easily lead to cracks and damage on wind turbine blades.The cracks on the blades can endanger the shafting of the generator set,the tower and other components,and even cause the tower to collapse.To achieve high-precision wind blade crack detection,this paper proposes a crack fault-detection strategy that integratesGated ResidualNetwork(GRN),a fusionmodule and Transformer.Firstly,GRNcan reduce unnecessary noisy inputs that could negatively impact performancewhile preserving the integrity of feature information.In addition,to gain in-depth information about the characteristics of wind turbine blades,a fusionmodule is suggested to implement the information fusion of wind turbine features.Specifically,each fan feature ismapped to a one-dimensional vector with the same length,and all one-dimensional vectors are concatenated to obtain a two-dimensional vector.And then,in the fusion module,the information fusion of the same characteristic variables in the different channels is realized through the Channel-mixing MLP,and the information fusion of different characteristic variables in the same channel is realized through the ColumnmixingMLP.Finally,the fused feature vector is input into the Transformer for feature learning,which enhances the influence of important feature information and improves the model’s anti-noise ability and classification accuracy.Extensive experimentswere conducted on the wind turbine supervisory control and data acquisition(SCADA)data froma domesticwind field.The results show that compared with other state-of-the-artmodels,including XGBoost,LightGBM,TabNet,etc.,the F1-score of proposed gated fusion based Transformer model can reach 0.9907,which is 0.4%-2.09% higher than the comparedmodels.Thismethod provides amore reliable approach for the condition detection and maintenance of fan blades in wind farms.

Research on Infrared Image Fusion Technology Based on Road Crack Detection

This study aimed to propose road crack detection method based on infrared image fusion technology.By analyzing the characteristics of road crack images,this method uses a variety of infrared image fusion methods to process different types of images.The use of this method allows the detection of road cracks,which not only reduces the professional requirements for inspectors,but also improves the accuracy of road crack detection.Based on infrared image processing technology,on the basis of in-depth analysis of infrared image features,a road crack detection method is proposed,which can accurately identify the road crack location,direction,length,and other characteristic information.Experiments showed that this method has a good effect,and can meet the requirement of road crack detection.

Deep Learning Method to Detect the Road Cracks and Potholes for Smart Cities

The increasing global population at a rapid pace makes road trafficdense;managing such massive traffic is challenging. In developing countrieslike Pakistan, road traffic accidents (RTA) have the highest mortality percentageamong other Asian countries. The main reasons for RTAs are roadcracks and potholes. Understanding the need for an automated system forthe detection of cracks and potholes, this study proposes a decision supportsystem (DSS) for an autonomous road information system for smart citydevelopment with the use of deep learning. The proposed DSS works in layerswhere initially the image of roads is captured and coordinates attached to theimage with the help of global positioning system (GPS), communicated tothe decision layer to find about the cracks and potholes in the roads, andeventually, that information is passed to the road management informationsystem, which gives information to drivers and the maintenance department.For the decision layer, we projected a CNN-based model for pothole crackdetection (PCD). Aimed at training, a K-fold cross-validation strategy wasused where the value of K was set to 10. The training of PCD was completedwith a self-collected dataset consisting of 6000 images from Pakistani roads.The proposed PCD achieved 98% of precision, 97% recall, and accuracy whiletesting on unseen images. The results produced by our model are higher thanthe existing model in terms of performance and computational cost, whichproves its significance.

Real-Time Detection of Cracks on Concrete Bridge Decks Using Deep Learning in the Frequency Domain

This paper presents a vision-based crack detection approach for concrete bridge decks using an integrated one-dimensional convolutional neural network(1D-CNN)and long short-term memory(LSTM)method in the image frequency domain.The so-called 1D-CNN-LSTM algorithm is trained using thousands of images of cracked and non-cracked concrete bridge decks.In order to improve the training efficiency,images are first transformed into the frequency domain during a preprocessing phase.The algorithm is then calibrated using the flattened frequency data.LSTM is used to improve the performance of the developed network for long sequence data.The accuracy of the developed model is 99.05%,98.9%,and 99.25%,respectively,for training,validation,and testing data.An implementation framework is further developed for future application of the trained model for large-scale images.The proposed 1D-CNN-LSTM method exhibits superior performance in comparison with existing deep learning methods in terms of accuracy and computation time.The fast implementation of the 1D-CNN-LSTM algorithm makes it a promising tool for real-time crack detection.

Piezoelectric-based Crack Detection Techniques of Concrete Structures:Experimental Study

Feasibility of a wave propagation-based active crack detection technique for nondestructive evaluations （NDE） of concrete structures with surface bonded and embedded piezoelectric-ceramic （PZT） patches was studied. At first, the wave propagation mechanisms in concrete were analyzed. Then, an active sensing system with integrated actuators/sensors was constructed. One PZT patch was used as an actuator to generate high frequency waves, and the other PZT patches were used as sensors to detect the propagating wave. Scattered wave signals from the damage can be obtained by subtracting the baseline signal of the intact structure from the recorded signal of the damaged structure. In the experimental study, progressive cracked damage inflicted artificially on the plain concrete beam is assessed by using both lateral and thickness modes of the PZT patches. The results indicate that with the increasing number and severity of cracks, the magnitude of the sensor output decreases for the surface bonded PZT patches, and increases for the embedded PZT patches.

Intelligent Detection Model Based on a Fully Convolutional Neural Network for Pavement Cracks

The crack is a common pavement failure problem.A lack of periodic maintenance will result in extending the cracks and damage the pavement,which will affect the normal use of the road.Therefore,it is significant to establish an efficient intelligent identification model for pavement cracks.The neural network is a method of simulating animal nervous systems using gradient descent to predict results by learning a weight matrix.It has been widely used in geotechnical engineering,computer vision,medicine,and other fields.However,there are three major problems in the application of neural networks to crack identification.There are too few layers,extracted crack features are not complete,and the method lacks the efficiency to calculate the whole picture.In this study,a fully convolutional neural network based on ResNet-101 is used to establish an intelligent identification model of pavement crack regions.This method,using a convolutional layer instead of a fully connected layer,realizes full convolution and accelerates calculation.The region proposals come from the feature map at the end of the base network,which avoids multiple computations of the same picture.Online hard example mining and data-augmentation techniques are adopted to improve the model’s recognition accuracy.We trained and tested Concrete Crack Images for Classification(CCIC),which is a public dataset collected using smartphones,and the Crack Image Database(CIDB),which was automatically collected using vehicle-mounted charge-coupled device cameras,with identification accuracy reaching 91.4%and 86.4%,respectively.The proposed model has a higher recognition accuracy and recall rate than Faster RCNN and different depth models,and can extract more complete and accurate crack features in CIDB.We also analyzed translation processing,fuzzy,scaling,and distorted images.The proposed model shows a strong robustness and stability,and can automatically identify image cracks of different forms.It has broad application prospects in practical engineering problems.

A Study on Crack Detection with Modal Parameters of A Jacket Platform

Crack detection procedures by different modal parameters are analyzed for identifying a crack and its location and magnitude in a jacket platform. The first ten natural frequencies and modal shapes of the jacket models are obtained by numerical experiments based on NASTRAN Code. A crack at different locations and of different magnitudes is imposed in the model at the underwater beams. Then, the modal evaluation parameters are calculated numerically, to illustrate the evaluation of modal parameter criteria used in jacket crack detection. The sensitivities of different modal parameters to different cracks are analyzed. A new technique is presented for predicting the approximate location of a breakage in the absence of the data of an intact model. This method can be used to detect a crack in underwater members by use of incomplete mode shapes of the top members of the jacket.

Wall Cracks Detection in Aerial Images Using Improved Mask R-CNN

The present paper proposes a detection method for building exterior wall cracks since manual detection methods have high risk and low efficiency.The proposed method is based on Unmanned Aerial Vehicle(UAV)and computer vision technology.First,a crack dataset of 1920 images was established using UAV to collect the images of a residential building exterior wall under different lighting conditions.Second,the average crack detection precisions of different methods including the Single Shot MultiBox Detector,You Only Look Once v3,You Only Look Once v4,Faster Regional Convolutional Neural Network(R-CNN)and Mask R-CNN methods were compared.Then,the Mask R-CNN method with the best performance and average precision of 0.34 was selected.Finally,based on the characteristics of cracks,the utilization ratio of Mask R-CNN to the underlying features was improved so that the average precision of 0.9 was achieved.It was found that the positioning accuracy and mask coverage rate of the proposed Mask R-CNN method are greatly improved.Also,it will be shown that using UAV is safer than manual detection because manual parameter setting is not required.In addition,the proposed detection method is expected to greatly reduce the cost and risk of manual detection of building exterior wall cracks and realize the efficient identification and accurate labeling of building exterior wall cracks.

Crack detection of reinforced concrete bridge using video image

With the digital image technology,a crack detection method of reinforced concrete bridge was studied for the performance assessment.The effects including the image gray level,pixel rate,noise filter,and edge detection were analyzed considering cracks qualities.A computer program was developed by visual C++6.0 programming language to detect the cracks,which was tested by 15cases of bridge video images.The results indicate that the relative error is within 6%for cracks larger than 0.3 mm cracks and it is less than 10%for crack width between 0.2 mm and 0.3 mm.In addition,for the crack below 0.1 mm,the relative error is more than30%because the bridge is in safe stage and it is very difficult to detect the actual width of crack.

Crack detection using a frequency response function in offshore platforms

Structural cracks can change the frequency response function (FRF) of an offshore platform. Thus, FRF shifts can be used to detect cracks. When a crack at a specific location and magnitude occurs in an offshore structure, changes in the FRF can be measured. In this way, shifts in FRF can be used to detect cracks. An experimental model was constructed to verify the FRF method. The relationship between FRF and cracks was found to be non-linear. The effect of multiple cracks on FRF was analyzed, and the shift due to multiple cracks was found to be much more than the summation of FRF shifts due to each of the cracks. Then the effects of noise and changes in the mass of the jacket on FRF were evaluated. The results show that significant damage to a beam can be detected by dramatic changes in the FRF, even when 10% random noise exists. FRF can also be used to approximately locate the breakage, but it can neither be efficiently used to predict the location of breakage nor the existence of small hairline cracks. The FRF shift caused by a 7% mass change is much less than the FRF shift caused by the breakage of any beam, but is larger than that caused by any early cracks.

AN IMPEDANCE ANALYSIS FOR CRACK DETECTION IN THE TIMOSHENKO BEAM BASED ON THE ANTI-RESONANCE TECHNIQUE

An alternative technique for crack detection in a Timoshenko beam based on the first anti-resonant frequency is presented in this paper. Unlike the natural frequency, the anti-resonant frequency is a local parameter rather than a global parameter of structures, thus the proposed technique can be used to locate the structural defects. An impedance analysis of a cracked beam stimulated by a harmonic force based on the Timoshenko beam formulation is investigated. In order to characterize the local discontinuity due to cracks, a rotational spring model based on fracture mechanics is proposed to model the crack. Subsequently, the proposed method is verified by a numerical example of a simply-supported beam with a crack. The effect of the crack size on the anti-resonant frequency is investigated. The position of the crack of the simply-supported beam is also determined by the anti-resonance technique. The proposed technique is further applied to the ＂contaminated＂ anti-resonant frequency to detect crack damage, which is obtained by adding 1-3% noise to the calculated data. It is found that the proposed technique is effective and free from the environment noise. Finally, an experimental study is performed, which further verifies the validity of the proposed crack identification technique.

Cement Pavement Surface Crack Detection Based on Image Processing

This article introduces the application of image recognition technology in cement pavement crack detection and put forward to method fordetermining threshold about grayscale stretching. This algorithm is designed for binarization which has a self-adaptive characteristic. After theimage is preprocessed, we apply 2D wavelet and Laplace operator to process the image. According to the characteristic of pixel of gray image, analgorithm designed on binarization for Binary image. The feasibility of this method can be verified the image processed by comparing with theresults of three algorithms: Otsu method, iteration method and fixed threshold method.

Detection of Graphene Cracks By Electromagnetic Induction,Insensitive to Doping Level

Detection of cracks is a great concern in production and operation processes of graphene based devices to ensure uniform quality.Here,we show a detection method for graphene cracks by electromagnetic induction.The time varying magnetic field leads to induced voltage signals on graphene,and the signals are detected by a voltmeter.The measured level of induced voltage is correlated with the number of cracks in graphene positively.The correlation is attributed to the increasing inductive characteristic of defective graphene,and it is verified by electromagnetic simulation and radio frequency analysis.Furthermore,we demonstrate that the induced voltage signal is insensitive to the doping level of graphene.Our work can potentially lead to the development of a high-throughput and reliable crack inspection technique for mass production of graphene applications.

Dynamic Simulation of Cracked Buildings for Damage Detection

A dynamic simulation method for cracked structures is implemented to determine their dynamic response with the purpose of evaluating their structural behavior.The procedure makes possible the si mulation of three-dimensional cracked structures.The excitation force is randomly generated to simulate wind gusts.It is assumed the structure remains in the elastic range,which allows for each mode that contributes to its dynamic response to be decoupled.The results indicate that the presence of damage causes changes in the modals parameters of the structure as accurate as other similar methods proposed for simpler structures.Therefore,it is concluded that the proposed method is a reliable way to evaluate the dynamic behavior of three-dimensi onal cracked building structures.