基于卷积神经网络的路表病害识别与测量

Recognition and Measurement of Pavement Disasters Based on Convolutional Neural Networks

为进一步提高利用二维图像统计路面病害的精度与效率,将卷积神经网络(Convolutional Neural Network,CNN)技术引入了基于图像分析的路面病害识别与测量。首先,将原始图像进行等尺寸分割作为CNN的训练样本。其次,经结构设计、前反馈算法训练及样本测试3个步骤后,建立病害识别模型(CNN1)。用训练完成的CNN1对所有图像进行病害类型识别并将输出结果作为裂缝特征提取模型(CNN2)和坑槽特征提取模型(CNN3)的训练样本。采用相同步骤建立裂缝特征提取和坑槽特征提取模型,完成训练后,运行CNN2,CNN3对路面裂缝与坑槽图像进行特征提取。最后,分析图像分辨率对3个CNN识别和特征提取精度以及效率的影响。结果表明:CNN1可以准确识别多种病害,CNN2的裂缝长度提取的平均误差为4.27%,宽度提取的平均误差为9.37%,裂缝病害严重等级判断准确率为98.99%;CNN3的单张图像中的坑槽个数测量无误差,单个坑槽面积的平均误差为13.43%,坑槽病害等级判定准确率为95.32%,可见CNN具有较高的测量精度;CNN1在使用CPU的情况下测试完成原始图像平均用时为704ms·幅^(-1),CNN2用时为5 376ms·幅^(-1),采用图形处理器加速后CNN1用时为192ms·幅^(-1),CNN2测试平均用时为1 024ms·幅^(-1),可见CNN在图形处理器加速下效率具有显著优势,相比其他方法,在图像分辨率高于70像素时,CNN对路面裂缝与坑槽的识别与测量具有运算高效、结果精准等优势。

In order to further improve the precision and efficiency of pavement disasters using twodimensional images,convolutional neural network（CNN）was introduced to recognize and measure pavement disasters.First,pavement images were divided into equal-sized maps,which were used as training samples of disaster recognition CNN.Then disaster recognition CNN1 was established by the structural design,before-feedback algorithm and sample tests.Subsequently,all equal-sized maps were input into well-trained disaster recognition CNN1,and the results were used as training samples of crack feature extraction model CNN2 and pit slot feature extraction model CNN3.Meanwhile,the crack feature extraction model CNN2 and the pit slot feature extraction model CNN3 were established with the same procedures.Afterwards,the pavement crack and images of pit slot were extracted by well-trained CNN2 and CNN3.Last but not least,the influences of image resolution ratio on the CNN recognition,precision of feature extraction,and efficiency were analyzed.The results show that various pavement disasters can be accurately recognized by CNN1,and the average errors of crack length and crack width of CNN2 are 4.27%and 9.37%respectively.The accuracy rate of crack disease severity level is 98.99%.There is no error of the number of pit slot CNN3,and the average error of each pit slot area is 13.43%.The accuracy rate of pit slot disease severity level is 95.32%.Thus CNN systems show high accuracy.The disaster recognition CNN1 and feature extraction CNN2 for testing original images in CPU conditions take up to 704 ms·sheet^（-1） and 5 376 ms·sheet^（-1） on average,whilst the disaster recognition CNN1 and feature extraction CNN2 for testing images after the acceleration by graphics processor in GPU conditions take up to 192 ms·sheet^（-1） and 1 024 ms·sheet^（-1） on average.Thus CNN systems present high efficiency in GPU condition.Compared with other methods,CNN presents high accuracy and efficiency in recognition and measurement of cracks and pit slot when image solutions are higher than 70 dpi.