基于深度学习的散斑图像大变形测量方法

Large Deformation Measurement Method of Speckle Images Based on Deep Learning

本文提出了一种针对复杂大变形的散斑图像位移场的测量方法,该方法利用注意力机制和深度可分离卷积改进一个现有的卷积神经网络模型用于测量大变形位移场。为训练该模型,构建了符合真实情况的包含多种类型的散斑图像和复杂大变形位移场的数据集并提出了新的损失函数。该方法与传统数字图像相关方法以及最新的深度学习方法分别在自建数据集和公开数据集上进行了对比实验和结果分析。结果表明,所提方法在模型参数量最小的情况下取得了最高的平均精度,位移场计算速度也远超传统方法,能够满足大变形位移场的实际实时测量需求。

Objective As the demand for materials with excellent mechanical properties is increasing in scientific research and engineering,determining how to accurately measure the global displacement field of materials in mechanical experiments has become an important scientific research issue.Digital image correlation(DIC)algorithm is a noncontact optical method for measuring global speckle displacement fields based on visible light,which is widely used in experimental mechanics and engineering fields.It has the advantages of low measurement costs,high precision,high sensitivity,strong antiinterference ability,and global measurement.However,traditional DIC algorithm cannot meet the requirements of realtime measurement in practical applications,which greatly limits the development and promotion of this method.With the rapid development of deep learning in computer vision,deep learning methods gradually come into use in DIC algorithm.Thanks to the efficient calculation by general processing unit(GPU)devices,the deep learningbased method for measuring the speckle displacement field can more easily achieve realtime online calculation.Although the method is much faster than the traditional one,the model cannot accurately measure the complex large deformation displacement field in practical applications due to the incomplete dataset.Hence,this work aims to construct a more realistic and comprehensive speckle image dataset with a large deformation displacement field and propose a fast and highprecision deep learning model to measure the displacement field of speckle images with large deformation.Methods A large number of different types of speckle images is obtained in various ways(Fig.1)to construct a speckle image dataset with a large deformation displacement field in line with the actual situation.These speckle images are obtained from real experiments and computer simulations under different parameter combinations(Table 1).Then,a composite deformation composed of translation,stretching,compression,rotation,Gauss,shear,and other basic deformations is used to define the random displacement field.Finally,a speckleimage displacementfield dataset with a maximum displacement of 16 pixel and large deformation in line with the actual deformation is produced.In terms of the deep learning network model,a fast and highprecision network model DICNet(Fig.5)for measuring the speckle images with a largedeformation displacement field is built upon the improvement on UNet.DICNet introduces a convolutional block attention module to increase the efficiency of feature extraction and fusion,uses depthwise separable convolution to replace some ordinary convolutional layers,and increases the convolution kernel size of some convolutional layers.It improves the displacementfield measurement accuracy and reduces the number of parameters of the network model.At the network training stage,a combination of the global shape loss function and global absolute loss function is proposed to improve the convergence speed and accuracy of the model.Results and Discussions Network selection experiments are conducted to prove that UNet is a rational basic network model for measuring the largedeformation displacement(Table 2).It has higher measurement accuracy of the displacement field,a smaller number of parameters,and faster inference speed.The DICNet proposed in this work is compared with the traditional DIC algorithm and the latest deep learning methods on the selfbuilt dataset,and the performance of these methods in the measurement task of the largedisplacement displacement field is comprehensively compared in terms of three indicators,i.e.,the rootmeansquare error(RMSE),the standard deviation,and mean time(Table 3).The results show that the measurement accuracy of the deep learning method is better than that of the traditional method.The RMSE of DICNet on the training set and the validation set is 0.056 pixel and 0.055 pixel,respectively,which is 67%-70%lower than that of other existing methods and about 39%lower than that of the original UNet network.On the test set,DICNet still has the smallest RMSE and the most stable performance(Table 4).The experiments of DICNet are also conducted on the public DIC challenge dataset(Fig.8).The results show that the measurement results of the proposed method are highly consistent with those of the traditional algorithms,which indicates that the proposed method still has good generalization performance on the public dataset.Conclusions This work proposes a displacement field measurement method for speckle images with complex large deformation.This method uses the convolutional block attention module and depthwise separable convolution to improve the UNet network for measuring large deformation displacement fields.To train the model,this work constructs a dataset containing multiple types of speckle images and complex largedeformation displacement fields in line with the real situation and proposes a new loss function.This method is compared with traditional DIC algorithm and the latest deep learning methods on the selfbuilt dataset and public dataset separately.The results show that the measurement results of DICNet are highly consistent with those of other methods,and the method in this work achieves the highest average accuracy with the smallest number of model parameters.The measurement speed of the displacement field is far higher than those of traditional methods,which can meet the actual realtime measurement requirements of a large deformation displacement field.The source code and network pretrained weights of this study are available at https://github.com/donotbreeze/Large-deformation-measurement-method-of-speckle-image-based-on-deep-learning.The dataset is available athttps://pan.baidu.com/s/1KzC9g_GIkvMnGFumDYGyBA?pwd=fd5x.