Steel Surface Defect Detection Using Learnable Memory Vision Transformer

This study investigates the application of Learnable Memory Vision Transformers(LMViT)for detecting metal surface flaws,comparing their performance with traditional CNNs,specifically ResNet18 and ResNet50,as well as other transformer-based models including Token to Token ViT,ViT withoutmemory,and Parallel ViT.Leveraging awidely-used steel surface defect dataset,the research applies data augmentation and t-distributed stochastic neighbor embedding(t-SNE)to enhance feature extraction and understanding.These techniques mitigated overfitting,stabilized training,and improved generalization capabilities.The LMViT model achieved a test accuracy of 97.22%,significantly outperforming ResNet18(88.89%)and ResNet50(88.90%),aswell as the Token to TokenViT(88.46%),ViT without memory(87.18),and Parallel ViT(91.03%).Furthermore,LMViT exhibited superior training and validation performance,attaining a validation accuracy of 98.2%compared to 91.0%for ResNet 18,96.0%for ResNet50,and 89.12%,87.51%,and 91.21%for Token to Token ViT,ViT without memory,and Parallel ViT,respectively.The findings highlight the LMViT’s ability to capture long-range dependencies in images,an areawhere CNNs struggle due to their reliance on local receptive fields and hierarchical feature extraction.The additional transformer-based models also demonstrate improved performance in capturing complex features over CNNs,with LMViT excelling particularly at detecting subtle and complex defects,which is critical for maintaining product quality and operational efficiency in industrial applications.For instance,the LMViT model successfully identified fine scratches and minor surface irregularities that CNNs often misclassify.This study not only demonstrates LMViT’s potential for real-world defect detection but also underscores the promise of other transformer-based architectures like Token to Token ViT,ViT without memory,and Parallel ViT in industrial scenarios where complex spatial relationships are key.Future research may focus on enhancing LMViT’s computational efficiency for deployment in real-time quality control systems.

Research on Electromagnetic Acoustic Emission Signal Recognition Based on Local Mean Decomposition and Least Squares Support Vector Machine

Electromagnetic acoustic emission technology is one of nondestructive testing, which can be used for defect detection of metal specimens. In this study, round and cracked metal specimens, round metal specimens, and intact metal specimens were prepared. And the electromagnetic acoustic emission signals of the three specimens were collected. In addition, the local mean decomposition(LMD), Autoregressive model(AR model) and least squares support vector machine (LSSVM) algorithms were combined to identify the eletromagnetic acoustic emission signals of round and cracked, round, and intact specimens. According to the algorithm recognition results, the recognition accuracy of can reach above 97.5%, which has a higher recognition rate compared with SVM and BP neural network. The results of the study show that the algorithm is able to identify quickly and accurately crack defect in metal specimens.