Method for Detecting Industrial Defects in Intelligent Manufacturing Using Deep Learning

With the advent of Industry 4.0,marked by a surge in intelligent manufacturing,advanced sensors embedded in smart factories now enable extensive data collection on equipment operation.The analysis of such data is pivotal for ensuring production safety,a critical factor in monitoring the health status of manufacturing apparatus.Conventional defect detection techniques,typically limited to specific scenarios,often require manual feature extraction,leading to inefficiencies and limited versatility in the overall process.Our research presents an intelligent defect detection methodology that leverages deep learning techniques to automate feature extraction and defect localization processes.Our proposed approach encompasses a suite of components:the high-level feature learning block(HLFLB),the multi-scale feature learning block(MSFLB),and a dynamic adaptive fusion block(DAFB),working in tandem to extract meticulously and synergistically aggregate defect-related characteristics across various scales and hierarchical levels.We have conducted validation of the proposed method using datasets derived from gearbox and bearing assessments.The empirical outcomes underscore the superior defect detection capability of our approach.It demonstrates consistently high performance across diverse datasets and possesses the accuracy required to categorize defects,taking into account their specific locations and the extent of damage,proving the method’s effectiveness and reliability in identifying defects in industrial components.

Improved Roberts operator for detecting surface defects of heavy rails with superior precision and efficiency

An experimental platform accompanying with the improved Roberts algorithm has been developed to achieve accurate and real-time edge detection of surface defects on heavy rails.Detection results of scratching defects show that the improved Roberts operator can attain accurate positioning to defect contour and get complete edge information.Meanwhile,a decreasing amount of interference noises as well as more precise characteristic parameters of the extracted defects can also be confirmed for the improved algorithm.Furthermore,the BP neural network adopted for defects classification with the improved Roberts operator can obtain the target training precision with 98 iterative steps and time of 2s while that of traditional Roberts operator is 118 steps and 4s.Finally,an enhanced defects identification rate of 13.33%has also been confirmed after the Roberts operator is improved.The proposed detecting platform will be positive in producing high-quality heavy rails and guaranteeing the national transportation safety.

Improvement of High-Speed Detection Algorithm for Nonwoven Material Defects Based on Machine Vision

Defect detection is vital in the nonwoven material industry,ensuring surface quality before producing finished products.Recently,deep learning and computer vision advancements have revolutionized defect detection,making it a widely adopted approach in various industrial fields.This paper mainly studied the defect detection method for nonwoven materials based on the improved Nano Det-Plus model.Using the constructed samples of defects in nonwoven materials as the research objects,transfer learning experiments were conducted based on the Nano DetPlus object detection framework.Within this framework,the Backbone,path aggregation feature pyramid network(PAFPN)and Head network models were compared and trained through a process of freezing,with the ultimate aim of bolstering the model's feature extraction abilities and elevating detection accuracy.The half-precision quantization method was used to optimize the model after transfer learning experiments,reducing model weights and computational complexity to improve the detection speed.Performance comparisons were conducted between the improved model and the original Nano Det-Plus model,YOLO,SSD and other common industrial defect detection algorithms,validating that the improved methods based on transfer learning and semi-precision quantization enabled the model to meet the practical requirements of industrial production.

YOLO-RLC:An Advanced Target-Detection Algorithm for Surface Defects of Printed Circuit Boards Based on YOLOv5

Printed circuit boards(PCBs)provide stable connections between electronic components.However,defective printed circuit boards may cause the entire equipment system to malfunction,resulting in incalculable losses.Therefore,it is crucial to detect defective printed circuit boards during the generation process.Traditional detection methods have low accuracy in detecting subtle defects in complex background environments.In order to improve the detection accuracy of surface defects on industrial printed circuit boards,this paper proposes a residual large kernel network based on YOLOv5(You Only Look Once version 5)for PCBs surface defect detection,called YOLO-RLC(You Only Look Once-Residual Large Kernel).Build a deep large kernel backbone to expand the effective field of view,capture global informationmore efficiently,and use 1×1 convolutions to balance the depth of the model,improving feature extraction efficiency through reparameterization methods.The neck network introduces a bidirectional weighted feature fusion network,combined with a brand-new noise filter and feature enhancement extractor,to eliminate noise information generated by information fusion and recalibrate information from different channels to improve the quality of deep features.Simplify the aspect ratio of the bounding box to alleviate the issue of specificity values.After training and testing on the PCB defect dataset,our method achieved an average accuracy of 97.3%(mAP50)after multiple experiments,which is 4.1%higher than YOLOv5-S,with an average accuracy of 97.6%and an Frames Per Second of 76.7.The comparative analysis also proves the superior performance and feasibility of YOLO-RLC in PCB defect detection.

DSN-BR-Based Online Inspection Method and Application for Surface Defects of Pharmaceutical Products in Aluminum-Plastic Blister Packages

Ensuring high product quality is of paramount importance in pharmaceutical drug manufacturing,as it is subject to rigorous regulatory practices.This study presents a research focused on the development of an on-line detection method and system for identifying surface defects in pharmaceutical products packaged in aluminum-plastic blisters.Firstly,the aluminum-plastic blister packages exhibit multi-scale features and inter-class indistinction.To address this,the deep semantic network with boundary refinement(DSN-BR)model is proposed,which leverages semantic segmentation domain knowledge,to accurately segment the defects in pixel level.Additionally,a specialized image acquisition module that minimizes the impact of ambient light is established,ensuring high-quality image capture.Finally,the image acquisition module,image detection module,and data management module are designed to construct a comprehensive online surface defect detection system.To validate the effectiveness of our approach,we employ a real dataset for instance verification on the implemented system.The experimental results substantiate the outstanding performance of the DSN-BR,achieving the mean intersection over union(MIoU)of 90.5%.Furthermore,the proposed system achieves an inference speed of up to 14.12 f/s,while attaining an F1-Score of 98.25%.These results demonstrate that the system meets the actual needs of the enterprise and provides theoretical and methodological support for intelligent inspection of product surface quality.By standardizing the control process of pharmaceutical manufacturing and improving the management capability of the manufacturing process,our approach holds significant market application prospects.

Industry-Oriented Detection Method of PCBA Defects Using Semantic Segmentation Models

Automated optical inspection(AOI)is a significant process in printed circuit board assembly(PCBA)production lines which aims to detect tiny defects in PCBAs.Existing AOI equipment has several deficiencies including low throughput,large computation cost,high latency,and poor flexibility,which limits the efficiency of online PCBA inspection.In this paper,a novel PCBA defect detection method based on a lightweight deep convolution neural network is proposed.In this method,the semantic segmentation model is combined with a rule-based defect recognition algorithm to build up a defect detection frame-work.To improve the performance of the model,extensive real PCBA images are collected from production lines as datasets.Some optimization methods have been applied in the model according to production demand and enable integration in lightweight computing devices.Experiment results show that the production line using our method realizes a throughput more than three times higher than traditional methods.Our method can be integrated into a lightweight inference system and pro-mote the flexibility of AOI.The proposed method builds up a general paradigm and excellent example for model design and optimization oriented towards industrial requirements.

A Hybrid Deep Learning and Machine Learning-Based Approach to Classify Defects in Hot Rolled Steel Strips for Smart Manufacturing

Smart manufacturing is a process that optimizes factory performance and production quality by utilizing various technologies including the Internet of Things(IoT)and artificial intelligence(AI).Quality control is an important part of today’s smart manufacturing process,effectively reducing costs and enhancing operational efficiency.As technology in the industry becomes more advanced,identifying and classifying defects has become an essential element in ensuring the quality of products during the manufacturing process.In this study,we introduce a CNN model for classifying defects on hot-rolled steel strip surfaces using hybrid deep learning techniques,incorporating a global average pooling(GAP)layer and a machine learning-based SVM classifier,with the aim of enhancing accuracy.Initially,features are extracted by the VGG19 convolutional block.Then,after processing through the GAP layer,the extracted features are fed to the SVM classifier for classification.For this purpose,we collected images from publicly available datasets,including the Xsteel surface defect dataset(XSDD)and the NEU surface defect(NEU-CLS)datasets,and we employed offline data augmentation techniques to balance and increase the size of the datasets.The outcome of experiments shows that the proposed methodology achieves the highest metrics score,with 99.79%accuracy,99.80%precision,99.79%recall,and a 99.79%F1-score for the NEU-CLS dataset.Similarly,it achieves 99.64%accuracy,99.65%precision,99.63%recall,and a 99.64%F1-score for the XSDD dataset.A comparison of the proposed methodology to the most recent study showed that it achieved superior results as compared to the other studies.

SAM Era:Can It Segment Any Industrial Surface Defects?

Segment Anything Model(SAM)is a cutting-edge model that has shown impressive performance in general object segmentation.The birth of the segment anything is a groundbreaking step towards creating a universal intelligent model.Due to its superior performance in general object segmentation,it quickly gained attention and interest.This makes SAM particularly attractive in industrial surface defect segmentation,especially for complex industrial scenes with limited training data.However,its segmentation ability for specific industrial scenes remains unknown.Therefore,in this work,we select three representative and complex industrial surface defect detection scenarios,namely strip steel surface defects,tile surface defects,and rail surface defects,to evaluate the segmentation performance of SAM.Our results show that although SAM has great potential in general object segmentation,it cannot achieve satisfactory performance in complex industrial scenes.Our test results are available at:https://github.com/VDT-2048/SAM-IS.

An Approach to Detect Structural Development Defects in Object-Oriented Programs

Structural development defects essentially refer to code structure that violates object-oriented design principles. They make program maintenance challenging and deteriorate software quality over time. Various detection approaches, ranging from traditional heuristic algorithms to machine learning methods, are used to identify these defects. Ensemble learning methods have strengthened the detection of these defects. However, existing approaches do not simultaneously exploit the capabilities of extracting relevant features from pre-trained models and the performance of neural networks for the classification task. Therefore, our goal has been to design a model that combines a pre-trained model to extract relevant features from code excerpts through transfer learning and a bagging method with a base estimator, a dense neural network, for defect classification. To achieve this, we composed multiple samples of the same size with replacements from the imbalanced dataset MLCQ1. For all the samples, we used the CodeT5-small variant to extract features and trained a bagging method with the neural network Roberta Classification Head to classify defects based on these features. We then compared this model to RandomForest, one of the ensemble methods that yields good results. Our experiments showed that the number of base estimators to use for bagging depends on the defect to be detected. Next, we observed that it was not necessary to use a data balancing technique with our model when the imbalance rate was 23%. Finally, for blob detection, RandomForest had a median MCC value of 0.36 compared to 0.12 for our method. However, our method was predominant in Long Method detection with a median MCC value of 0.53 compared to 0.42 for RandomForest. These results suggest that the performance of ensemble methods in detecting structural development defects is dependent on specific defects.

Soft measurement of wood defects based on LDA feature fusion and compressed sensor images

We proposed a detection method for wood defects based on linear discriminant analysis (LDA) and the use of compressed sensor images. Wood surface images were captured, using a camera Oscar F810C IRF camera, and then the image segmentation was performed, and the defect features were extracted from wood board images. To reduce the processing time, LDA algorithm was used to integrate these features and reduce their dimensions. Features after fusion were used to construct a data dictionary and a compressed sensor was designed to recognize the wood defects types. Of the three major defect types, 50 images live knots, dead knots, and cracks were used to test the effects of this method. The average time for feature fusion and classification was 0.446 ms with the classification accuracy of 94%.

Algorithmic Scheme for Concurrent Detection and Classification of Printed Circuit Board Defects

An ideal printed circuit board(PCB)defect inspection system can detect defects and classify PCB defect types.Existing defect inspection technologies can identify defects but fail to classify all PCB defect types.This research thus proposes an algorithmic scheme that can detect and categorize all 14-known PCB defect types.In the proposed algorithmic scheme,fuzzy cmeans clustering is used for image segmentation via image subtraction prior to defect detection.Arithmetic and logic operations,the circle hough transform(CHT),morphological reconstruction(MR),and connected component labeling(CCL)are used in defect classification.The algorithmic scheme achieves 100%defect detection and 99.05%defect classification accuracies.The novelty of this research lies in the concurrent use of CHT,MR,and CCL algorithms to accurately detect and classify all 14-known PCB defect types and determine the defect characteristics such as the location,area,and nature of defects.This information is helpful in electronic parts manufacturing for finding the root causes of PCB defects and appropriately adjusting the manufacturing process.Moreover,the algorithmic scheme can be integrated into machine vision to streamline the manufacturing process,improve the PCB quality,and lower the production cost.

Internal Defects Detection Method of the Railway Track Based on Generalization Features Cluster Under Ultrasonic Images

There may be several internal defects in railway track work that have different shapes and distribution rules,and these defects affect the safety of high-speed trains.Establishing reliable detection models and methods for these internal defects remains a challenging task.To address this challenge,in this study,an intelligent detection method based on a generalization feature cluster is proposed for internal defects of railway tracks.First,the defects are classified and counted according to their shape and location features.Then,generalized features of the internal defects are extracted and formulated based on the maximum difference between different types of defects and the maximum tolerance among same defects’types.Finally,the extracted generalized features are expressed by function constraints,and formulated as generalization feature clusters to classify and identify internal defects in the railway track.Furthermore,to improve the detection reliability and speed,a reduced-dimension method of the generalization feature clusters is presented in this paper.Based on this reduced-dimension feature and strongly constrained generalized features,the K-means clustering algorithm is developed for defect clustering,and good clustering results are achieved.Regarding the defects in the rail head region,the clustering accuracy is over 95%,and the Davies-Bouldin index(DBI)index is negligible,which indicates the validation of the proposed generalization features with strong constraints.Experimental results prove that the accuracy of the proposed method based on generalization feature clusters is up to 97.55%,and the average detection time is 0.12 s/frame,which indicates that it performs well in adaptability,high accuracy,and detection speed under complex working environments.The proposed algorithm can effectively detect internal defects in railway tracks using an established generalization feature cluster model.

Detection of Fabric Defects with Fuzzy Label Co-occurrence Matrix Set

Co-occurrence matrices have been successfully applied in texture classification and segmentation.However,they have poor computation performance in real-time application.In this paper,the efficient co-occurrence matrix solution for defect detection is focused on,and a method of Fuzzy Label Co-occurrence Matrix (FLCM) set is proposed.In this method,all gray levels are supposed to subject to some fuzzy sets called fuzzy tonal sets and three defective features are defined.Features of FLCM set with various parameters are combined for the final judgment.Unlike many methods,image acquired for learning hasn't to be entirely free of defects.It is shown that the method produces high accuracy and can be a competent candidate for plain colour fabric defect detection.

YOLO-VSI: An Improved YOLOv8 Model for Detecting Railway Turnouts Defects in Complex Environments

Railway turnouts often develop defects such as chipping,cracks,and wear during use.If not detected and addressed promptly,these defects can pose significant risks to train operation safety and passenger security.Despite advances in defect detection technologies,research specifically targeting railway turnout defects remains limited.To address this gap,we collected images from railway inspectors and constructed a dataset of railway turnout defects in complex environments.To enhance detection accuracy,we propose an improved YOLOv8 model named YOLO-VSS-SOUP-Inner-CIoU(YOLO-VSI).The model employs a state-space model(SSM)to enhance the C2f module in the YOLOv8 backbone,proposed the C2f-VSS module to better capture long-range dependencies and contextual features,thus improving feature extraction in complex environments.In the network’s neck layer,we integrate SPDConv and Omni-Kernel Network(OKM)modules to improve the original PAFPN(Path Aggregation Feature Pyramid Network)structure,and proposed the Small Object Upgrade Pyramid(SOUP)structure to enhance small object detection capabilities.Additionally,the Inner-CIoU loss function with a scale factor is applied to further enhance the model’s detection capabilities.Compared to the baseline model,YOLO-VSI demonstrates a 3.5%improvement in average precision on our railway turnout dataset,showcasing increased accuracy and robustness.Experiments on the public NEU-DET dataset reveal a 2.3%increase in average precision over the baseline,indicating that YOLO-VSI has good generalization capabilities.

Nondestructive Testing of Bridge Stay Cable Surface Defects Based on Computer Vision

The automatically defect detection method using vision inspectionis a promising direction. In this paper, an efficient defect detection method fordetecting surface damage to cables on a cable-stayed bridge automatically isdeveloped. A mechanism design method for the protective layer of cables of abridge based on vision inspection and diameter measurement is proposed bycombining computer vision and diameter measurement techniques. A detectionsystem for the surface damages of cables is de-signed. Images of cablesurfaces are then enhanced and subjected to threshold segmentation by utilizingthe improved local grey contrast enhancement method and the improvedmaximum correlation method. Afterwards, the data obtained through diametermeasurement are mined by employing the moving average method. Imageenhancement, threshold segmentation, and diameter measurement methodsare separately validated experimentally. The experimental test results showthat the system delivers recall ratios for type-I and II surface defects of cablesreaching 80.4% and 85.2% respectively, which accurately detects bulges oncable surfaces.

Automatic Image Inspection of Fabric Defects Based on Optimal Gabor Filter

An effective method for automatic image inspection of fabric defects is presented. The proposed method relies on a tuned 2D-Gabor filter and quantum-behaved particle swarm optimization( QPSO) algorithm. The proposed method consists of two main steps:( 1) training and( 2) image inspection. In the image training process,the parameters of the 2D-Gabor filters can be tuned by QPSO algorithm to match with the texture features of a defect-free template. In the inspection process, each sample image under inspection is convoluted with the selected optimized Gabor filter.Then a simple thresholding scheme is applied to generating a binary segmented result. The performance of the proposed scheme is evaluated by using a standard fabric defects database from Cotton Incorporated. Good experimental results demonstrate the efficiency of proposed method. To further evaluate the performance of the proposed method,a real time test is performed based on an on-line defect detection system. The real time test results further demonstrate the effectiveness, stability and robustness of the proposed method,which is suitable for industrial production.

Detection of fabric defects based on bilateral filter and frangi filter

Aimed at low contrast effect on fabric detection,a method based on bilateral filter and frangi filter is proposed. Firstly,in order to reduce the influence of fabric background texture information on the detection results,bilateral filter is used to deal with the fabric image. Then frangi filter is used to filter the fabric image after bilateral filtering to enhance the fabric defect area information. Finally,a maximum entropy method is implemented on the fabric image after frangi filtering to separate the defected area. Experimental results show that the proposed method can effectively detect defects.

Modeling&Evaluating the Performance of Convolutional Neural Networks for Classifying Steel Surface Defects

Recently,outstanding identification rates in image classification tasks were achieved by convolutional neural networks(CNNs).to use such skills,selective CNNs trained on a dataset of well-known images of metal surface defects captured with an RGB camera.Defects must be detected early to take timely corrective action due to production concerns.For image classification up till now,a model-based method has been utilized,which indicated the predicted reflection characteristics of surface defects in comparison to flaw-free surfaces.The problem of detecting steel surface defects has grown in importance as a result of the vast range of steel applications in end-product sectors such as automobiles,households,construction,etc.Themanual processes for detections are time-consuming,labor-intensive,and expensive.Different strategies have been used to automate manual processes,but CNN models have proven to be the most effective rather than image processing andmachine learning techniques.By using differentCNNmodels with fine-tuning,easily compare their performance and select the best-performing model for the same kinds of tasks.However,it is important that using different CNN models either from fine tuning can be computationally expensive and time-consuming.Therefore,our study helps the upcoming researchers to choose the CNN without considering the issues of model complexity,performance,and computational resources.In this article,the performance of various CNN models like Visual Geometry Group,VGG16,VGG19,ResNet152,ResNet152V2,Xception,InceptionV3,InceptionResNetV2,NASNetLarge,MobileNetV2,and DenseNet201 with transfer learning techniques are evaluated.These models were chosen based on their popularity and impact in the field of computer vision research,as well as their performance on benchmark datasets.According to the outcomes,DenseNet201 outperformed the other CNN models and had the greatest detection rate on the NEU dataset,falling in at 98.37 percent.

Defect Detection Model Using Time Series Data Augmentation and Transformation

Time-series data provide important information in many fields,and their processing and analysis have been the focus of much research.However,detecting anomalies is very difficult due to data imbalance,temporal dependence,and noise.Therefore,methodologies for data augmentation and conversion of time series data into images for analysis have been studied.This paper proposes a fault detection model that uses time series data augmentation and transformation to address the problems of data imbalance,temporal dependence,and robustness to noise.The method of data augmentation is set as the addition of noise.It involves adding Gaussian noise,with the noise level set to 0.002,to maximize the generalization performance of the model.In addition,we use the Markov Transition Field(MTF)method to effectively visualize the dynamic transitions of the data while converting the time series data into images.It enables the identification of patterns in time series data and assists in capturing the sequential dependencies of the data.For anomaly detection,the PatchCore model is applied to show excellent performance,and the detected anomaly areas are represented as heat maps.It allows for the detection of anomalies,and by applying an anomaly map to the original image,it is possible to capture the areas where anomalies occur.The performance evaluation shows that both F1-score and Accuracy are high when time series data is converted to images.Additionally,when processed as images rather than as time series data,there was a significant reduction in both the size of the data and the training time.The proposed method can provide an important springboard for research in the field of anomaly detection using time series data.Besides,it helps solve problems such as analyzing complex patterns in data lightweight.

YOLO-DD:Improved YOLOv5 for Defect Detection

As computer technology continues to advance,factories have increasingly higher demands for detecting defects.However,detecting defects in a plant environment remains a challenging task due to the presence of complex backgrounds and defects of varying shapes and sizes.To address this issue,this paper proposes YOLO-DD,a defect detectionmodel based on YOLOv5 that is effective and robust.To improve the feature extraction process and better capture global information,the vanilla YOLOv5 is augmented with a new module called Relative-Distance-Aware Transformer(RDAT).Additionally,an Information Gap Filling Strategy(IGFS)is proposed to improve the fusion of features at different scales.The classic lightweight attention mechanism Squeeze-and-Excitation(SE)module is also incorporated into the neck section to enhance feature expression and improve the model’s performance.Experimental results on the NEU-DET dataset demonstrate that YOLO-DDachieves competitive results compared to state-of-the-art methods,with a 2.0% increase in accuracy compared to the original YOLOv5,achieving 82.41% accuracy and38.25FPS(framesper second).Themodel is also testedon a self-constructed fabric defect dataset,and the results show that YOLO-DD is more stable and has higher accuracy than the original YOLOv5,demonstrating its stability and generalization ability.The high efficiency of YOLO-DD enables it to meet the requirements of industrial high accuracy and real-time detection.