Railway switch fault diagnosis based on Multi-heads Channel Self Attention,Residual Connection and Deep CNN

A novel switch diagnosis method based on self-attention and residual deep convolutional neural networks(CNNs)is proposed.Because of the imbalanced dataset,the K-means synthetic minority oversampling technique(SMOTE)is applied to balancing the dataset at first.Then,the deep CNN is utilized to extract local features from long power curves,and the residual connection is performed to handle the performance degeneration.In the end,the multi-heads channel self attention focuses on those important local features.The ablation and comparison experiments are applied to verifying the effectiveness of the proposed methods.With the residual connection and multi-heads channel self attention,the proposed method has achieved an impressive accuracy of 99.83%.The t-SNE based visualizations for features of the middle layers enhance the trustworthiness.

U-shaped Vision Transformer and Its Application in Gear Pitting Measurement

Although convolutional neural networks have become the mainstream segmentation model,the locality of convolution makes them cannot well learn global and long-range semantic information.To further improve the performance of segmentation models,we propose U-shaped vision Transformer(UsViT),a model based on Transformer and convolution.Specifically,residual Transformer blocks are designed in the encoder of UsViT,which take advantages of residual network and Transformer backbone at the same time.What is more,transpositions in each Transformer layer achieve the information interaction between spatial locations and feature channels,enhancing the capability of feature learning.In the decoder,for enhancing receptive field,different dilation rates are introduced to each convolutional layer.In addition,residual connections are applied to make the information propagation smoother when training the model.We first verify the superiority of UsViT on automatic portrait matting public dataset,which achieves 90.43%accuracy(Acc),95.56%Dice similarity coefficient,and 94.66%Intersection over Union with relatively fewer parameters.Finally,UsViT is applied to gear pitting measurement in gear contact fatigue test,and the comparative results indicate that UsViT can improve the Acc of pitting detection.

Grow-light smart monitoring system leveraging lightweight deep learning for plant disease classification

This work focuses on a novel lightweight machine learning approach to the task of plant disease classification,posing as a core component of a larger grow-light smart monitoring system.To the extent of our knowledge,this work is the first to implement lightweight convolutional neural network architectures leveraging down-scaled versions of inception blocks,residual connections,and dense residual connections applied without pre-training to the PlantVillage dataset.The novel contributions of this work include the proposal of a smart monitor-ing framework outline;responsible for detection and classification of ailments via the devised lightweight net-works as well as interfacing with LED grow-light fixtures to optimize environmental parameters and lighting control for the growth of plants in a greenhouse system.Lightweight adaptation of dense residual connections achieved the best balance of minimizing model parameters and maximizing performance metrics with accuracy,precision,recall,and F1-scores of 96.75%,97.62%,97.59%,and 97.58%respectively,while consisting of only 228,479 model parameters.These results are further compared against various full-scale state-of-the-art model architectures trained on the PlantVillage dataset,of which the proposed down-scaled lightweight models were capable of performing equally to,if not better than many large-scale counterparts with drastically less com-putational requirements.

Highway icing time prediction with deep learning approaches based on data from road sensors

In harsh climates,highway icing poses a hazard to traffic safety and increases road maintenance costs.It is of great significance to predict when the highway icing may occur and take a preventive plan.However,there are few studies on highway icing time prediction due to the scarcity and complexity of data.In this study,variables of icing temperature,friction,ice percentage,road surface temperature,water film height,saline concentration,and road condition were collected by road sensors distributed on a highway in China.A large-scale time series highway surface information dataset called HighwayIce is formed.Furthermore,a deep learning approach called IceAlarm,composed of long short-term memory neural network(LSTM),multilayer perceptron(MLP),and residual connection,has been developed to predict when the highway will ice.The LSTM is used to process dynamic variables,the MLP is used to process static variables,and the fully-connected layers with residual connections are used to make a deep fusion.The experimental results show that the average mean absolute error before icing using the IceAlarm model is about 6min and outperforms all baseline models.The HighwayIce dataset and IceAlarm model can help improve the prediction accuracy and efficiency of forecasting real-world road icing time,therefore reducing the impact of icy road conditions on traffic.

Automatic Segmentation Method for Cone-Beam Computed Tomography Image of the Bone Graft Region within Maxillary Sinus Based on the Atrous Spatial Pyramid Convolution Network

Sinus floor elevation with a lateral window approach requires bone graft(BG)to ensure sufficient bone mass,and it is necessary to measure and analyse the BG region for follow-up of postoperative patients.However,the BG region from cone-beam computed tomography(CBCT)images is connected to the margin of the maxillary sinus,and its boundary is blurred.Common segmentation methods are usually performed manually by experienced doctors,and are complicated by challenges such as low efficiency and low precision.In this study,an auto-segmentation approach was applied to the BG region within the maxillary sinus based on an atrous spatial pyramid convolution(ASPC)network.The ASPC module was adopted using residual connections to compose multiple atrous convolutions,which could extract more features on multiple scales.Subsequently,a segmentation network of the BG region with multiple ASPC modules was established,which effectively improved the segmentation performance.Although the training data were insufficient,our networks still achieved good auto-segmentation results,with a dice coefficient(Dice)of 87.13%,an Intersection over Union(Iou)of 78.01%,and a sensitivity of 95.02%.Compared with other methods,our method achieved a better segmentation effect,and effectively reduced the misjudgement of segmentation.Our method can thus be used to implement automatic segmentation of the BG region and improve doctors’work efficiency,which is of great importance for developing preliminary studies on the measurement of postoperative BG within the maxillary sinus.