An Improved Solov2 Based on Attention Mechanism and Weighted Loss Function for Electrical Equipment Instance Segmentation

The current existing problem of deep learning framework for the detection and segmentation of electrical equipment is dominantly related to low precision.Because of the reliable,safe and easy-to-operate technology provided by deep learning-based video surveillance for unmanned inspection of electrical equipment,this paper uses the bottleneck attention module(BAM)attention mechanism to improve the Solov2 model and proposes a new electrical equipment segmentation mode.Firstly,the BAM attention mechanism is integrated into the feature extraction network to adaptively learn the correlation between feature channels,thereby improving the expression ability of the feature map;secondly,the weighted sum of CrossEntropy Loss and Dice loss is designed as the mask loss to improve the segmentation accuracy and robustness of the model;finally,the non-maximal suppression(NMS)algorithm to better handle the overlap problem in instance segmentation.Experimental results show that the proposed method achieves an average segmentation accuracy of mAP of 80.4% on three types of electrical equipment datasets,including transformers,insulators and voltage transformers,which improve the detection accuracy by more than 5.7% compared with the original Solov2 model.The segmentation model proposed can provide a focusing technical means for the intelligent management of power systems.

Physics-Informed Neural Networks with Two Weighted Loss Function Methods for Interactions of Two-Dimensional Oceanic Internal Solitary Waves

The multiple patterns of internal solitary wave interactions(ISWI)are a complex oceanic phenomenon.Satellite remote sensing techniques indirectly detect these ISWI,but do not provide information on their detailed structure and dynamics.Recently,the authors considered a three-layer fluid with shear flow and developed a(2+1)Kadomtsev-Petviashvili(KP)model that is capable of describing five types of oceanic ISWI,including O-type,P-type,TO-type,TP-type,and Y-shaped.Deep learning models,particularly physics-informed neural networks(PINN),are widely used in the field of fluids and internal solitary waves.However,the authors find that the amplitude of internal solitary waves is much smaller than the wavelength and the ISWI occur at relatively large spatial scales,and these characteristics lead to an imbalance in the loss function of the PINN model.To solve this problem,the authors introduce two weighted loss function methods,the fixed weighing and the adaptive weighting methods,to improve the PINN model.This successfully simulated the detailed structure and dynamics of ISWI,with simulation results corresponding to the satellite images.In particular,the adaptive weighting method can automatically update the weights of different terms in the loss function and outperforms the fixed weighting method in terms of generalization ability.

Generative Adversarial Network-Based Electromagnetic Signal Classification: A Semi- Supervised Learning Framework

Generative adversarial network(GAN)has achieved great success in many fields such as computer vision,speech processing,and natural language processing,because of its powerful capabilities for generating realistic samples.In this paper,we introduce GAN into the field of electromagnetic signal classification(ESC).ESC plays an important role in both military and civilian domains.However,in many specific scenarios,we can’t obtain enough labeled data,which cause failure of deep learning methods because they are easy to fall into over-fitting.Fortunately,semi-supervised learning(SSL)can leverage the large amount of unlabeled data to enhance the classification performance of classifiers,especially in scenarios with limited amount of labeled data.We present an SSL framework by incorporating GAN,which can directly process the raw in-phase and quadrature(IQ)signal data.According to the characteristics of the electromagnetic signal,we propose a weighted loss function,leading to an effective classifier to realize the end-to-end classification of the electromagnetic signal.We validate the proposed method on both public RML2016.04c dataset and real-world Aircraft Communications Addressing and Reporting System(ACARS)signal dataset.Extensive experimental results show that the proposed framework obtains a significant increase in classification accuracy compared with the state-of-the-art studies.

Estimating Weibull Parameters Using Least Squares and Multilayer Perceptron vs. Bayes Estimation

The Weibull distribution is regarded as among the finest in the family of failure distributions.One of the most commonly used parameters of the Weibull distribution(WD)is the ordinary least squares(OLS)technique,which is useful in reliability and lifetime modeling.In this study,we propose an approach based on the ordinary least squares and the multilayer perceptron(MLP)neural network called the OLSMLP that is based on the resilience of the OLS method.The MLP solves the problem of heteroscedasticity that distorts the estimation of the parameters of the WD due to the presence of outliers,and eases the difficulty of determining weights in case of the weighted least square(WLS).Another method is proposed by incorporating a weight into the general entropy(GE)loss function to estimate the parameters of the WD to obtain a modified loss function(WGE).Furthermore,a Monte Carlo simulation is performed to examine the performance of the proposed OLSMLP method in comparison with approximate Bayesian estimation(BLWGE)by using a weighted GE loss function.The results of the simulation showed that the two proposed methods produced good estimates even for small sample sizes.In addition,the techniques proposed here are typically the preferred options when estimating parameters compared with other available methods,in terms of the mean squared error and requirements related to time.

Deep learning characterization of rock conditions based on tunnel boring machine data

Rock condition perception based on tunnel boring machine(TBM)data is of great importance for not only ensuring tunnel boring safety but also improving construction efficiency.The prediction of TBM boring responses(i.e.,torque and total thrust of the cutterhead)largely determines the reliability of rock condition perception.In this paper,a new architecture of a two-dimensional convolutional neural network(2D-CNN)with a dual-input strategy is proposed to predict the TBM responses.The TBM Lot 3 of the Yinsong project in Jilin province,China,is taken as the case study in this paper.Two types of models that follow different learning strategies are compared:one is defined as the point model,which only learns data of the stable phase,and the other is defined as the line model,which learns data from both the loading and stable boring phases.The line model is further improved by the weighted loss function method.The results indicate that the strategy of learning data from both the loading phase and stable boring phase and increasing the weight of samples from the stable phase is shown to be optimal in predicting TBM boring responses.In terms of learning strategies,the line model can learn the influence of active control parameters on passive response parameters,but the point model cannot.In terms of machine learning algorithms,2D-CNN has the best performance,with R2 values of 0.865 and 0.923 for torque and total thrust,respectively.The proposed line model can overcome the problem that the traditional model failed to learn the influence of control parameters.Such a model can provide a solid base for the timely optimization of the control parameters in TBM boring process.