Transferable adversarial slow feature extraction network for few-shot quality prediction in coal-to-ethylene glycol process

In the coal-to-ethylene glycol(CTEG)process,precisely estimating quality variables is crucial for process monitoring,optimization,and control.A significant challenge in this regard is relying on offline laboratory analysis to obtain these variables,which often incurs substantial monetary costs and significant time delays.The resulting few-shot learning scenarios present a hurdle to the efficient development of predictive models.To address this issue,our study introduces the transferable adversarial slow feature extraction network(TASF-Net),an innovative approach designed specifically for few-shot quality prediction in the CTEG process.TASF-Net uniquely integrates the slowness principle with a deep Bayesian framework,effectively capturing the nonlinear and inertial characteristics of the CTEG process.Additionally,the model employs a variable attention mechanism to identify quality-related input variables adaptively at each time step.A key strength of TASF-Net lies in its ability to navigate the complex measurement noise,outliers,and system interference typical in CTEG data.Adversarial learning strategy using a min-max game is adopted to improve its robustness and ability to model irregular industrial data accurately and significantly.Furthermore,an incremental refining transfer learning framework is designed to further improve few-shot prediction performance achieved by transferring knowledge from the pretrained model on the source domain to the target domain.The effectiveness and superiority of TASF-Net have been empirically validated using a real-world CTEG dataset.Compared with some state-of-the-art methods,TASF-Net demonstrates exceptional capability in addressing the intricate challenges for few-shot quality prediction in the CTEG process.

Detection of Oscillations in Process Control Loops From Visual Image Space Using Deep Convolutional Networks

Oscillation detection has been a hot research topic in industries due to the high incidence of oscillation loops and their negative impact on plant profitability.Although numerous automatic detection techniques have been proposed,most of them can only address part of the practical difficulties.An oscillation is heuristically defined as a visually apparent periodic variation.However,manual visual inspection is labor-intensive and prone to missed detection.Convolutional neural networks(CNNs),inspired by animal visual systems,have been raised with powerful feature extraction capabilities.In this work,an exploration of the typical CNN models for visual oscillation detection is performed.Specifically,we tested MobileNet-V1,ShuffleNet-V2,Efficient Net-B0,and GhostNet models,and found that such a visual framework is well-suited for oscillation detection.The feasibility and validity of this framework are verified utilizing extensive numerical and industrial cases.Compared with state-of-theart oscillation detectors,the suggested framework is more straightforward and more robust to noise and mean-nonstationarity.In addition,this framework generalizes well and is capable of handling features that are not present in the training data,such as multiple oscillations and outliers.

Regression Method for Rail Fastener Tightness Based on Center-Line Projection Distance Feature and Neural Network

In the railway system,fasteners have the functions of damping,maintaining the track distance,and adjusting the track level.Therefore,routine maintenance and inspection of fasteners are important to ensure the safe operation of track lines.Currently,assessment methods for fastener tightness include manual observation,acoustic wave detection,and image detection.There are limitations such as low accuracy and efficiency,easy interference and misjudgment,and a lack of accurate,stable,and fast detection methods.Aiming at the small deformation characteristics and large elastic change of fasteners from full loosening to full tightening,this study proposes high-precision surface-structured light technology for fastener detection and fastener deformation feature extraction based on the center-line projection distance and a fastener tightness regression method based on neural networks.First,the method uses a 3D camera to obtain a fastener point cloud and then segments the elastic rod area based on the iterative closest point algorithm registration.Principal component analysis is used to calculate the normal vector of the segmented elastic rod surface and extract the point on the centerline of the elastic rod.The point is projected onto the upper surface of the bolt to calculate the projection distance.Subsequently,the mapping relationship between the projection distance sequence and fastener tightness is established,and the influence of each parameter on the fastener tightness prediction is analyzed.Finally,by setting up a fastener detection scene in the track experimental base,collecting data,and completing the algorithm verification,the results showed that the deviation between the fastener tightness regression value obtained after the algorithm processing and the actual measured value RMSE was 0.2196 mm,which significantly improved the effect compared with other tightness detection methods,and realized an effective fastener tightness regression.

Mixed-decomposed convolutional network:A lightweight yet efficient convolutional neural network for ocular disease recognition

Eye health has become a global health concern and attracted broad attention.Over the years,researchers have proposed many state-of-the-art convolutional neural networks(CNNs)to assist ophthalmologists in diagnosing ocular diseases efficiently and precisely.However,most existing methods were dedicated to constructing sophisticated CNNs,inevitably ignoring the trade-off between performance and model complexity.To alleviate this paradox,this paper proposes a lightweight yet efficient network architecture,mixeddecomposed convolutional network(MDNet),to recognise ocular diseases.In MDNet,we introduce a novel mixed-decomposed depthwise convolution method,which takes advantage of depthwise convolution and depthwise dilated convolution operations to capture low-resolution and high-resolution patterns by using fewer computations and fewer parameters.We conduct extensive experiments on the clinical anterior segment optical coherence tomography(AS-OCT),LAG,University of California San Diego,and CIFAR-100 datasets.The results show our MDNet achieves a better trade-off between the performance and model complexity than efficient CNNs including MobileNets and MixNets.Specifically,our MDNet outperforms MobileNets by 2.5%of accuracy by using 22%fewer parameters and 30%fewer computations on the AS-OCT dataset.

Numerical‐discrete‐scheme‐incorporated recurrent neural network for tasks in natural language processing

A variety of neural networks have been presented to deal with issues in deep learning in the last decades.Despite the prominent success achieved by the neural network,it still lacks theoretical guidance to design an efficient neural network model,and verifying the performance of a model needs excessive resources.Previous research studies have demonstrated that many existing models can be regarded as different numerical discretizations of differential equations.This connection sheds light on designing an effective recurrent neural network(RNN)by resorting to numerical analysis.Simple RNN is regarded as a discretisation of the forward Euler scheme.Considering the limited solution accuracy of the forward Euler methods,a Taylor‐type discrete scheme is presented with lower truncation error and a Taylor‐type RNN(T‐RNN)is designed with its guidance.Extensive experiments are conducted to evaluate its performance on statistical language models and emotion analysis tasks.The noticeable gains obtained by T‐RNN present its superiority and the feasibility of designing the neural network model using numerical methods.

Multi-component quantitative and feed-forward neural network for pattern classification of raw and wine-processed Corni Fructus

Background:To promote the quality evaluation,clarify the processing mechanism and distinguish origins of Corni Fructus(cornus)from different regions.Methods:This study developed a high performance liquid chromatography method for simultaneous determination of 5-hydroxymethylfurfural,2 phenolic acids and 4 iridoid glycosides and the reference fingerprint of cornus from different regions.In addition,the feedforward neural network model provided a pattern classification of sample regions.Results:The content of morroniside and loganin were the highest in all raw cornus samples ranging from 9.45μg/mg to 16.3μg/mg and 6.64μg/mg to 13.7μg/mg,respectively.The level of sweroside in raw cornus from Henan(0.83μg/mg^(-1).39μg/mg)and Zhejiang(0.64μg/mg^(-1).17μg/mg)were greater than other origins.After wine-processing,the glucose or fructose were dehydrated to increase the levels of 5-hydroxymethylfurfural.The C-4 position of-COOCH3 of hot-sensitive iridoid glycosides was hydrolyzed to generate-COOH as stable components.Polyphenol derivatives may be degraded to increase the content of phenolic acid.Subsequently,an excellent feedforward neural network model for identification of raw cornus and wine-prepared cornus was established which could distinguish the sample origins.Conclusion:This work provided a trustworthy method to evaluate the quality and distinguish the sources of cornus.Meanwhile,the clear processing mechanism provided a scientific foundation for controlling the cornus quality during wine-processing.

Constructing processing map of Ti40 alloy using artificial neural network

Based on the experimental data of Ti40 alloy obtained from Gleeble-1500 thermal simulator,an artificial neural network model of high temperature flow stress as a function of strain,strain rate and temperature was established.In the network model,the input parameters of the model are strain,logarithm strain rate and temperature while flow stress is the output parameter.Multilayer perceptron（MLP） architecture with back-propagation algorithm is utilized.The present study achieves a good performance of the artificial neural network（ANN） model,and the predicted results are in agreement with experimental values.A processing map of Ti40 alloy is obtained with the flow stress predicted by the trained neural network model.The processing map developed by ANN model can efficiently track dynamic recrystallization and flow localization regions of Ti40 alloy during deforming.Subsequently,the safe and instable domains of hot working of Ti40 alloy are identified and validated through microstructural investigations.

Attention-based long short-term memory fully convolutional network for chemical process fault diagnosis

A correct and timely fault diagnosis is important for improving the safety and reliability of chemical processes. With the advancement of big data technology, data-driven fault diagnosis methods are being extensively used and still have considerable potential. In recent years, methods based on deep neural networks have made significant breakthroughs, and fault diagnosis methods for industrial processes based on deep learning have attracted considerable research attention. Therefore, we propose a fusion deeplearning algorithm based on a fully convolutional neural network(FCN) to extract features and build models to correctly diagnose all types of faults. We use long short-term memory(LSTM) units to expand our proposed FCN so that our proposed deep learning model can better extract the time-domain features of chemical process data. We also introduce the attention mechanism into the model, aimed at highlighting the importance of features, which is significant for the fault diagnosis of chemical processes with many features. When applied to the benchmark Tennessee Eastman process, our proposed model exhibits impressive performance, demonstrating the effectiveness of the attention-based LSTM FCN in chemical process fault diagnosis.

Two-view attention-guided convolutional neural network for mammographic image classification

Deep learning has been widely used in the field of mammographic image classification owing to its superiority in automatic feature extraction.However,general deep learning models cannot achieve very satisfactory classification results on mammographic images because these models are not specifically designed for mammographic images and do not take the specific traits of these images into account.To exploit the essential discriminant information of mammographic images,we propose a novel classification method based on a convolutional neural network.Specifically,the proposed method designs two branches to extract the discriminative features from mammographic images from the mediolateral oblique and craniocaudal(CC)mammographic views.The features extracted from the two-view mammographic images contain complementary information that enables breast cancer to be more easily distinguished.Moreover,the attention block is introduced to capture the channel-wise information by adjusting the weight of each feature map,which is beneficial to emphasising the important features of mammographic images.Furthermore,we add a penalty term based on the fuzzy cluster algorithm to the cross-entropy function,which improves the generalisation ability of the classification model by maximising the interclass distance and minimising the intraclass distance of the samples.The experimental results on The Digital database for Screening Mammography INbreast and MIAS mammography databases illustrate that the proposed method achieves the best classification performance and is more robust than the compared state-ofthe-art classification methods.

Dual-Branch-UNet: A Dual-Branch Convolutional Neural Network for Medical Image Segmentation

In intelligent perception and diagnosis of medical equipment,the visual and morphological changes in retinal vessels are closely related to the severity of cardiovascular diseases(e.g.,diabetes and hypertension).Intelligent auxiliary diagnosis of these diseases depends on the accuracy of the retinal vascular segmentation results.To address this challenge,we design a Dual-Branch-UNet framework,which comprises a Dual-Branch encoder structure for feature extraction based on the traditional U-Net model for medical image segmentation.To be more explicit,we utilize a novel parallel encoder made up of various convolutional modules to enhance the encoder portion of the original U-Net.Then,image features are combined at each layer to produce richer semantic data and the model’s capacity is adjusted to various input images.Meanwhile,in the lower sampling section,we give up pooling and conduct the lower sampling by convolution operation to control step size for information fusion.We also employ an attentionmodule in the decoder stage to filter the image noises so as to lessen the response of irrelevant features.Experiments are verified and compared on the DRIVE and ARIA datasets for retinal vessels segmentation.The proposed Dual-Branch-UNet has proved to be superior to other five typical state-of-the-art methods.

Smart Lung Tumor Prediction Using Dual Graph Convolutional Neural Network

A significant advantage of medical image processing is that it allows non-invasive exploration of internal anatomy in great detail.It is possible to create and study 3D models of anatomical structures to improve treatment outcomes,develop more effective medical devices,or arrive at a more accurate diagnosis.This paper aims to present a fused evolutionary algorithm that takes advantage of both whale optimization and bacterial foraging optimization to optimize feature extraction.The classification process was conducted with the aid of a convolu-tional neural network(CNN)with dual graphs.Evaluation of the performance of the fused model is carried out with various methods.In the initial input Com-puter Tomography(CT)image,150 images are pre-processed and segmented to identify cancerous and non-cancerous nodules.The geometrical,statistical,struc-tural,and texture features are extracted from the preprocessed segmented image using various methods such as Gray-level co-occurrence matrix(GLCM),Histo-gram-oriented gradient features(HOG),and Gray-level dependence matrix(GLDM).To select the optimal features,a novel fusion approach known as Whale-Bacterial Foraging Optimization is proposed.For the classification of lung cancer,dual graph convolutional neural networks have been employed.A com-parison of classification algorithms and optimization algorithms has been con-ducted.According to the evaluated results,the proposed fused algorithm is successful with an accuracy of 98.72%in predicting lung tumors,and it outper-forms other conventional approaches.

Early SkinDiseaseIdentification Using Deep Neural Network

Skin lesions detection and classification is a prominent issue and difficult even for extremely skilled dermatologists and pathologists.Skin disease is the most common disorder triggered by fungus,viruses,bacteria,allergies,etc.Skin diseases are most dangerous and may be the cause of serious damage.Therefore,it requires to diagnose it at an earlier stage,but the diagnosis therapy itself is complex and needs advanced laser and photonic therapy.This advance therapy involvesfinancial burden and some other ill effects.Therefore,it must use artificial intelligence techniques to detect and diagnose it accurately at an earlier stage.Several techniques have been proposed to detect skin disease at an earlier stage but fail to get accuracy.Therefore,the primary goal of this paper is to classify,detect and provide accurate information about skin diseases.This paper deals with the same issue by proposing a high-performance Convolution neural network(CNN)to classify and detect skin disease at an earlier stage.The complete meth-odology is explained in different folds:firstly,the skin diseases images are pre-processed with processing techniques,and secondly,the important feature of the skin images are extracted.Thirdly,the pre-processed images are analyzed at different stages using a Deep Convolution Neural Network(DCNN).The approach proposed in this paper is simple,fast,and shows accurate results up to 98%and used to detect six different disease types.

Hybrid Neural Network Model for RH Vacuum Refining Process Control

A hybrid neural network model,in which RH process(theoretical)model is combined organically with neural network(NN)and case-base reasoning(CBR),was established.The CBR method was used to select the operation mode and the RH operational guide parameters for different steel grades according to the initial conditions of molten steel,and a three-layer BP neural network was adopted to deal with nonlinear factors for improving and compensating the limitations of technological model for RH process control and end-point prediction.It was verified that the hybrid neural network is effective for improving the precision and calculation efficiency of the model.

Time series prediction using wavelet process neural network

In the real world, the inputs of many complicated systems are time-varying functions or processes. In order to predict the outputs of these systems with high speed and accuracy, this paper proposes a time series prediction model based on the wavelet process neural network, and develops the corresponding learning algorithm based on the expansion of the orthogonal basis functions. The effectiveness of the proposed time series prediction model and its learning algorithm is proved by the Macke-Glass time series prediction, and the comparative prediction results indicate that the proposed time series prediction model based on the wavelet process neural network seems to perform well and appears suitable for using as a good tool to predict the highly complex nonlinear time series.

Dimensionality Reduction with Input Training Neural Network and Its Application in Chemical Process Modelling

Many applications of principal component analysis (PCA) can be found in dimensionality reduction. But linear PCA method is not well suitable for nonlinear chemical processes. A new PCA method based on im-proved input training neural network (IT-NN) is proposed for the nonlinear system modelling in this paper. Mo-mentum factor and adaptive learning rate are introduced into learning algorithm to improve the training speed of IT-NN. Contrasting to the auto-associative neural network (ANN), IT-NN has less hidden layers and higher training speed. The effectiveness is illustrated through a comparison of IT-NN with linear PCA and ANN with experiments. Moreover, the IT-NN is combined with RBF neural network (RBF-NN) to model the yields of ethylene and propyl-ene in the naphtha pyrolysis system. From the illustrative example and practical application, IT-NN combined with RBF-NN is an effective method of nonlinear chemical process modelling.

Optimization of Processing Parameters of Power Spinning for Bushing Based on Neural Network and Genetic Algorithms

A neural network model of key process parameters and forming quality is developed based on training samples which are obtained from the orthogonal experiment and the finite element numerical simulation. Optimization of the process parameters is conducted using the genetic algorithm (GA). The experimental results have shown that a surface model of the neural network can describe the nonlinear implicit relationship between the parameters of the power spinning process:the wall margin and amount of expansion. It has been found that the process of determining spinning technological parameters can be accelerated using the optimization method developed based on the BP neural network and the genetic algorithm used for the process parameters of power spinning formation. It is undoubtedly beneficial towards engineering applications.

ia-PNCC: Noise Processing Method for Underwater Target Recognition Convolutional Neural Network

Underwater target recognition is a key technology for underwater acoustic countermeasure.How to classify and recognize underwater targets according to the noise information of underwater targets has been a hot topic in the field of underwater acoustic signals.In this paper,the deep learning model is applied to underwater target recognition.Improved anti-noise Power-Normalized Cepstral Coefficients(ia-PNCC)is proposed,based on PNCC applied to underwater noises.Multitaper and normalized Gammatone filter banks are applied to improve the anti-noise capacity.The method is combined with a convolutional neural network in order to recognize the underwater target.Experiment results show that the acoustic feature presented by ia-PNCC has lower noise and are wellsuited to underwater target recognition using a convolutional neural network.Compared with the combination of convolutional neural network with single acoustic feature,such as MFCC(Mel-scale Frequency Cepstral Coefficients)or LPCC(Linear Prediction Cepstral Coefficients),the combination of the ia-PNCC with a convolutional neural network offers better accuracy for underwater target recognition.

Peri-Net-Pro: the neural processes with quantified uncertainty for crack patterns

This paper develops a deep learning tool based on neural processes(NPs)called the Peri-Net-Pro,to predict the crack patterns in a moving disk and classifies them according to the classification modes with quantified uncertainties.In particular,image classification and regression studies are conducted by means of convolutional neural networks(CNNs)and NPs.First,the amount and quality of the data are enhanced by using peridynamics to theoretically compensate for the problems of the finite element method(FEM)in generating crack pattern images.Second,case studies are conducted with the prototype microelastic brittle(PMB),linear peridynamic solid(LPS),and viscoelastic solid(VES)models obtained by using the peridynamic theory.The case studies are performed to classify the images by using CNNs and determine the suitability of the PMB,LBS,and VES models.Finally,a regression analysis is performed on the crack pattern images with NPs to predict the crack patterns.The regression analysis results confirm that the variance decreases when the number of epochs increases by using the NPs.The training results gradually improve,and the variance ranges decrease to less than 0.035.The main finding of this study is that the NPs enable accurate predictions,even with missing or insufficient training data.The results demonstrate that if the context points are set to the 10th,100th,300th,and 784th,the training information is deliberately omitted for the context points of the 10th,100th,and 300th,and the predictions are different when the context points are significantly lower.However,the comparison of the results of the 100th and 784th context points shows that the predicted results are similar because of the Gaussian processes in the NPs.Therefore,if the NPs are employed for training,the missing information of the training data can be supplemented to predict the results.

Prediction about residual stress and microhardness of material subjected to multiple overlap laser shock processing using artificial neural network

In this work,the nickel-based powder metallurgy superalloy FGH95 was selected as experimental material,and the experimental parameters in multiple overlap laser shock processing(LSP)treatment were selected based on orthogonal experimental design.The experimental data of residual stress and microhardness were measured in the same depth.The residual stress and microhardness laws were investigated and analyzed.Artificial neural network(ANN)with four layers(4-N-(N-1)-2)was applied to predict the residual stress and microhardness of FGH95 subjected to multiple overlap LSP.The experimental data were divided as training-testing sets in pairs.Laser energy,overlap rate,shocked times and depth were set as inputs,while residual stress and microhardness were set as outputs.The prediction performances with different network configuration of developed ANN models were compared and analyzed.The developed ANN model with network configuration of 4-7-6-2 showed the best predict performance.The predicted values showed a good agreement with the experimental values.In addition,the correlation coefficients among all the parameters and the effect of LSP parameters on materials response were studied.It can be concluded that ANN is a useful method to predict residual stress and microhardness of material subjected to LSP when with limited experimental data.

An Intelligent Neural Networks System for Adaptive Learning and Prediction of a Bioreactor Benchmark Process

The adaptive learning and prediction of a highly nonlinear and time-varying bioreactor benchmark process is studied using Neur-On-Line, a graphical tool kit for developing and deploying neural networks in the G2 real time intelligent environment,and a new modified Broyden, Fletcher, Goldfarb, and Shanno （BFGS） quasi-Newton algorithm. The modified BFGS algorithm for the adaptive learning of back propagation （BP） neural networks is developed and embedded into NeurOn-Line by introducing a new search method of learning rate to the full memory BFGS algorithm. Simulation results show that the adaptive learning and prediction neural network system can quicklv track the time-varving and nonlinear behavior of the bioreactor.