Feed-Forward Neural Network Based Petroleum Wells Equipment Failure Prediction

In the oil industry, the productivity of oil wells depends on the performance of the sub-surface equipment system. These systems often have problems stemming from sand, corrosion, internal pressure variation, or other factors. In order to ensure high equipment performance and avoid high-cost losses, it is essential to identify the source of possible failures in the early stage. However, this requires additional maintenance fees and human power. Moreover, the losses caused by these problems may lead to interruptions in the whole production process. In order to minimize maintenance costs, in this paper, we introduce a model for predicting equipment failure based on processing the historical data collected from multiple sensors. The state of the system is predicted by a Feed-Forward Neural Network (FFNN) with an SGD and Backpropagation algorithm is applied in the training process. Our model’s primary goal is to identify potential malfunctions at an early stage to ensure the production process’ continued high performance. We also evaluated the effectiveness of our model against other solutions currently available in the industry. The results of our study show that the FFNN can attain an accuracy score of 97% on the given dataset, which exceeds the performance of the models provided.

A Kind of Second-Order Learning Algorithm Based on Generalized Cost Criteria in Multi-Layer Feed-Forward Neural Networks

A kind of second order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi layer feed forward neural networks, the second order back propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second order learning algorithm that was given by Karayiannis.

Combined Signal Processing Based Techniques and Feed Forward Neural Networks for Pathological Voice Detection and Classification

This paper presents the pathological voice detection and classification techniques using signal processing based methodologies and Feed Forward Neural Networks(FFNN).The important pathological voices such as Autism Spectrum Disorder(ASD)and Down Syndrome(DS)are considered for analysis.These pathological voices are known to manifest in different ways in the speech of children and adults.Therefore,it is possible to discriminate ASD and DS children from normal ones using the acoustic features extracted from the speech of these subjects.The important attributes hidden in the pathological voices are extracted by applying different signal processing techniques.In this work,three group of feature vectors such as perturbation measures,noise parameters and spectral-cepstral modeling are derived from the signals.The detection and classification is done by means of Feed For-ward Neural Network(FFNN)classifier trained with Scaled Conjugate Gradient(SCG)algorithm.The performance of the network is evaluated by finding various performance metrics and the the experimental results clearly demonstrate that the proposed method gives better performance compared with other methods discussed in the literature.

Near-infrared Spectral Detection of the Content of Soybean Fat Acids Based on Genetic Multilayer Feed forward Neural Network

In the paper, a method of building mathematic model employing genetic multilayer feed forward neural network is presented, and the quantitative relationship of chemical measured values and near-infrared spectral data is established. In the paper, quantitative mathematic model related chemical assayed values and near-infrared spectral data is established by means of genetic multilayer feed forward neural network, acquired near-infrared spectral data are taken as input of network with the content of five kinds of fat acids tested from chemical method as output, weight values of multilayer feed forward neural network are trained by genetic algorithms and detection model of neural network of soybean is built. A kind of multilayer feed forward neural network trained by genetic algorithms is designed in the paper. Through experiments, all the related coefficients of five fat acids can approach 0.9 which satisfies the preliminary test of soybean breeding.

Feed-Forward Artificial Neural Network Model for Air Pollutant Index Prediction in the Southern Region of Peninsular Malaysia

This paper describes the application of principal component analysis (PCA) and artificial neural network (ANN) to predict the air pollutant index (API) within the seven selected Malaysian air monitoring stations in the southern region of Peninsular Malaysia based on seven years database (2005-2011). Feed-forward ANN was used as a prediction method. The feed-forward ANN analysis demonstrated that the rotated principal component scores (RPCs) were the best input parameters to predict API. From the 4 RPCs, only 10 (CO, O3, PM10, NO2, CH4, NmHC, THC, wind direction, humidity and ambient temp) out of 12 prediction variables were the most significant parameters to predict API. The results proved that the ANN method can be applied successfully as tools for decision making and problem solving for better atmospheric management.

Using Neural Networks to Predict Secondary Structure for Protein Folding

Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate prediction results. The goal of this paper is to develop and implement an intelligent based system to predict secondary structure of a protein from its primary amino acid sequence by using five models of Neural Network (NN). These models are Feed Forward Neural Network (FNN), Learning Vector Quantization (LVQ), Probabilistic Neural Network (PNN), Convolutional Neural Network (CNN), and CNN Fine Tuning for PSSP. To evaluate our approaches two datasets have been used. The first one contains 114 protein samples, and the second one contains 1845 protein samples.

Using Feed Forward BPNN for Forecasting All Share Price Index

Use of artificial neural networks has become a significant and an emerging research method due to its capability of capturing nonlinear behavior instead of conventional time series methods. Among them, feed forward back propagation neural network (BPNN) is the widely used network topology for forecasting stock prices indices. In this study, we attempted to find the best network topology for one step ahead forecasting of All Share Price Index (ASPI), Colombo Stock Exchange (CSE) by employing feed forward BPNN. The daily data including ASPI, All Share Total Return Index (ASTRI), Market Price Earnings Ratio (PER), and Market Price to Book Value (PBV) were collected from CSE over the period from January 2nd 2012 to March 20th 2014. The experiment is implemented by prioritizing the number of inputs, learning rate, number of hidden layer neurons, and the number of training sessions. Eight models were selected on basis of input data and the number of training sessions. Then the best model was used for forecasting next trading day ASPI value. Empirical result reveals that the proposed model can be used as an approximation method to obtain next day value. In addition, it showed that the number of inputs, number of hidden layer neurons and the training times are significant factors that can be affected to the accuracy of forecast value.

基于多层前馈神经网络的扩散系数求解

如何利用浓度分布的测量数据(间接采样)来确定扩散系数,并建立有效快速的数值求解方法是目前亟待解决的问题.由于扩散系数的求解属于反问题中的参数识别问题,通常具有不适定、非线性和计算量大等特点,所以在仅考虑给定温度下扩散对物质输运的影响的情况下,研究扩散系数与浓度、浓度梯度的关系,并利用物质扩散浓度的动态采样值和多层前馈神经网络对扩散系数进行求解,数值实验表明该方法十分有效.

Forecasting solar power generation using evolutionary mating algorithm-deep neural networks

This paper proposes an integration of recent metaheuristic algorithm namely Evolutionary Mating Algorithm (EMA) in optimizing the weights and biases of deep neural networks (DNN) for forecasting the solar power generation. The study employs a Feed Forward Neural Network (FFNN) to forecast AC power output using real solar power plant measurements spanning a 34-day period, recorded at 15-minute intervals. The intricate nonlinear relationship between solar irradiation, ambient temperature, and module temperature is captured for accurate prediction. Additionally, the paper conducts a comprehensive comparison with established algorithms, including Differential Evolution (DE-DNN), Barnacles Mating Optimizer (BMO-DNN), Particle Swarm Optimization (PSO-DNN), Harmony Search Algorithm (HSA-DNN), DNN with Adaptive Moment Estimation optimizer (ADAM) and Nonlinear AutoRegressive with eXogenous inputs (NARX). The experimental results distinctly highlight the exceptional performance of EMA-DNN by attaining the lowest Root Mean Squared Error (RMSE) during testing. This contribution not only advances solar power forecasting methodologies but also underscores the potential of merging metaheuristic algorithms with contemporary neural networks for improved accuracy and reliability.

面向图像分类的Vision Transformer研究综述

作为一种基于Transformer架构的模型,ViT已经在图像分类任务中展现出了良好的效果。对ViT在图像分类任务上的应用进行系统性归纳总结。首先,简单介绍了ViT框架及其4个模块(patch模块、位置编码、多头注意力和前馈神经网络)的功能特性;其次,以ViT中4个模块的改进措施为脉络综述其在图像分类任务中的应用;再次,由于不同的模型结构和改进措施对最终的分类性能产生显著影响,还对文中出现的各类ViT进行了横向对比,并详细列出模型的参数和分类精度及其优缺点;最后,指出ViT在图像分类任务中的优势和局限性,并提出未来可能的研究方向以打破其局限性,进一步扩展ViT在其他计算机视觉任务中的应用,同时,还可以探索将ViT扩展到视频理解等更广泛的计算机视觉领域。

基于多源数据融合分析的地质风险预测算法设计

为了准确预测和评估地质工程中存在的风险,设计一种基于多源数据融合分析的地质风险巡检系统。该系统能够综合利用探地雷达、红外传感器等设备采集到的数据信息,通过智能化检测算法快速、准确地识别出地质风险。在预测模型的设计中,提出了一种基于SCINet和LSTM的地质风险预测算法。该算法通过前馈神经网络(FFN)来增强多源数据的非线性表示;并且能够利用SCINet在提取多尺度特征方面的优势,引入LSTM使得模型具有捕获长期依赖性的能力,从而提高整体算法的预测精度。实验结果表明,所提出的预测算法能够有效提高对地质风险的识别性能。与GRU和Bi-LSTM等多种识别算法进行的对比实验验证了该算法的优越性,其准确率相比主流的Bi-LSTM提高了15.95%。

比例延迟微分方程的极限学习机算法

目的针对比例延迟微分方程,提出一种基于极限学习机(ELM)算法的单隐藏层前馈神经网络训练方法,并将该方法推广到求解双比例延迟微分系统。方法首先,构建一个单隐藏层前馈神经网络并随机生成输入权值和隐藏层偏置;然后,通过计算系数矩阵使其满足比例延迟微分方程及其初值条件,将其转化为最小二乘问题,利用摩尔-彭罗斯广义逆解出输出权值;最后,将输出权值代入构建的神经网络便可获得具有较高精度的比例延迟微分方程数值解。结果通过数值实验与已有方法的结果进行比较,验证了该方法对处理比例延迟微分方程与双比例延迟微分系统的有效性,且随着选取的训练点和隐藏层节点数量增多,所得到的数值解精度和收敛速度也随之增加。结论ELM算法对处理比例延迟微分方程以及双比例延迟微分系统具有较好的效果。

BP神经网络在垃圾焚烧电厂酸性气体排放控制中的应用

对于采用半干法的大多数垃圾焚烧发电厂,控制酸性气体排放浓度的主要手段是调节脱酸塔入口石灰浆流量。传统的PID控制采用CEMS实测数据作为反馈信号调节石灰浆流量,但脱酸塔入口到烟囱烟气采样点距离远,反应时间长,控制效果不佳。为此,引入BP人工神经网络遗传算法,并利用人工控制模式下积累的大量过程数据训练人工神经网络,以替代人工控制。

A three-dimensional nonlinear reduced-order predictive joint model

Mechanical joints can have significant effects on the dynamics of assembled structures.However,the lack of efficacious predictive dynamic models tot joints hinders accurate prediction of their dynamic behavior.The goal of our work is to develop physics-based,reduced-order,finite element models that are capable of replicating the effects of joints on vi- brating structures.The authors recently developed the so-called two-dimensional adjusted lwan beam element(2-D AIBE) to simulate the hysteretic behavior of bolted joints in 2-D beam structures.In this paper,2-D AIBE is extended to three-di- mensional cases by formulating a three-dimensional adjusted lwan beam element(3-D AIBE).hupulsive loading experi- ments are applied to a jointed frame structure and a beam structure containing the same joint.The frame is subjected to ex- citation out of plane so that the joint is under rotation and single axis bending.By assuming that the rotation in the joint is linear elastic,the parameters of the joint associated with bending in the flame are identified from acceleration responses of the jointed beam structure,using a multi-layer teed-torward neural network(MLFF).Numerieal simulation is then per- formed on the frame structure using the identified parameters.The good agreement between the simulated and experimental impulsive acceleration responses of the frame structure validates the efficacy of the presented 3-D AIBE,and indicates that the model can potentially be applied to more complex structural systems with joint parameters identified from a relatively simple structure.

Determination of penetration depth at high velocity impact using finite element method and artificial neural network tools

Determination of ballistic performance of an armor solution is a complicated task and evolved significantly with the application of finite element methods(FEM) in this research field.The traditional armor design studies performed with FEM requires sophisticated procedures and intensive computational effort,therefore simpler and accurate numerical approaches are always worthwhile to decrease armor development time.This study aims to apply a hybrid method using FEM simulation and artificial neural network(ANN) analysis to approximate ballistic limit thickness for armor steels.To achieve this objective,a predictive model based on the artificial neural networks is developed to determine ballistic resistance of high hardness armor steels against 7.62 mm armor piercing ammunition.In this methodology,the FEM simulations are used to create training cases for Multilayer Perceptron(MLP) three layer networks.In order to validate FE simulation methodology,ballistic shot tests on 20 mm thickness target were performed according to standard Stanag 4569.Afterwards,the successfully trained ANN(s) is used to predict the ballistic limit thickness of 500 HB high hardness steel armor.Results show that even with limited number of data,FEM-ANN approach can be used to predict ballistic penetration depth with adequate accuracy.

Response Surface Methodology and Artificial Neural Network Methods Comparative Assessment for Fuel Rich and Fuel Lean Catalytic Combustion

Modeling, predictive and generalization capabilities of response surface methodology (RSM) and artificial neural network (ANN) have been performed to assess the thermal structure of the experimentally studied catalytic combustion of stabilized confined turbulent gaseous diffusion flames. The Pt/γAl2O3 and Pd/γAl2O3 disc burners were located in the combustion domain and the experiments were accomplished under both fuel-rich and fuel-lean conditions at a modified equivalence (fuel/air) ratio (ø) of 0.75 and 0.25, respectively. The thermal structure of these catalytic flames developed over the Pt and Pd disc burners was scrutinized via measuring the mean temperature profiles in the radial direction at different discrete axial locations along with the flames. The RSM and ANN methods investigated the effect of the two operating parameters namely (r), the radial distance from the center line of the flame, and (x), axial distance along with the flame over the disc, on the measured temperature of the flames and predicted the corresponding temperatures beside predicting the maximum temperature and the corresponding input process variables. A three-layered Feed Forward Neural Network was developed in conjugation with the hyperbolic tangent sigmoid (tansig) transfer function and an optimized topology of 2:10:1 (input neurons:hidden neurons:output neurons). Also the ANN method has been exploited to illustrate the effects of coded R and X input variables on the response in the three and two dimensions and to locate the predicted maximum temperature. The results indicated the superiority of ANN in the prediction capability as the ranges of & F_Ratio are 0.9181 - 0.9809 & 634.5 - 3528.8 for RSM method compared to 0.9857 - 0.9951 & 7636.4 - 24,028.4 for ANN method beside lower values for error analysis terms.

Comparative Appraisal of Response Surface Methodology and Artificial Neural Network Method for Stabilized Turbulent Confined Jet Diffusion Flames Using Bluff-Body Burners

The present study was conducted to present the comparative modeling, predictive and generalization abilities of response surface methodology (RSM) and artificial neural network (ANN) for the thermal structure of stabilized confined jet diffusion flames in the presence of different geometries of bluff-body burners. Two stabilizer disc burners tapered at 30° and 60° and another frustum cone of 60°/30° inclination angle were employed all having the same diameter of 80 (mm) acting as flame holders. The measured radial mean temperature profiles of the developed stabilized flames at different normalized axial distances (x/dj) were considered as the model example of the physical process. The RSM and ANN methods analyze the effect of the two operating parameters namely (r), the radial distance from the center line of the flame, and (x/dj) on the measured temperature of the flames, to find the predicted maximum temperature and the corresponding process variables. A three-layered Feed Forward Neural Network in conjugation with the hyperbolic tangent sigmoid (tansig) as transfer function and the optimized topology of 2:10:1 (input neurons: hidden neurons: output neurons) was developed. Also the ANN method has been employed to illustrate such effects in the three and two dimensions and shows the location of the predicted maximum temperature. The results indicated the superiority of ANN in the prediction capability as the ranges of R2 and F Ratio are 0.868 - 0.947 and 231.7 - 864.1 for RSM method compared to 0.964 - 0.987 and 2878.8 7580.7 for ANN method beside lower values for error analysis terms.

Wavelet based detection of ventricular arrhythmias with neural network classifier

This paper presents an algorithm based on the wavelet decomposition, for feature extraction from the Electrocardiogram (ECG) signal and recognition of three types of Ventricular Arrhythmias using neural networks. A set of Discrete Wavelet Transform (DWT) coefficients, which contain the maximum information about the arrhythmias, is selected from the wavelet decomposition. These coefficients are fed to the feed forward neural network which classifies the arrhythmias. The algorithm is applied on the ECG registrations from the MIT-BIH arrhythmia and malignant ventricular arrhythmia databases. We applied Daubechies 4 wavelet in our algorithm. The wavelet decomposition enabled us to perform the task efficiently and produced reliable results.

Study on the Elman Neural Network Operation Control Strategy of the Central Air Conditioning Chilled Water System

The stable operation of the central air conditioning water system always is a major difficulty for the control profession. Paper focus on the water system with multi variable, strong coupling, nonlinear, large time delay characteristics, presented use feed forward coupling compensation method, to eliminate the coupling effect between temperature and pressure. In this paper, the Elman neural network controller is designed for the first time, and the simulation results show that the response time of Elman neural network controller is shorter, the system is more stable and the overshoot is small.

Hardware Realization of Artificial Neural Network Based Intrusion Detection &Prevention System

In the 21st century with the exponential growth of the Internet, the vulnerability of the network which connects us is on the rise at a very fast pace. Today organizations are spending millions of dollars to protect their sensitive data from different vulnerabilities that they face every day. In this paper, a new methodology towards implementing an Intrusion Detection & Prevention System (IDPS) based on Artificial Neural Network (ANN) onto Field Programmable Gate Array (FPGA) is proposed. This system not only detects different network attacks but also prevents them from being propagated. The parallel structure of an ANN makes it potentially fast for the computation of certain tasks. FPGA platforms are the optimum and best choice for the modern digital systems nowadays. The same feature makes ANN well suited for implementation in FPGA technology. Hardware realization of ANN to a large extent depends on the efficient implementation of a single neuron. However FPGA realization of ANNs with a large number of neurons is still a challenging task. The proposed multilayer ANN based IDPS uses multiple neurons for higher performance and greater accuracy. Simulation of the design in MATLAB SIMULINK 2010b by using Knowledge Discovery and Data Mining (KDD) CUP dataset shows a very good performance. Subsequently MATLAB HDL coder was used to generate VHDL code for the proposed design that produced Intellectual Property (IP) cores for Xilinx Targeted Design Platforms. For evaluation purposes the proposed design was synthesized, implemented and tested onto Xilinx Virtex-7 2000T FPGA device.