Hybrid model for BOF oxygen blowing time prediction based on oxygen balance mechanism and deep neural network

The amount of oxygen blown into the converter is one of the key parameters for the control of the converter blowing process,which directly affects the tap-to-tap time of converter. In this study, a hybrid model based on oxygen balance mechanism (OBM) and deep neural network (DNN) was established for predicting oxygen blowing time in converter. A three-step method was utilized in the hybrid model. First, the oxygen consumption volume was predicted by the OBM model and DNN model, respectively. Second, a more accurate oxygen consumption volume was obtained by integrating the OBM model and DNN model. Finally, the converter oxygen blowing time was calculated according to the oxygen consumption volume and the oxygen supply intensity of each heat. The proposed hybrid model was verified using the actual data collected from an integrated steel plant in China, and compared with multiple linear regression model, OBM model, and neural network model including extreme learning machine, back propagation neural network, and DNN. The test results indicate that the hybrid model with a network structure of 3 hidden layer layers, 32-16-8 neurons per hidden layer, and 0.1 learning rate has the best prediction accuracy and stronger generalization ability compared with other models. The predicted hit ratio of oxygen consumption volume within the error±300 m^(3)is 96.67%;determination coefficient (R^(2)) and root mean square error (RMSE) are0.6984 and 150.03 m^(3), respectively. The oxygen blow time prediction hit ratio within the error±0.6 min is 89.50%;R2and RMSE are0.9486 and 0.3592 min, respectively. As a result, the proposed model can effectively predict the oxygen consumption volume and oxygen blowing time in the converter.

Review of Artificial Intelligence for Oil and Gas Exploration: Convolutional Neural Network Approaches and the U-Net 3D Model

Deep learning, especially through convolutional neural networks (CNN) such as the U-Net 3D model, has revolutionized fault identification from seismic data, representing a significant leap over traditional methods. Our review traces the evolution of CNN, emphasizing the adaptation and capabilities of the U-Net 3D model in automating seismic fault delineation with unprecedented accuracy. We find: 1) The transition from basic neural networks to sophisticated CNN has enabled remarkable advancements in image recognition, which are directly applicable to analyzing seismic data. The U-Net 3D model, with its innovative architecture, exemplifies this progress by providing a method for detailed and accurate fault detection with reduced manual interpretation bias. 2) The U-Net 3D model has demonstrated its superiority over traditional fault identification methods in several key areas: it has enhanced interpretation accuracy, increased operational efficiency, and reduced the subjectivity of manual methods. 3) Despite these achievements, challenges such as the need for effective data preprocessing, acquisition of high-quality annotated datasets, and achieving model generalization across different geological conditions remain. Future research should therefore focus on developing more complex network architectures and innovative training strategies to refine fault identification performance further. Our findings confirm the transformative potential of deep learning, particularly CNN like the U-Net 3D model, in geosciences, advocating for its broader integration to revolutionize geological exploration and seismic analysis.

A Neural-network-based Alternative Scheme to Include Nonhydrostatic Processes in an Atmospheric Dynamical Core

Here,a nonhydrostatic alternative scheme(NAS)is proposed for the grey zone where the nonhydrostatic impact on the atmosphere is evident but not large enough to justify the necessity to include an implicit nonhydrostatic solver in an atmospheric dynamical core.The NAS is designed to replace this solver,which can be incorporated into any hydrostatic models so that existing well-developed hydrostatic models can effectively serve for a longer time.Recent advances in machine learning(ML)provide a potential tool for capturing the main complicated nonlinear-nonhydrostatic relationship.In this study,an ML approach called a neural network(NN)was adopted to select leading input features and develop the NAS.The NNs were trained and evaluated with 12-day simulation results of dry baroclinic-wave tests by the Weather Research and Forecasting(WRF)model.The forward time difference of the nonhydrostatic tendency was used as the target variable,and the five selected features were the nonhydrostatic tendency at the last time step,and four hydrostatic variables at the current step including geopotential height,pressure in two different forms,and potential temperature,respectively.Finally,a practical NAS was developed with these features and trained layer by layer at a 20-km horizontal resolution,which can accurately reproduce the temporal variation and vertical distribution of the nonhydrostatic tendency.Corrected by the NN-based NAS,the improved hydrostatic solver at different horizontal resolutions can run stably for at least one month and effectively reduce most of the nonhydrostatic errors in terms of system bias,anomaly root-mean-square error,and the error of the wave spatial pattern,which proves the feasibility and superiority of this scheme.

A study on temperature monitoring method for inverter IGBT based on memory recurrent neural network

The power module of the Insulated Gate Bipolar Transistor(IGBT)is the core component of the traction transmission system of high-speed trains.The module's junction temperature is a critical factor in determining device reliability.Existing temperature monitoring methods based on the electro-thermal coupling model have limitations,such as ignoring device interactions and high computational complexity.To address these issues,an analysis of the parameters influencing IGBT failure is conducted,and a temperature monitoring method based on the Macro-Micro Attention Long Short-Term Memory(MMALSTM)recursive neural network is proposed,which takes the forward voltage drop and collector current as features.Compared with the traditional electricalthermal coupling model method,it requires fewer monitoring parameters and eliminates the complex loss calculation and equivalent thermal resistance network establishment process.The simulation model of a highspeed train traction system has been established to explore the accuracy and efficiency of MMALSTM-based prediction methods for IGBT power module junction temperature.The simulation outcomes,which deviate only 3.2% from the theoretical calculation results of the electric-thermal coupling model,confirm the reliability of this approach for predicting the temperature of IGBT power modules.

Artificial neural network-based one-equation model for simulation of laminar-turbulent transitional flow

A mapping function between the Reynolds-averaged Navier-Stokes mean flow variables and transition intermittency factor is constructed by fully connected artificial neural network(ANN),which replaces the governing equation of the intermittency factor in transition-predictive Spalart-Allmaras(SA)-γmodel.By taking SA-γmodel as the benchmark,the present ANN model is trained at two airfoils with various angles of attack,Mach numbers and Reynolds numbers,and tested with unseen airfoils in different flow states.The a posteriori tests manifest that the mean pressure coefficient,skin friction coefficient,size of laminar separation bubble,mean streamwise velocity,Reynolds shear stress and lift/drag/moment coefficient from the present two-way coupling ANN model almost coincide with those from the benchmark SA-γmodel.Furthermore,the ANN model proves to exhibit a higher calculation efficiency and better convergence quality than traditional SA-γmodel.

Artificial neural network-based subgrid-scale models for LES of compressible turbulent channel flow

Fully connected neural networks(FCNNs)have been developed for the closure of subgrid-scale(SGS)stress and SGS heat flux in large-eddy simulations of compressible turbulent channel flow.The FCNNbased SGS model trained using data with Mach number Ma=3.0 and Reynolds number Re=3000 was applied to situations with different Mach numbers and Reynolds numbers.The input variables of the neural network model were the filtered velocity gradients and temperature gradients at a single spatial grid point.The a priori test showed that the FCNN model had a correlation coefficient larger than 0.91 and a relative error smaller than 0.43,with much better reconstructions of SGS unclosed terms than the dynamic Smagorinsky model(DSM).In a posteriori test,the behavior of the FCNN model was marginally better than that of the DSM in predicting the mean velocity profiles,mean temperature profiles,turbulent intensities,total Reynolds stress,total Reynolds heat flux,and mean SGS flux of kinetic energy,and outperformed the Smagorinsky model.

Fractional Order Environmental and Economic Model Investigations Using Artificial Neural Network

The motive of these investigations is to provide the importance and significance of the fractional order(FO)derivatives in the nonlinear environmental and economic(NEE)model,i.e.,FO-NEE model.The dynamics of the NEE model achieves more precise by using the form of the FO derivative.The investigations through the non-integer and nonlinear mathematical form to define the FO-NEE model are also provided in this study.The composition of the FO-NEEmodel is classified into three classes,execution cost of control,system competence of industrial elements and a new diagnostics technical exclusion cost.The mathematical FO-NEE system is numerically studied by using the artificial neural networks(ANNs)along with the Levenberg-Marquardt backpropagation method(ANNs-LMBM).Three different cases using the FO derivative have been examined to present the numerical performances of the FO-NEE model.The data is selected to solve the mathematical FO-NEE system is executed as 70%for training and 15%for both testing and certification.The exactness of the proposed ANNs-LMBM is observed through the comparison of the obtained and the Adams-Bashforth-Moulton database results.To ratify the aptitude,validity,constancy,exactness,and competence of the ANNs-LMBM,the numerical replications using the state transitions,regression,correlation,error histograms and mean square error are also described.

Nitrogen Content Inversion of Corn Leaf Data Based on Deep Neural Network Model

To obtain excellent regression results under the condition of small sample hyperspectral data,a deep neural network with simulated annealing(SA-DNN)is proposed.According to the characteristics of data,the attention mechanism was applied to make the network pay more attention to effective features,thereby improving the operating efficiency.By introducing an improved activation function,the data correlation was reduced based on increasing the operation rate,and the problem of over-fitting was alleviated.By introducing simulated annealing,the network chose the optimal learning rate by itself,which avoided falling into the local optimum to the greatest extent.To evaluate the performance of the SA-DNN,the coefficient of determination(R^(2)),root mean square error(RMSE),and other metrics were used to evaluate the model.The results show that the performance of the SA-DNN is significantly better than other traditional methods.

Leveraging Quantum Computing for the Ising Model to Simulate Two Real Systems: Magnetic Materials and Biological Neural Networks (BNNs)

Quantum computing is a field with increasing relevance as quantum hardware improves and more applications of quantum computing are discovered. In this paper, we demonstrate the feasibility of modeling Ising Model Hamiltonians on the IBM quantum computer. We developed quantum circuits to simulate these systems more efficiently for both closed and open boundary Ising models, with and without perturbations. We tested these various geometries of systems in both 1-D and 2-D space to mimic two real systems: magnetic materials and biological neural networks (BNNs). Our quantum model is more efficient than classical computers, which can struggle to simulate large, complex systems of particles.

Physics-informed neural network approach for heat generation rate estimation of lithium-ion battery under various driving conditions

Accurate insight into the heat generation rate(HGR) of lithium-ion batteries(LIBs) is one of key issues for battery management systems to formulate thermal safety warning strategies in advance.For this reason,this paper proposes a novel physics-informed neural network(PINN) approach for HGR estimation of LIBs under various driving conditions.Specifically,a single particle model with thermodynamics(SPMT) is first constructed for extracting the critical physical knowledge related with battery HGR.Subsequently,the surface concentrations of positive and negative electrodes in battery SPMT model are integrated into the bidirectional long short-term memory(BiLSTM) networks as physical information.And combined with other feature variables,a novel PINN approach to achieve HGR estimation of LIBs with higher accuracy is constituted.Additionally,some critical hyperparameters of BiLSTM used in PINN approach are determined through Bayesian optimization algorithm(BOA) and the results of BOA-based BiLSTM are compared with other traditional BiLSTM/LSTM networks.Eventually,combined with the HGR data generated from the validated virtual battery,it is proved that the proposed approach can well predict the battery HGR under the dynamic stress test(DST) and worldwide light vehicles test procedure(WLTP),the mean absolute error under DST is 0.542 kW/m^(3),and the root mean square error under WLTP is1.428 kW/m^(3)at 25℃.Lastly,the investigation results of this paper also show a new perspective in the application of the PINN approach in battery HGR estimation.

Prediction of column failure modes based on artificial neural network

To implement the performance-based seismic design of engineered structures,the failure modes of members must be classified.The classification method of column failure modes is analyzed using data from the Pacific Earthquake Engineering Research Center(PEER).The main factors affecting failure modes of columns include the hoop ratios,longitudinal reinforcement ratios,ratios of transverse reinforcement spacing to section depth,aspect ratios,axial compression ratios,and flexure-shear ratios.This study proposes a data-driven prediction model based on an artificial neural network(ANN)to identify the column failure modes.In this study,111 groups of data are used,out of which 89 are used as training data and 22 are used as test data,and the ANN prediction model of failure modes is developed.The results show that the proposed method based on ANN is superior to traditional methods in identifying the column failure modes.

Application of convolutional neural networks to large-scale naphtha pyrolysis kinetic modeling

System design and optimization problems require large-scale chemical kinetic models. Pure kinetic models of naphtha pyrolysis need to solve a complete set of stiff ODEs and is therefore too computational expensive. On the other hand, artificial neural networks that completely neglect the topology of the reaction networks often have poor generalization. In this paper, a framework is proposed for learning local representations from largescale chemical reaction networks. At first, the features of naphtha pyrolysis reactions are extracted by applying complex network characterization methods. The selected features are then used as inputs in convolutional architectures. Different CNN models are established and compared to optimize the neural network structure.After the pre-training and fine-tuning step, the ultimate CNN model reduces the computational cost of the previous kinetic model by over 300 times and predicts the yields of main products with the average error of less than 3%. The obtained results demonstrate the high efficiency of the proposed framework.

Neural Network and GBSM Based Time-Varying and Stochastic Channel Modeling for 5G Millimeter Wave Communications

In this work,a frame work for time-varying channel modeling and simulation is proposed by using neural network(NN)to overcome the shortcomings in geometry based stochastic model(GBSM)and simulation approach.Two NN models are developed for modeling of path loss together with shadow fading(SF)and joint small scale channel parameters.The NN models can predict path loss plus SF and small scale channel parameters accurately compared with measurement at 26 GHz performed in an outdoor microcell.The time-varying path loss and small scale channel parameters generated by the NN models are proposed to replace the empirical path loss and channel parameter random numbers in GBSM-based framework to playback the measured channel and match with its environment.Moreover,the sparse feature of clusters,delay and angular spread,channel capacity are investigated by a virtual array measurement at 28 GHz in a large waiting hall.

Nonlinear Decoupling PID Control Using Neural Networks and Multiple Models

For a class of complex industrial processes with strong nonlinearity, serious coupling and uncertainty, a nonlinear decoupling proportional-integral-differential （PID） controller is proposed, which consists of a traditional PID controller, a decoupling compensator and a feedforward compensator for the unmodeled dynamics. The parameters of such controller is selected based on the generalized minimum variance control law. The unmodeled dynamics is estimated and compensated by neural networks, a switching mechanism is introduced to improve tracking performance, then a nonlinear decoupling PID control algorithm is proposed. All signals in such switching system are globally bounded and the tracking error is convergent. Simulations show effectiveness of the algorithm.

Wavelet Neural Network Based on NARMA-L2 Model for Prediction of Thermal Characteristics in a Feed System

Research of thermal characteristics has been a key issue in the development of high-speed feed system. Most of the work carried out thus far is based on the principle of directly mapping the thermal error against the temperature of critical machine elements irrespective of the operating conditions. But recent researches show that different sets of operating parameters generated significantly different error values even though the temperature of the machine elements generated was similar. As such, it is important to develop a generic thermal error model which is capable of evaluating the positioning error induced by different operating parameters. This paper ultimately aims at the development of a comprehensive prediction model that can predict the thermal characteristics under different operating conditions （feeding speed, load and preload of ballscrew） in a feed system. A novel wavelet neural network based on feedback linearization autoregressive moving averaging （NARMA-L2） model is introduced to predict the temperature rise of sensitive points and thermal positioning errors considering the different operating conditions as the model inputs. Particle swarm optimization（PSO） algorithm is brought in as the training method. According to ISO230-2 Positioning Accuracy Measurement and ISO230-3 Thermal Effect Evaluation standards, experiments under different operating conditions were carried out on a self-made quasi high-speed feed system experimental bench HUST-FS-001 by using Pt100 as temperature sensor, and the positioning errors were measured by Heidenhain linear grating scale. The experiment results show that the recommended method can be used to predict temperature rise of sensitive points and thermal positioning errors with good accuracy. The work described in this paper lays a solid foundation of thermal error prediction and compensation in a feed system based on varying operating conditions and machine tool characteristics.

Anaerobic tapered fluidized bed reactor for starch wastewater treatment and modeling using multilayer perceptron neural network

treatability of synthetic sago wastewater was investigated in a laboratory anaerobic tapered fluidized bed reactor （ATFBR） with a mesoporous granular activated carbon （GAC） as a support material. The experimental protocol was defined to examine the effect of the maximum organic loading rate （OLR）, hydraulic retention time （HRT）, the efficiency of the reactor and to report on its steady- state performance. The reactor was subjected to a steady-state operation over a range of OLR up to 85.44 kg COD/（m^3·d）. The COD removal efficiency was found to be 92% in the reactor while the biogas produced in the digester reached 25.38 m^3/（m^3·d） of the reactor. With the increase of OLR from 83.7 kg COD/（m^3·d）, the COD removal efficiency decreased. Also an artificial neural network （ANN） model using multilayer perceptron （MLP） has been developed for a system of two input variable and five output dependent variables. For the training of the input-output data, the experimental values obtained have been used. The output parameters predicted have been found to be much closer to the corresponding experimental ones and the model was validated for 30% of the untrained data. The mean square error （MSE） was found to be only 0.0146.

Stand basal area modelling for Chinese fir plantations using an artificial neural network model

Artificial neural network models are a popular estimation tool for fitting nonlinear relationships because they require no assumptions about the form of the fitting function,non-Gaussian distributions,multicollinearity,outliers and noise in the data.The problems of backpropagation models using artificial neural networks include determination of the structure of the network and overlearning courses.According to data from 1981 to 2008 from 15 permanent sample plots on Dagangshan Mountain in Jiangxi Province,a back-propagation artificial neural network model(BPANN)and a support vector machine model(SVM)for basal area of Chinese fir(Cunninghamia lanceolata)plantations were constructed using four kinds of prediction factors,including stand age,site index,surviving stem numbers and quadratic mean diameters.Artificial intelligence methods,especially SVM,could be effective in describing stand basal area growth of Chinese fir under different growth conditions with higher simulation precision than traditional regression models.SVM and the Chapman–Richards nonlinear mixed-effects model had less systematic bias than the BPANN.

Research on runoff variations based on wavelet analysis and wavelet neural network model： A case study of the Heihe River drainage basin （1944-2005）

The Heihe River drainage basin is one of the endangered ecological regions of China. The shortage of water resources is the bottleneck, which constrains the sustainable development of the region. Many scholars in China have done researches concerning this problem. Based on previous researches, this paper analyzed characteristics, tendencies, and causes of annual runoff variations in the Yingluo Gorge （1944-2005） and the Zhengyi Gorge （1954-2005）, which are the boundaries of the upper reaches, the middle reaches, and the lower reaches of the Heihe River drainage basin, by wavelet analysis, wavelet neural network model, and GIS spatial analysis. The results show that： （1） annual runoff variations of the Yingluo Gorge have principal periods of 7 years and 25 years, and its increasing rate is 1.04 m^3/s.10y; （2） annual runoff variations of the Zhengyi Gorge have principal periods of 6 years and 27 years, and its decreasing rate is 2.25 m^3/s.10y; （3） prediction results show that： during 2006-2015, annual runoff variations of the Yingluo and Zhengyi gorges have ascending tendencies, and the increasing rates are respectively 2.04 m^3/s.10y and 1.61 m^3/s.10y; （4） the increase of annual runoff in the Yingluo Gorge has causal relationship with increased temperature and precipitation in the upper reaches, and the decrease of annual runoff in the Zhengyi Gorge in the past decades was mainly caused by the increased human consumption of water resources in the middle researches. The study results will provide scientific basis for making rational use and allocation schemes of water resources in the Heihe River drainage basin.

Application of Bayesian regularized BP neural network model for analysis of aquatic ecological data—A case study of chlorophyll-a prediction in Nanzui water area of Dongting Lake

Bayesian regularized BP neural network（BRBPNN） technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of the network were obtained. After the selection of input variables using stepwise/multiple linear regression method in SPSS i1.0 software, the BRBPNN model was established between chlorophyll-α and environmental parameters, biological parameters. The achieved optimal network structure was 3-11-1 with the correlation coefficients and the mean square errors for the training set and the test set as 0.999 and 0.000？8426, 0.981 and 0.0216 respectively. The sum of square weights between each input neuron and the hidden layer of optimal BRBPNN models of different structures indicated that the effect of individual input parameter on chlorophyll- α declined in the order of alga amount 〉 secchi disc depth（SD） 〉 electrical conductivity （EC）. Additionally, it also demonstrated that the contributions of these three factors were the maximal for the change of chlorophyll-α concentration, total phosphorus（TP） and total nitrogen（TN） were the minimal. All the results showed that BRBPNN model was capable of automated regularization parameter selection and thus it may ensure the excellent generation ability and robustness. Thus, this study laid the foundation for the application of BRBPNN model in the analysis of aquatic ecological data（chlorophyll-α prediction） and the explanation about the effective eutrophication treatment measures for Nanzui water area in Dongting Lake.

Dynamics Modeling and Robust Trajectory Tracking Control for a Class of Hybrid Humanoid Arm Based on Neural Network

In order to solve the problem of trajectory tracking for a class of novel serial-parallel hybrid humanoid arm（HHA）, which has parameters uncertainty, frictions, disturbance, abrasion and pulse forces derived from motors, a multistep dynamics modeling strategy is proposed and a robust controller based on neural network（NN）-adaptive algorithm is designed. At the first step of dynamics modeling, the dynamics model of the reduced HHA is established by Lagrange method. At the second step of dynamics modeling, the parameter uncertain part resulting mainly from the idealization of the HHA is learned by adaptive algorithm. In the trajectory tracking controller, the radial basis function（RBF） NN, whose optimal weights are learned online by adaptive algorithm, is used to learn the upper limit function of the total uncertainties including frictions, disturbances, abrasion and pulse forces. To a great extent, the conservatism of this robust trajectory tracking controller is reduced, and by this controller the HHA can impersonate mostly human actions. The proof and simulation results testify the validity of the adaptive strategy for parameter learning and the neural network-adaptive strategy for the trajectory tracking control.