Dimensionality Reduction with Input Training Neural Network and Its Application in Chemical Process Modelling

Many applications of principal component analysis (PCA) can be found in dimensionality reduction. But linear PCA method is not well suitable for nonlinear chemical processes. A new PCA method based on im-proved input training neural network (IT-NN) is proposed for the nonlinear system modelling in this paper. Mo-mentum factor and adaptive learning rate are introduced into learning algorithm to improve the training speed of IT-NN. Contrasting to the auto-associative neural network (ANN), IT-NN has less hidden layers and higher training speed. The effectiveness is illustrated through a comparison of IT-NN with linear PCA and ANN with experiments. Moreover, the IT-NN is combined with RBF neural network (RBF-NN) to model the yields of ethylene and propyl-ene in the naphtha pyrolysis system. From the illustrative example and practical application, IT-NN combined with RBF-NN is an effective method of nonlinear chemical process modelling.

Research on Network Training System Facing Enterprise Knowledge Management

The existing computer and network technology makes the enterprise training transform from the traditional mode into new mode. The paper studies how to combine enterprise knowledge management and network training to make the enterprise training meet the demands of knowledge management and improve the competitiveness of enterprises. And the paper puts forwards the new opinion combining enterprise knowledge management and network training system. The purpose of applying knowledge map and knowledge push to training system is to integrate knowledge management into training system to make the enterprises face the challenge of knowledge economy.

Method to generate training samples for neural network used in target recognition

Training neural network to recognize targets needs a lot of samples.People usually get these samples in a non-systematic way,which can miss or overemphasize some target information.To improve this situation,a new method based on virtual model and invariant moments was proposed to generate training samples.The method was composed of the following steps：use computer and simulation software to build target object＇s virtual model and then simulate the environment,light condition,camera parameter,etc.;rotate the model by spin and nutation of inclination to get the image sequence by virtual camera;preprocess each image and transfer them into binary image;calculate the invariant moments for each image and get a vectors＇ sequence.The vectors＇ sequence which was proved to be complete became the training samples together with the target outputs.The simulated results showed that the proposed method could be used to recognize the real targets and improve the accuracy of target recognition effectively when the sampling interval was short enough and the circumstance simulation was close enough.

Research on the Construction and Practice of College English Spoken Language Network Training Camp under the “Let’s talk” Model

Based on the"Understandable Output Hypothesis"a practical study on the construction of college oral English network training camp is set up,through speech learning and imitation,building language input in natural environment,exploring effective output mode based on information technology platform,providing foreign language learners with opportunities to express language and get feedback.Students use relevant resources on the Internet to complete the oral activities of"thematic activities"together,so as to cultivate students'cooperative learning,communication skills,team spirit and language communication ability.

Theory Analysis of the Handover Challenge in Express Train Access Networks （ETAN）

To handle the handover challenge in Express Train Access Networks(ETAN).mobility fading effects in high speed railway environments should be addressed first.Based on the investigation of fading effects in this paper,we obtain two theoretical bounds:HOTiming upper bound and HO-Margin lower bound,which are helpful guidelines to study the handover challenge today and in the future.Then,we apply them to analyze performance of conventional handover technologies and our proposal in ETAN.This follow-up theory analyses and simulation experiment results demonstrate that the proposed handover solution can minimize handover time up to 4ms(which is the fastest one so far),and reduce HO-Margin to 0.16 dB at a train speed of 350km/h.

A Novel Method for Solving Ordinary Differential Equations with Artificial Neural Networks

This research work investigates the use of Artificial Neural Network (ANN) based on models for solving first and second order linear constant coefficient ordinary differential equations with initial conditions. In particular, we employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but bypass the standard back-propagation algorithm for updating the intrinsic weights. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the initial or boundary conditions and contains no adjustable parameters. The second part involves a feed-forward neural network to be trained to satisfy the differential equation. Numerous works have appeared in recent times regarding the solution of differential equations using ANN, however majority of these employed a single hidden layer perceptron model, incorporating a back-propagation algorithm for weight updation. For the homogeneous case, we assume a solution in exponential form and compute a polynomial approximation using statistical regression. From here we pick the unknown coefficients as the weights from input layer to hidden layer of the associated neural network trial solution. To get the weights from hidden layer to the output layer, we form algebraic equations incorporating the default sign of the differential equations. We then apply the Gaussian Radial Basis function (GRBF) approximation model to achieve our objective. The weights obtained in this manner need not be adjusted. We proceed to develop a Neural Network algorithm using MathCAD software, which enables us to slightly adjust the intrinsic biases. We compare the convergence and the accuracy of our results with analytic solutions, as well as well-known numerical methods and obtain satisfactory results for our example ODE problems.

Solving Riccati-Type Nonlinear Differential Equations with Novel Artificial Neural Networks

In this study we investigate neural network solutions to nonlinear differential equations of Ricatti-type. We employ a feed-forward Multilayer Perceptron Neural Network (MLPNN), but avoid the standard back-propagation algorithm for updating the intrinsic weights. Our objective is to minimize an error, which is a function of the network parameters i.e., the weights and biases. Once the weights of the neural network are obtained by our systematic procedure, we need not adjust all the parameters in the network, as postulated by many researchers before us, in order to achieve convergence. We only need to fine-tune our biases which are fixed to lie in a certain given range, and convergence to a solution with an acceptable minimum error is achieved. This greatly reduces the computational complexity of the given problem. We provide two important ODE examples, the first is a Ricatti type differential equation to which the procedure is applied, and this gave us perfect agreement with the exact solution. The second example however provided us with only an acceptable approximation to the exact solution. Our novel artificial neural networks procedure has demonstrated quite clearly the function approximation capabilities of ANN in the solution of nonlinear differential equations of Ricatti type.

Optical tensor core architecture for neural network training based on dual-layer waveguide topology and homodyne detection

We propose an optical tensor core(OTC) architecture for neural network training. The key computational components of the OTC are the arrayed optical dot-product units(DPUs). The homodyne-detection-based DPUs can conduct the essential computational work of neural network training, i.e., matrix-matrix multiplication. Dual-layer waveguide topology is adopted to feed data into these DPUs with ultra-low insertion loss and cross talk. Therefore, the OTC architecture allows a large-scale dot-product array and can be integrated into a photonic chip. The feasibility of the OTC and its effectiveness on neural network training are verified with numerical simulations.

High-Speed EMU TCMS Design and LCC Technology Research

This paper introduces the high-speed electrical multiple unit （EMO） life cycle, including the design, manufacturing, testing, and maintenance stages. It also presents the train control and monitoring system （TCMS） software development platform, the TCMS testing and verification bench, the EMU driving simulation platform, and the EMU remote data transmittal and maintenance platform. All these platforms and benches combined together make up the EMU life cycle cost （LCC） system. Each platform facilitates EMU LCC management and is an important part of the system.

Contributing Factors for Delays during the Morning Commute Hours and the Impact of the Spread of COVID-19 for Metropolitan Train Lines in Japan

The present study aims to conduct 2 types of statistical analysis to reveal the impact of the spread of COVID-19 on train delays by comparing the potential contributing factors before, during and after the outbreak of the virus in the metropolitan train lines in Japan. First of all, the result of the present study clearly revealed the changes in contributing factors for train delays caused by the spread of COVID-19. Specifically, the contributing factors for train delays changed due to the decrease of passengers by the effect of the outbreak of the virus. Additionally, though large terminal stations were considered to be a major contributing factor in causing and increasing train delays in the past, this was not the case after the spread of COVID-19. Therefore, under such conditions, it is more effective to make improvements in small to medium stations and tracks rather than terminal stations. Furthermore, as the decrease in passengers also decreased train delays in commuter lines going to the suburbs due to the spread of COVID-19, the contributing factor for such lines is the excessive number of passengers. Therefore, as for countermeasures for train delays after the effects of COVID-19, it is necessary to disperse passengers in order to avoid passengers concentrating in the same time zones and train lines.

Domain adversarial training for classification of cracking in images of concrete surfaces

The development of automatic methods to recognize cracks in surfaces of concrete has been under focus in recent years,firstly through computer vision methods and more recently focusing on convolutional neural networks that are delivering promising results.Challenges are still persisting in crack recognition,namely due to the confusion added by the myriad of elements commonly found on concrete surfaces.The robustness of these methods would deal with these elements if access to correspondingly heterogeneous datasets was possible.Even so,this would be a cumbersome methodology,since training would be needed for each particular case and models would be case dependent.Thus,efforts from the scientific community are focusing on generalizing neural network models to achieve high per-formance in images from different domains,slightly different from those in which they were effectively trained.The generalization of networks can be achieved by domain adaptation techniques at the training stage.Domain adapta-tion enables finding a feature space in which features from both domains are invariant,and thus,classes become separable.The work presented here proposes the DA-Crack method,which is a domain adversarial training method,to generalize a neural network for recognizing cracks in images of concrete surfaces.The domain adversarial method uses a convolutional extractor followed by a classifier and a discriminator,and relies on two datasets:a source labeled dataset and a target unlabeled small dataset.The classifier is responsible for the classification of images randomly chosen,while the discriminator is dedicated to uncovering to which dataset each image belongs.Backpropagation from the discriminator reverses the gradient used to update the extractor.This enables fighting the convergence promoted by the updating backpropagated from the classifier,and thus generalizing the extractor enabling it for crack recognition of images from both source and target datasets.Results show that the DA-Crack training method improved accuracy in crack classification of images from the target dataset in 54 percentage points,while accuracy on the source dataset remains unaffected.

How Deep Learning Networks could be Designed to Locate Mineral Deposits

Whether using a shallow neural network with one hidden layer,or a deep network with many hidden layers,the training data must represent subgroups of the deposit type being explored to be useful.Published examples of neural networks have mostly been limited to one individual mineral deposit for training.Variation of geologic features among deposits within a type are so large that a single deposit cannot provide proper information to train a neural net to generalize and guide exploration for other deposits.Models trained with only one deposit tend to be academic successes but are not of practical value in exploration for other deposits.This is why it takes much experience examining many deposits to properly train an economic geologist—a neural network is not any different.Two examples of shallow neural networks are used to demonstrate the power of neural networks to possibly locate undiscovered deposits and to provide some suggestions of how to deal with missing data.The training data needs to include information spatially related to known deposits and hopefully information from many different deposits of the type.Lessons learned from these and other examples point to a proposed sampling plan for data that could lead to a generalized neural network for exploration.In this plan,10 or more well-explored gold-rich porphyry copper deposits from around the world with 100 or more sample sites near and some distance from each deposit would probably capture important variability among such deposits and provide proper data to train and test a shallow neural network to predict locations of undiscovered deposits.

Bottom hole pressure estimation using hybridization neural networks and grey wolves optimization

An effective design and optimum production strategies of a well depend on the accurate prediction of its bottom hole pressure(BHP)which may be calculated or determined by several methods.However,it is not practical technically or economically to apply for a well test or to deploy a permanent pressure gauge in the bottom hole to predict the BHP.Consequently,several correlations and mechanistic models based on the knownsurfacemeasurementshave beendeveloped.Unfortunately,all these tools(correlations&mechanistic models)are limited to some conditions and intervals of application.Therefore,establish a global model that ensures a large coverage of conditions with a reduced cost and high accuracy becomes a necessity.In this study,we propose new models for estimating bottom hole pressure of vertical wells with multiphase flow.First,Artificial Neural Network(ANN)based on back propagation training(BP-ANN)with 12 neurons in its hidden layer is established using trial and error.The next methods correspond to optimized or evolved neural networks(optimize the weights and thresholds of the neural networks)with Grey Wolves Optimization(GWO),and then its accuracy to reach the global optima is compared with 2 other naturally inspired algorithms which are the most used in the optimization field:Genetic Algorithm(GA)and Particle Swarms Optimization(PSO).The models were developed and tested using 100 field data collected from Algerian fields and covering a wide range of variables.The obtained results demonstrate the superiority of the hybridization ANN-GWO compared with the 2 other hybridizations or with the BP learning alone.Furthermore,the evolved neural networks with these global optimization algorithms are strongly shown to be highly effective to improve the performance of the neural networks to estimate flowing BHP over existing approaches and correlations.

Computer-aided diabetic retinopathy diagnostic model using optimal thresholding merged with neural network

Purpose-Diabetic retinopathy(DR)is a central root of blindness all over the world.Though DR is tough to diagnose in starting stages,and the detection procedure might be time-consuming even for qualified experts.Nowadays,intelligent disease detection techniques are extremely acceptable for progress analysis and recognition of various diseases.Therefore,a computer-aided diagnosis scheme based on intelligent learning approaches is intended to propose for diagnosing DR effectively using a benchmark dataset.Design/methodology/approach-The proposed DR diagnostic procedure involves four main steps:(1)image pre-processing,(2)blood vessel segmentation,(3)feature extraction,and(4)classification.Initially,the retinal fundus image is taken for pre-processing with the help of Contrast Limited Adaptive Histogram Equalization(CLAHE)and average filter.In the next step,the blood vessel segmentation is carried out using a segmentation process with optimized gray-level thresholding.Once the blood vessels are extracted,feature extraction is done,using Local Binary Pattern(LBP),Texture Energy Measurement(TEM based on Laws of Texture Energy),and two entropy computations-Shanon’s entropy,and Kapur’s entropy.These collected features are subjected to a classifier called Neural Network(NN)with an optimized training algorithm.Both the gray-level thresholding and NN is enhanced by the Modified Levy Updated-Dragonfly Algorithm(MLU-DA),which operates to maximize the segmentation accuracy and to reduce the error difference between the predicted and actual outcomes of the NN.Finally,this classification error can correctly prove the efficiency of the proposed DR detection model.Findings-The overall accuracy of the proposed MLU-DA was 16.6%superior to conventional classifiers,and the precision of the developed MLU-DA was 22%better than LM-NN,16.6%better than PSO-NN,GWO-NN,and DA-NN.Finally,it is concluded that the implemented MLU-DA outperformed state-of-the-art algorithms in detecting DR.Originality/value-This paper adopts the latest optimization algorithm called MLU-DA-Neural Network with optimal gray-level thresholding for detecting diabetic retinopathy disease.This is the first work utilizes MLU-DA-based Neural Network for computer-aided Diabetic Retinopathy diagnosis.

Probabilistic Modeling and Optimization of Real-Time Protocol for Multifunction Vehicle Bus

In this paper, we present the modeling and optimization of a Real-Time Protocol（RTP） used in Train Communication Networks（TCN）. In the proposed RTP, message arbitration is represented by a probabilistic model and the number of arbitration checks is minimized by using the probability of device activity. Our optimized protocol is fully compatible with the original standard and can thus be implemented easily. The experimental results demonstrate that the proposed algorithm can reduce the number of checks by about 50%, thus significantly enhancing bandwidth.