General Decay Synchronization of Competitive Fuzzy Neural Networks Involving Time Delays and Right-Hand Discontinuous Activation

This paper discusses the general decay synchronization problem for a class of fuzzy competitive neural networks with time-varying delays and discontinuous activation functions. Firstly, based on the concept of Filippov solutions for right-hand discontinuous systems, some sufficient conditions for general decay synchronization of the considered system are obtained via designing a nonlinear feedback controller and applying discontinuous differential equation theory, Lyapunov functional methods and some inequality techniques. Finally, one numerical example is given to verify the effectiveness of the proposed theoretical results. The general decay synchronization considered in this article can better estimate the convergence rate of the system, and the exponential synchronization and polynomial synchronization can be seen as its special cases.

Application of Self-Organizing Feature Map Neural Network Based on K-means Clustering in Network Intrusion Detection

Due to the widespread use of the Internet,customer information is vulnerable to computer systems attack,which brings urgent need for the intrusion detection technology.Recently,network intrusion detection has been one of the most important technologies in network security detection.The accuracy of network intrusion detection has reached higher accuracy so far.However,these methods have very low efficiency in network intrusion detection,even the most popular SOM neural network method.In this paper,an efficient and fast network intrusion detection method was proposed.Firstly,the fundamental of the two different methods are introduced respectively.Then,the selforganizing feature map neural network based on K-means clustering(KSOM)algorithms was presented to improve the efficiency of network intrusion detection.Finally,the NSLKDD is used as network intrusion data set to demonstrate that the KSOM method can significantly reduce the number of clustering iteration than SOM method without substantially affecting the clustering results and the accuracy is much higher than Kmeans method.The Experimental results show that our method can relatively improve the accuracy of network intrusion and significantly reduce the number of clustering iteration.

Modified imperialist competitive algorithm-based neural network to determine shear strength of concrete beams reinforced with FRP

Fiber reinforced polymers (FRPs), unlike steel, are corrosion-resistant and therefore are of interest;however, their use is hindered because their brittle shear is formulated in most specifications using limited data available at the time. We aimed to predict the shear strength of concrete beams reinforced with FRP bars and without stirrups by compiling a relatively large database of 198 previously published test results (available in appendix). To model shear strength, an artificial neural network was trained by an ensemble of Levenberg-Marquardt and imperialist competitive algorithms. The results suggested superior accuracy of model compared to equations available in specifications and literature.

Waterlogging risk assessment based on self-organizing map(SOM)artificial neural networks:a case study of an urban storm in Beijing

Due to rapid urbanization, waterlogging induced by torrential rainfall has become a global concern and a potential risk affecting urban habitant's safety. Widespread waterlogging disasters haveoccurred almost annuallyinthe urban area of Beijing, the capital of China. Based on a selforganizing map(SOM) artificial neural network(ANN), a graded waterlogging risk assessment was conducted on 56 low-lying points in Beijing, China. Social risk factors, such as Gross domestic product(GDP), population density, and traffic congestion, were utilized as input datasets in this study. The results indicate that SOM-ANNis suitable for automatically and quantitatively assessing risks associated with waterlogging. The greatest advantage of SOM-ANN in the assessment of waterlogging risk is that a priori knowledge about classification categories and assessment indicator weights is not needed. As a result, SOM-ANN can effectively overcome interference from subjective factors,producing classification results that are more objective and accurate. In this paper, the risk level of waterlogging in Beijing was divided into five grades. The points that were assigned risk grades of IV or Vwere located mainly in the districts of Chaoyang, Haidian, Xicheng, and Dongcheng.

New results on global exponential stability of competitive neural networks with different time scales and time-varying delays

This paper studies the global exponential stability of competitive neural networks with different time scales and time-varying delays. By using the method of the proper Lyapunov functions and inequality technique, some sufficient conditions are presented for global exponential stability of delay competitive neural networks with different time scales. These conditions obtained have important leading significance in the designs and applications of global exponential stability for competitive neural networks. Finally, an example with its simulation is provided to demonstrate the usefulness of the proposed criteria.

A SPEECH RECOGNITION METHOD USING COMPETITIVE AND SELECTIVE LEARNING NEURAL NETWORKS

On the basis of asymptotic theory of Gersho, the isodistortion principle of vector clustering was discussed and a kind of competitive and selective learning method (CSL) which may avoid local optimization and have excellent result in application to clusters of HMM model was also proposed. In combining the parallel, self organizational hierarchical neural networks (PSHNN) to reclassify the scores of every form output by HMM, the CSL speech recognition rate is obviously elevated.

Research of Dynamic Competitive Learning in Neural Networks

Introduce a method of generation of new units within a cluster and aalgorithm of generating new clusters. The model automatically builds up its dynamically growinginternal representation structure during the learning process. Comparing model with other typicalclassification algorithm such as the Kohonen's self-organizing map, the model realizes a multilevelclassification of the input pattern with an optional accuracy and gives a strong support possibilityfor the parallel computational main processor. The idea is suitable for the high-level storage ofcomplex datas structures for object recognition.

A Self-Organizing Memory Neural Network for Aerosol Concentration Prediction

Haze-fog,which is an atmospheric aerosol caused by natural or man-made factors,seriously affects the physical and mental health of human beings.PM2.5(a particulate matter whose diameter is smaller than or equal to 2.5 microns)is the chief culprit causing aerosol.To forecast the condition of PM2.5,this paper adopts the related the meteorological data and air pollutes data to predict the concentration of PM2.5.Since the meteorological data and air pollutes data are typical time series data,it is reasonable to adopt a machine learning method called Single Hidden-Layer Long Short-Term Memory Neural Network(SSHL-LSTMNN)containing memory capability to implement the prediction.However,the number of neurons in the hidden layer is difficult to decide unless manual testing is operated.In order to decide the best structure of the neural network and improve the accuracy of prediction,this paper employs a self-organizing algorithm,which uses Information Processing Capability(IPC)to adjust the number of the hidden neurons automatically during a learning phase.In a word,to predict PM2.5 concentration accurately,this paper proposes the SSHL-LSTMNN to predict PM2.5 concentration.In the experiment,not only the hourly precise prediction but also the daily longer-term prediction is taken into account.At last,the experimental results reflect that SSHL-LSTMNN performs the best.

An Interval-valued Fuzzy Competitive Neural Network

Because interval value is quite natural in clustering, an interval-valued fuzzy competitive neural network is proposed. Firstly, this paper proposes several definitions of distance relating to interval number. And then, it indicates the method of preprocessing input data, the structure of the network and the learning algorithm of the interval-valued fuzzy competitive neural network. This paper also analyses the principle of the learning algorithm. At last, an experiment is used to test the validity of the network.

Enhanced Self-Organizing Map Neural Network for DNA Sequence Classification

The artificial neural networks (ANNs), among different soft computing methodologies are widely used to meet the challenges thrown by the main objectives of data mining classification techniques, due to their robust, powerful, distributed, fault tolerant computing and capability to learn in a data-rich environment. ANNs has been used in several fields, showing high performance as classifiers. The problem of dealing with non numerical data is one major obstacle prevents using them with various data sets and several domains. Another problem is their complex structure and how hands to interprets. Self-Organizing Map (SOM) is type of neural systems that can be easily interpreted, but still can’t be used with non numerical data directly. This paper presents an enhanced SOM structure to cope with non numerical data. It used DNA sequences as the training dataset. Results show very good performance compared to other classifiers. For better evaluation both micro-array structure and their sequential representation as proteins were targeted as dataset accuracy is measured accordingly.

Research on the credit classification of practicing qualification personnel in construction market based on self-organizing neural network

Combining with the characters of the practicing qualification personnel in construction market,evaluation method based on the self-organizing neural network is brought out to analyze the credit classification of the practicing qualification personnel. And the impact factors on the credit classification of the practicing qualification personnel,such as the number of neurons,the training steps,the dimension of neurons and the field of winning neurons are studied. Then a self-organizing competitive neural network is built. At last,a case study is conducted by taking practicing qualification personnel as an example. The research result reveals that the method can efficiently evaluate the credit of the practicing qualification personnel;thus,it could provide scientific advice to the construction enterprise to prevent relevant discreditable behaviors of some practicing qualification personnel.

3D Ice Shape Description Method Based on BLSOM Neural Network

When checking the ice shape calculation software,its accuracy is judged based on the proximity between the calculated ice shape and the typical test ice shape.Therefore,determining the typical test ice shape becomes the key task of the icing wind tunnel tests.In the icing wind tunnel test of the tail wing model of a large amphibious aircraft,in order to obtain accurate typical test ice shape,the Romer Absolute Scanner is used to obtain the 3D point cloud data of the ice shape on the tail wing model.Then,the batch-learning self-organizing map(BLSOM)neural network is used to obtain the 2D average ice shape along the model direction based on the 3D point cloud data of the ice shape,while its tolerance band is calculated using the probabilistic statistical method.The results show that the combination of 2D average ice shape and its tolerance band can represent the 3D characteristics of the test ice shape effectively,which can be used as the typical test ice shape for comparative analysis with the calculated ice shape.

Optimization of a crude distillation unit using a combination of wavelet neural network and line-up competition algorithm

The modeling and optimization of an industrial-scale crude distillation unit （CDU） are addressed. The main spec- ifications and base conditions of CDU are taken from a crude oil refinery in Wuhan, China. For modeling of a com- plicated CDU, an improved wavelet neural network （WNN） is presented to model the complicated CDU, in which novel parametric updating laws are developed to precisely capture the characteristics of CDU. To address CDU in an economically optimal manner, an economic optimization algorithm under prescribed constraints is presented. By using a combination of WNN-based optimization model and line-up competition algorithm （LCA）, the supe- rior performance of the proposed approach is verified. Compared with the base operating condition, it is validat- ed that the increments of products including kerosene and diesel are up to 20% at least by increasing less than 5% duties of intermediate coolers such as second pump-around （PA2） and third Dump-around （PA3）.

PARALLEL SELF-ORGANIZING MAP

１ＩＮＴＲＯＤＵＣＴＩＯＮ“Ｏｎｃｅｓａｗ，ｎｅｖｅｒｆｏｒｇｏｔｅｎ”ｉｓａｓｅｎｔｅｎｃｅｗｈｉｃｈｕｓｅｄｔｏｄｅｓｃｒｉｂｅａｈｕｍａｎｓｅｎｓｅａｎｄｌｅａｒｎｉｎｇｓｅｑｕｅｎｃｅ．Ｆｏｒｅｘａｍｐｌｅ，ａｂｏｙｇｌａｎｃｅｄａｔａｌｏ...

Modeling and optimum operating conditions for FCCU using artificial neural network

A self-organizing radial basis function(RBF) neural network(SODM-RBFNN) was presented for predicting the production yields and operating optimization. Gradient descent algorithm was used to optimize the widths of RBF neural network with the initial parameters obtained by k-means learning method. During the iteration procedure of the algorithm, the centers of the neural network were optimized by using the gradient method with these optimized width values. The computational efficiency was maintained by using the multi-threading technique. SODM-RBFNN consists of two RBF neural network models: one is a running model used to predict the product yields of fluid catalytic cracking unit(FCCU) and optimize its operating parameters; the other is a learning model applied to construct or correct a RBF neural network. The running model can be updated by the learning model according to an accuracy criterion. The simulation results of a five-lump kinetic model exhibit its accuracy and generalization capabilities, and practical application in FCCU illustrates its effectiveness.

A NOVEL INTRUSION DETECTION MODE BASED ON UNDERSTANDABLE NEURAL NETWORK TREES

Several data mining techniques such as Hidden Markov Model (HMM), artificial neural network, statistical techniques and expert systems are used to model network packets in the field of intrusion detection. In this paper a novel intrusion detection mode based on understandable Neural Network Tree (NNTree) is pre-sented. NNTree is a modular neural network with the overall structure being a Decision Tree (DT), and each non-terminal node being an Expert Neural Network (ENN). One crucial advantage of using NNTrees is that they keep the non-symbolic model ENN’s capability of learning in changing environments. Another potential advantage of using NNTrees is that they are actually “gray boxes” as they can be interpreted easily if the num-ber of inputs for each ENN is limited. We showed through experiments that the trained NNTree achieved a simple ENN at each non-terminal node as well as a satisfying recognition rate of the network packets dataset. We also compared the performance with that of a three-layer backpropagation neural network. Experimental results indicated that the NNTree based intrusion detection model achieved better performance than the neural network based intrusion detection model.

Comparison of Electric Load Forecasting between Using SOM and MLP Neural Network

Electric load forecasting has been a major area of research in the last decade since the production of accurate short-term forecasts for electricity loads has proven to be a key to success for many of the decision makers in the energy sector, from power generation to operation of the system. The objective of this research is to analyze the capacity of the MLP （multilayer perceptron neural network） versus SOM （self-organizing map neural network） for short-term load forecasting. The MLP is one of the most commonly used networks. It can be used for classification problems, model construction, series forecasting and discrete control. On the other hand, the SOM is a type of artificial neural network that is trained using unsupervised data to produce a low-dimensional, discretized representation of an input space of training samples in a cell map. Historical data of real global load demand were used for the research. Both neural models provide good prediction results, but the results obtained with the SOM maps are markedly better Also the main advantage of SOM maps is that they reach good results as a network unsupervised. It is much easier to train and interpret the results.

A MULTILAYER FEEDFORWARD NEURAL NETWORK MODEL FOR VISUAL MOTION PERCEPTION

The local visual motion detection mechanism used in the visual systems of primatescan only sense the motion component oriented perpendicularly to the contrast gradient of thebrightness pattern.But the visual system of higher animals can adaptively determine the actualdirection of motion through a learning process.In this paper a multilayered feedforward neuralnetwork model for perception of visual motion is presented.This model employs W.Reichardt’selementary motion detectors array and T.Kohonen’s self-organizing feature map.We explored theself-organizing principles for perception of visual motion.The computer simulations show thatthis neural network is able to recognize the true direction of motion through an unsupervisedlearning process.In addition,the neurons with the same or similar motion direction selectivitytend to appear in“functional columns”which seem to be qualitatively similar to the corticalmotion columns observed by electrophysiological and cytohistochemical studies in certain higherareas such as MT.It proves that motion-detection by spatio-temporal coherences,mapping,co-operation,competition,and Hebb rule may be the basic principles for the self-organization ofvisual motion perception networks.

Fault Attribute Reduction of Oil Immersed Transformer Based on Improved Imperialist Competitive Algorithm

The original fault data of oil immersed transformer often contains a large number of unnecessary attributes,which greatly increases the elapsed time of the algorithm and reduces the classification accuracy,leading to the rise of the diagnosis error rate.Therefore,in order to obtain high quality oil immersed transformer fault attribute data sets,an improved imperialist competitive algorithm was proposed to optimize the rough set to discretize the original fault data set and the attribute reduction.The feasibility of the proposed algorithm was verified by experiments and compared with other intelligent algorithms.Results show that the algorithm was stable at the 27th iteration with a reduction rate of 56.25%and a reduction accuracy of 98%.By using BP neural network to classify the reduction results,the accuracy was 86.25%,and the overall effect was better than those of the original data and other algorithms.Hence,the proposed method is effective for fault attribute reduction of oil immersed transformer.

English-Chinese Neural Machine Translation Based on Self-organizing Mapping Neural Network and Deep Feature Matching

The traditional Chinese-English translation model tends to translate some source words repeatedly,while mistakenly ignoring some words.Therefore,we propose a novel English-Chinese neural machine translation based on self-organizing mapping neural network and deep feature matching.In this model,word vector,two-way LSTM,2D neural network and other deep learning models are used to extract the semantic matching features of question-answer pairs.Self-organizing mapping(SOM)is used to classify and identify the sentence feature.The attention mechanism-based neural machine translation model is taken as the baseline system.The experimental results show that this framework significantly improves the adequacy of English-Chinese machine translation and achieves better results than the traditional attention mechanism-based English-Chinese machine translation model.