Application of Self-Organizing Feature Map Neural Network Based on K-means Clustering in Network Intrusion Detection

Due to the widespread use of the Internet,customer information is vulnerable to computer systems attack,which brings urgent need for the intrusion detection technology.Recently,network intrusion detection has been one of the most important technologies in network security detection.The accuracy of network intrusion detection has reached higher accuracy so far.However,these methods have very low efficiency in network intrusion detection,even the most popular SOM neural network method.In this paper,an efficient and fast network intrusion detection method was proposed.Firstly,the fundamental of the two different methods are introduced respectively.Then,the selforganizing feature map neural network based on K-means clustering(KSOM)algorithms was presented to improve the efficiency of network intrusion detection.Finally,the NSLKDD is used as network intrusion data set to demonstrate that the KSOM method can significantly reduce the number of clustering iteration than SOM method without substantially affecting the clustering results and the accuracy is much higher than Kmeans method.The Experimental results show that our method can relatively improve the accuracy of network intrusion and significantly reduce the number of clustering iteration.

Waterlogging risk assessment based on self-organizing map(SOM)artificial neural networks:a case study of an urban storm in Beijing

Due to rapid urbanization, waterlogging induced by torrential rainfall has become a global concern and a potential risk affecting urban habitant's safety. Widespread waterlogging disasters haveoccurred almost annuallyinthe urban area of Beijing, the capital of China. Based on a selforganizing map(SOM) artificial neural network(ANN), a graded waterlogging risk assessment was conducted on 56 low-lying points in Beijing, China. Social risk factors, such as Gross domestic product(GDP), population density, and traffic congestion, were utilized as input datasets in this study. The results indicate that SOM-ANNis suitable for automatically and quantitatively assessing risks associated with waterlogging. The greatest advantage of SOM-ANN in the assessment of waterlogging risk is that a priori knowledge about classification categories and assessment indicator weights is not needed. As a result, SOM-ANN can effectively overcome interference from subjective factors,producing classification results that are more objective and accurate. In this paper, the risk level of waterlogging in Beijing was divided into five grades. The points that were assigned risk grades of IV or Vwere located mainly in the districts of Chaoyang, Haidian, Xicheng, and Dongcheng.

Enhanced Self-Organizing Map Neural Network for DNA Sequence Classification

The artificial neural networks (ANNs), among different soft computing methodologies are widely used to meet the challenges thrown by the main objectives of data mining classification techniques, due to their robust, powerful, distributed, fault tolerant computing and capability to learn in a data-rich environment. ANNs has been used in several fields, showing high performance as classifiers. The problem of dealing with non numerical data is one major obstacle prevents using them with various data sets and several domains. Another problem is their complex structure and how hands to interprets. Self-Organizing Map (SOM) is type of neural systems that can be easily interpreted, but still can’t be used with non numerical data directly. This paper presents an enhanced SOM structure to cope with non numerical data. It used DNA sequences as the training dataset. Results show very good performance compared to other classifiers. For better evaluation both micro-array structure and their sequential representation as proteins were targeted as dataset accuracy is measured accordingly.

3D Ice Shape Description Method Based on BLSOM Neural Network

When checking the ice shape calculation software,its accuracy is judged based on the proximity between the calculated ice shape and the typical test ice shape.Therefore,determining the typical test ice shape becomes the key task of the icing wind tunnel tests.In the icing wind tunnel test of the tail wing model of a large amphibious aircraft,in order to obtain accurate typical test ice shape,the Romer Absolute Scanner is used to obtain the 3D point cloud data of the ice shape on the tail wing model.Then,the batch-learning self-organizing map(BLSOM)neural network is used to obtain the 2D average ice shape along the model direction based on the 3D point cloud data of the ice shape,while its tolerance band is calculated using the probabilistic statistical method.The results show that the combination of 2D average ice shape and its tolerance band can represent the 3D characteristics of the test ice shape effectively,which can be used as the typical test ice shape for comparative analysis with the calculated ice shape.

English-Chinese Neural Machine Translation Based on Self-organizing Mapping Neural Network and Deep Feature Matching

The traditional Chinese-English translation model tends to translate some source words repeatedly,while mistakenly ignoring some words.Therefore,we propose a novel English-Chinese neural machine translation based on self-organizing mapping neural network and deep feature matching.In this model,word vector,two-way LSTM,2D neural network and other deep learning models are used to extract the semantic matching features of question-answer pairs.Self-organizing mapping(SOM)is used to classify and identify the sentence feature.The attention mechanism-based neural machine translation model is taken as the baseline system.The experimental results show that this framework significantly improves the adequacy of English-Chinese machine translation and achieves better results than the traditional attention mechanism-based English-Chinese machine translation model.

An Emotion Analysis Method Using Multi-Channel Convolution Neural Network in Social Networks

As an interdisciplinary comprehensive subject involving multidisciplinary knowledge,emotional analysis has become a hot topic in psychology,health medicine and computer science.It has a high comprehensive and practical application value.Emotion research based on the social network is a relatively new topic in the field of psychology and medical health research.The text emotion analysis of college students also has an important research significance for the emotional state of students at a certain time or a certain period,so as to understand their normal state,abnormal state and the reason of state change from the information they wrote.In view of the fact that convolutional neural network cannot make full use of the unique emotional information in sentences,and the need to label a large number of highquality training sets for emotional analysis to improve the accuracy of the model,an emotional analysismodel using the emotional dictionary andmultichannel convolutional neural network is proposed in this paper.Firstly,the input matrix of emotion dictionary is constructed according to the emotion information,and the different feature information of sentences is combined to form different network input channels,so that the model can learn the emotion information of input sentences from various feature representations in the training process.Then,the loss function is reconstructed to realize the semi supervised learning of the network.Finally,experiments are carried on COAE 2014 and self-built data sets.The proposed model can not only extract more semantic information in emotional text,but also learn the hidden emotional information in emotional text.The experimental results show that the proposed emotion analysis model can achieve a better classification performance.Compared with the best benchmark model gram-CNN,the F1 value can be increased by 0.026 in the self-built data set,and it can be increased by 0.032 in the COAE 2014 data set.

Application of SOM neural network in clustering

The Self-Organizing Map (SOM) is an unsupervised neural network algorithm that projects high-dimensional data onto a two-dimensional map. The projection preserves the topology of the data so that similar data items will be mapped to nearby locations on the map. One of the SOM neural network’s applications is clustering of animals due their features. In this paper we produce an experiment to analyze the SOM in clustering different species of animals.

Comparison of Electric Load Forecasting between Using SOM and MLP Neural Network

Electric load forecasting has been a major area of research in the last decade since the production of accurate short-term forecasts for electricity loads has proven to be a key to success for many of the decision makers in the energy sector, from power generation to operation of the system. The objective of this research is to analyze the capacity of the MLP （multilayer perceptron neural network） versus SOM （self-organizing map neural network） for short-term load forecasting. The MLP is one of the most commonly used networks. It can be used for classification problems, model construction, series forecasting and discrete control. On the other hand, the SOM is a type of artificial neural network that is trained using unsupervised data to produce a low-dimensional, discretized representation of an input space of training samples in a cell map. Historical data of real global load demand were used for the research. Both neural models provide good prediction results, but the results obtained with the SOM maps are markedly better Also the main advantage of SOM maps is that they reach good results as a network unsupervised. It is much easier to train and interpret the results.

Study of TSP based on self-organizing map

Self-organizing map(SOM) proposed by Kohonen has obtained certain achievements in solving the traveling salesman problem(TSP).To improve Kohonen SOM,an effective initialization and parameter modification method is discussed to obtain a faster convergence rate and better solution.Therefore,a new improved self-organizing map(ISOM)algorithm is introduced and applied to four traveling salesman problem instances for experimental simulation,and then the result of ISOM is compared with those of four SOM algorithms:AVL,KL,KG and MSTSP.Using ISOM,the average error of four travelingsalesman problem instances is only 2.895 0%,which is greatly better than the other four algorithms:8.51%(AVL),6.147 5%(KL),6.555%(KG) and 3.420 9%(MSTSP).Finally,ISOM is applied to two practical problems:the Chinese 100 cities-TSP and102 counties-TSP in Shanxi Province,and the two optimal touring routes are provided to the tourists.

Fast and Accurate Machine Learning Inverse Lithography Using Physics Based Feature Maps and Specially Designed DCNN

Inverse lithography technology(ILT)is intended to achieve optimal mask design to print a lithography target for a given lithography process.Full chip implementation of rigorous inverse lithography remains a challenging task because of enormous computational resource requirements and long computational time.To achieve full chip ILT solution,attempts have been made by using machine learning techniques based on deep convolution neural network(DCNN).The reported input for such DCNN is the rasterized images of the lithography target;such pure geometrical input requires DCNN to possess considerable number of layers to learn the optical properties of the mask,the nonlinear imaging process,and the rigorous ILT algorithm as well.To alleviate the difficulties,we have proposed the physics based optimal feature vector design for machine learning ILT in our early report.Although physics based feature vector followed by feedforward neural network can provide the solution to machine learning ILT,the feature vector is long and it can consume considerable amount of memory resource in practical implementation.To improve the resource efficiency,we proposed a hybrid approach in this study by combining first few physics based feature maps with a specially designed DCNN structure to learn the rigorous ILT algorithm.Our results show that this approach can make machine learning ILT easy,fast and more accurate.

Self-organizing feature map neural network classification of the ASTER data based on wavelet fusion

Most methods for classification of remote sensing data are based on the statistical parameter evaluation with the assumption that the samples obey the normal distribution. How-ever, more accurate classification results can be obtained with the neural network method through getting knowledge from environments and adjusting the parameter (or weight) step by step by a specific measurement. This paper focuses on the double-layer structured Kohonen self-organizing feature map (SOFM), for which all neurons within the two layers are linked one another and those of the competition layers are linked as well along the sides. Therefore, the self-adapting learning ability is improved due to the effective competition and suppression in this method. The SOFM has become a hot topic in the research area of remote sensing data classi-fication. The Advanced Spaceborne Thermal Emission and Reflectance Radiometer (ASTER) is a new satellite-borne remote sensing instrument with three 15-m resolution bands and three 30-m resolution bands at the near infrared. The ASTER data of Dagang district, Tianjin Munici-pality is used as the test data in this study. At first, the wavelet fusion is carried out to make the spatial resolutions of the ASTER data identical; then, the SOFM method is applied to classifying the land cover types. The classification results are compared with those of the maximum likeli-hood method (MLH). As a consequence, the classification accuracy of SOFM increases about by 7% in general and, in particular, it is almost as twice as that of the MLH method in the town.

Morphological self-organizing feature map neural network with applications to automatic target recognition

The rotation invariant feature of the target is obtained using the multi-direction feature extraction property of the steerable filter. Combining the morphological operation top-hat transform with the self-organizing feature map neural network, the adaptive topological region is selected. Using the erosion operation, the topological region shrinkage is achieved. The steerable filter based morphological self-organizing feature map neural network is applied to automatic target recognition of binary standard patterns and real world infrared sequence images. Compared with Hamming network and morphological shared-weight networks respectively, the higher recognition correct rate, robust adaptability, quick training, and better generalization of the proposed method are achieved.

A NOVEL INTRUSION DETECTION MODE BASED ON UNDERSTANDABLE NEURAL NETWORK TREES

Several data mining techniques such as Hidden Markov Model (HMM), artificial neural network, statistical techniques and expert systems are used to model network packets in the field of intrusion detection. In this paper a novel intrusion detection mode based on understandable Neural Network Tree (NNTree) is pre-sented. NNTree is a modular neural network with the overall structure being a Decision Tree (DT), and each non-terminal node being an Expert Neural Network (ENN). One crucial advantage of using NNTrees is that they keep the non-symbolic model ENN’s capability of learning in changing environments. Another potential advantage of using NNTrees is that they are actually “gray boxes” as they can be interpreted easily if the num-ber of inputs for each ENN is limited. We showed through experiments that the trained NNTree achieved a simple ENN at each non-terminal node as well as a satisfying recognition rate of the network packets dataset. We also compared the performance with that of a three-layer backpropagation neural network. Experimental results indicated that the NNTree based intrusion detection model achieved better performance than the neural network based intrusion detection model.

基于mRMR-SOM的异步电机轴承故障诊断研究

针对异步电机轴承故障诊断问题,提出了一种融合最大相关最小冗余特征选择算法(mRMR)和自组织映射神经网络(SOM)的故障诊断方法,并将其应用于轴承故障诊断的不同阶段。首先,在实验室环境下搭建了异步电机故障诊断试验平台,在不同电机状态下分别采集振动、电流和电压信号,利用统计学方法获取了高维混合特征集;然后,以互信息为背景,利用mRMR根据特征与状态标签间的相关性和特征间的冗余性,筛选了具备强区分能力的特征,以避免计算冗余和后验诊断性能下降;最后,采用SOM对异步电机健康和轴承故障状态进行了分类识别,验证了SOM对异步电机轴承故障诊断的有效性,以及mRMR对故障诊断结果的影响。研究结果表明:基于mRMR-SOM的异步电机轴承故障诊断方法能够准确地区分健康和故障状态,测试集分类准确率达到89%;使用mRMR特征筛选能够将154维特征降低至17维,缩短23.5%的网络收敛时间,并将分类准确率由89%提升至98%;试验结果验证了基于mRMR-SOM的异步电机轴承故障诊断方法对于异步电机轴承故障诊断问题的有效性,且证实其具备良好的诊断效果。

Algorithm for Solving Traveling Salesman Problem Based on Self-Organizing Mapping Network

Traveling salesman problem(TSP)is a classic non-deterministic polynomial-hard optimization prob-lem.Based on the characteristics of self-organizing mapping(SOM)network,this paper proposes an improved SOM network from the perspectives of network update strategy,initialization method,and parameter selection.This paper compares the performance of the proposed algorithms with the performance of existing SOM network algorithms on the TSP and compares them with several heuristic algorithms.Simulations show that compared with existing SOM networks,the improved SOM network proposed in this paper improves the convergence rate and algorithm accuracy.Compared with iterated local search and heuristic algorithms,the improved SOM net-work algorithms proposed in this paper have the advantage of fast calculation speed on medium-scale TSP.

基于SOM-FDA利用XRF对药品铝塑包装片的分类

建立了一种对药品铝塑包装片进行快速分类的方法。利用能量色散型X射线荧光光谱(XRF)仪,对47种不同的药品铝塑包装片样品进行了检验,结合自组织映射(self organizing map,SOM)神经网络聚类,通过最大相关性最小冗余(maximum relevance minimum redundancy,MRMR)算法对元素重要性进行排序,并利用最近邻(K-nearest neighbor,KNN)分类器处理样品数据。依据样品中所含元素的种类及质量分数的不同,对药品铝塑包装片进行区分。SOM神经网络聚类的结果为9类,KNN分类器的准确率为97.87%。X射线荧光光谱法操作简便快速、无损检材、灵敏度高。建立的分类模型科学准确,可为公安机关大规模筛选、确定侦查方向、缩短侦查时间提供帮助。

融合SOM神经网络与K-means聚类算法的用户信用画像研究

为提高现阶段基于K-Means聚类算法的用户信用画像模型的准确性和实时性,提出一种融合自组织映射(SOM,Self-Organizing Map)神经网络与K-Means聚类算法的改进方法。通过SOM对用户数据进行降维和特征提取,直接获得最优聚类数目后再用K-Means算法进行聚类分析。通过真实在线借贷平台数据对所提方法进行验证,结果表明,该方法可提升用户信用画像分析的质量,更好地满足金融数据分析中对实时管理和风险控制的要求,为金融机构提供精准的决策支持。

SELF-ORGANIZING MAP OF COMPLEX NETWORKS FOR COMMUNITY DETECTION

Detecting communities from complex networks is an important issue and has attracted attention of researchers in many fields. It is relevant to social tasks, biological inquiries, and technological problems since various networks exist in these systems. This paper proposes a new self-organizing map （SOM） based approach to community detection. By adopting a new operation and a new weightupdating scheme, a complex network can be organized into dense subgraphs according to the topological connection of each node by the SOM algorithm. Extensive numerical experiments show that the performance of the SOM algorithm is good. It can identify communities more accurately than existing methods. This method can be used to detect communities not only in undirected networks, but also in directed networks and bipartite networks.

Application of self-organizing neural networks to classification of plant communities in Pangquangou Nature Reserve, North China

Vegetation classification is an important topic in plant ecology and many quantitative techniques for classification have been developed in the field.The artificial neural network is a comparatively new tool for data analysis.The self-organizing feature map(SOFM)is powerful tool for clustering analysis.SOFM has been applied to many research fields and it was applied to the classification of plant communities in the Pangquangou Nature Reserve in the present work.Pangquangou Nature Reserve,located at 37°20′–38°20′ N,110°18′–111°18′ E,is a part of the Luliang Mountain range.Eighty-nine samples(quadrats)of 10 m×10 m for forest,4 m×4 m for shrubland and 1 m×1 m for grassland along an elevation gradient,were set up and species data was recorded in each sample.After discussion of the mathematical algorism,clustering technique and the procedure of SOFM,the classification was carried out by using NNTool box in MATLAB(6.5).As a result,the 89 samples were clustered into 13 groups representing 13 types of plant communities.The characteristics of each community were described.The result of SOFM classification was identical to the result of fuzzy c-mean clustering and consistent with the distribution patterns of vegetation in the study area and shows significant ecological meanings.This suggests that SOFM may clearly describe the ecological relationships between plant communities and it is a very effective quantitative technique in plant ecology research.

基于改进的SOM神经网络在水质评价分析中的应用

随着人们对水资源环境的日益重视,各种水质评价方法层出不穷。传统的水质评价方法多采用精确的数学模型进行描述,无法很好的反映水环境中存在的复杂非线性关系,从而影响整体评价结果。因此,本文提出采用一种改进的自组织特征映射神经网络(SOM)方法来进行水质评价,利用SOM神经网络能在无监督、无先验知识的状态下对样本进行自组织、自学习,实现对样本的评价与分类这一特点。通过引入主成分分析,解决SOM神经网络处理高维和相关性强的指标时出现的问题,提高网络收敛速度和聚类准确性。仿真结果表明:改进后的SOM神经网络能够直观准确地评价水体质量,反映水质整体状况。