Application of Self-Organizing Feature Map Neural Network Based on K-means Clustering in Network Intrusion Detection

Due to the widespread use of the Internet,customer information is vulnerable to computer systems attack,which brings urgent need for the intrusion detection technology.Recently,network intrusion detection has been one of the most important technologies in network security detection.The accuracy of network intrusion detection has reached higher accuracy so far.However,these methods have very low efficiency in network intrusion detection,even the most popular SOM neural network method.In this paper,an efficient and fast network intrusion detection method was proposed.Firstly,the fundamental of the two different methods are introduced respectively.Then,the selforganizing feature map neural network based on K-means clustering(KSOM)algorithms was presented to improve the efficiency of network intrusion detection.Finally,the NSLKDD is used as network intrusion data set to demonstrate that the KSOM method can significantly reduce the number of clustering iteration than SOM method without substantially affecting the clustering results and the accuracy is much higher than Kmeans method.The Experimental results show that our method can relatively improve the accuracy of network intrusion and significantly reduce the number of clustering iteration.

Self-organizing feature map neural network classification of the ASTER data based on wavelet fusion

Most methods for classification of remote sensing data are based on the statistical parameter evaluation with the assumption that the samples obey the normal distribution. How-ever, more accurate classification results can be obtained with the neural network method through getting knowledge from environments and adjusting the parameter (or weight) step by step by a specific measurement. This paper focuses on the double-layer structured Kohonen self-organizing feature map (SOFM), for which all neurons within the two layers are linked one another and those of the competition layers are linked as well along the sides. Therefore, the self-adapting learning ability is improved due to the effective competition and suppression in this method. The SOFM has become a hot topic in the research area of remote sensing data classi-fication. The Advanced Spaceborne Thermal Emission and Reflectance Radiometer (ASTER) is a new satellite-borne remote sensing instrument with three 15-m resolution bands and three 30-m resolution bands at the near infrared. The ASTER data of Dagang district, Tianjin Munici-pality is used as the test data in this study. At first, the wavelet fusion is carried out to make the spatial resolutions of the ASTER data identical; then, the SOFM method is applied to classifying the land cover types. The classification results are compared with those of the maximum likeli-hood method (MLH). As a consequence, the classification accuracy of SOFM increases about by 7% in general and, in particular, it is almost as twice as that of the MLH method in the town.

Morphological self-organizing feature map neural network with applications to automatic target recognition

The rotation invariant feature of the target is obtained using the multi-direction feature extraction property of the steerable filter. Combining the morphological operation top-hat transform with the self-organizing feature map neural network, the adaptive topological region is selected. Using the erosion operation, the topological region shrinkage is achieved. The steerable filter based morphological self-organizing feature map neural network is applied to automatic target recognition of binary standard patterns and real world infrared sequence images. Compared with Hamming network and morphological shared-weight networks respectively, the higher recognition correct rate, robust adaptability, quick training, and better generalization of the proposed method are achieved.

Waterlogging risk assessment based on self-organizing map(SOM)artificial neural networks:a case study of an urban storm in Beijing

Due to rapid urbanization, waterlogging induced by torrential rainfall has become a global concern and a potential risk affecting urban habitant's safety. Widespread waterlogging disasters haveoccurred almost annuallyinthe urban area of Beijing, the capital of China. Based on a selforganizing map(SOM) artificial neural network(ANN), a graded waterlogging risk assessment was conducted on 56 low-lying points in Beijing, China. Social risk factors, such as Gross domestic product(GDP), population density, and traffic congestion, were utilized as input datasets in this study. The results indicate that SOM-ANNis suitable for automatically and quantitatively assessing risks associated with waterlogging. The greatest advantage of SOM-ANN in the assessment of waterlogging risk is that a priori knowledge about classification categories and assessment indicator weights is not needed. As a result, SOM-ANN can effectively overcome interference from subjective factors,producing classification results that are more objective and accurate. In this paper, the risk level of waterlogging in Beijing was divided into five grades. The points that were assigned risk grades of IV or Vwere located mainly in the districts of Chaoyang, Haidian, Xicheng, and Dongcheng.

Enhanced Self-Organizing Map Neural Network for DNA Sequence Classification

The artificial neural networks (ANNs), among different soft computing methodologies are widely used to meet the challenges thrown by the main objectives of data mining classification techniques, due to their robust, powerful, distributed, fault tolerant computing and capability to learn in a data-rich environment. ANNs has been used in several fields, showing high performance as classifiers. The problem of dealing with non numerical data is one major obstacle prevents using them with various data sets and several domains. Another problem is their complex structure and how hands to interprets. Self-Organizing Map (SOM) is type of neural systems that can be easily interpreted, but still can’t be used with non numerical data directly. This paper presents an enhanced SOM structure to cope with non numerical data. It used DNA sequences as the training dataset. Results show very good performance compared to other classifiers. For better evaluation both micro-array structure and their sequential representation as proteins were targeted as dataset accuracy is measured accordingly.

Study of TSP based on self-organizing map

Self-organizing map(SOM) proposed by Kohonen has obtained certain achievements in solving the traveling salesman problem(TSP).To improve Kohonen SOM,an effective initialization and parameter modification method is discussed to obtain a faster convergence rate and better solution.Therefore,a new improved self-organizing map(ISOM)algorithm is introduced and applied to four traveling salesman problem instances for experimental simulation,and then the result of ISOM is compared with those of four SOM algorithms:AVL,KL,KG and MSTSP.Using ISOM,the average error of four travelingsalesman problem instances is only 2.895 0%,which is greatly better than the other four algorithms:8.51%(AVL),6.147 5%(KL),6.555%(KG) and 3.420 9%(MSTSP).Finally,ISOM is applied to two practical problems:the Chinese 100 cities-TSP and102 counties-TSP in Shanxi Province,and the two optimal touring routes are provided to the tourists.

Fast and Accurate Machine Learning Inverse Lithography Using Physics Based Feature Maps and Specially Designed DCNN

Inverse lithography technology(ILT)is intended to achieve optimal mask design to print a lithography target for a given lithography process.Full chip implementation of rigorous inverse lithography remains a challenging task because of enormous computational resource requirements and long computational time.To achieve full chip ILT solution,attempts have been made by using machine learning techniques based on deep convolution neural network(DCNN).The reported input for such DCNN is the rasterized images of the lithography target;such pure geometrical input requires DCNN to possess considerable number of layers to learn the optical properties of the mask,the nonlinear imaging process,and the rigorous ILT algorithm as well.To alleviate the difficulties,we have proposed the physics based optimal feature vector design for machine learning ILT in our early report.Although physics based feature vector followed by feedforward neural network can provide the solution to machine learning ILT,the feature vector is long and it can consume considerable amount of memory resource in practical implementation.To improve the resource efficiency,we proposed a hybrid approach in this study by combining first few physics based feature maps with a specially designed DCNN structure to learn the rigorous ILT algorithm.Our results show that this approach can make machine learning ILT easy,fast and more accurate.

An Emotion Analysis Method Using Multi-Channel Convolution Neural Network in Social Networks

As an interdisciplinary comprehensive subject involving multidisciplinary knowledge,emotional analysis has become a hot topic in psychology,health medicine and computer science.It has a high comprehensive and practical application value.Emotion research based on the social network is a relatively new topic in the field of psychology and medical health research.The text emotion analysis of college students also has an important research significance for the emotional state of students at a certain time or a certain period,so as to understand their normal state,abnormal state and the reason of state change from the information they wrote.In view of the fact that convolutional neural network cannot make full use of the unique emotional information in sentences,and the need to label a large number of highquality training sets for emotional analysis to improve the accuracy of the model,an emotional analysismodel using the emotional dictionary andmultichannel convolutional neural network is proposed in this paper.Firstly,the input matrix of emotion dictionary is constructed according to the emotion information,and the different feature information of sentences is combined to form different network input channels,so that the model can learn the emotion information of input sentences from various feature representations in the training process.Then,the loss function is reconstructed to realize the semi supervised learning of the network.Finally,experiments are carried on COAE 2014 and self-built data sets.The proposed model can not only extract more semantic information in emotional text,but also learn the hidden emotional information in emotional text.The experimental results show that the proposed emotion analysis model can achieve a better classification performance.Compared with the best benchmark model gram-CNN,the F1 value can be increased by 0.026 in the self-built data set,and it can be increased by 0.032 in the COAE 2014 data set.

基于mRMR-SOM的异步电机轴承故障诊断研究

针对异步电机轴承故障诊断问题,提出了一种融合最大相关最小冗余特征选择算法(mRMR)和自组织映射神经网络(SOM)的故障诊断方法,并将其应用于轴承故障诊断的不同阶段。首先,在实验室环境下搭建了异步电机故障诊断试验平台,在不同电机状态下分别采集振动、电流和电压信号,利用统计学方法获取了高维混合特征集;然后,以互信息为背景,利用mRMR根据特征与状态标签间的相关性和特征间的冗余性,筛选了具备强区分能力的特征,以避免计算冗余和后验诊断性能下降;最后,采用SOM对异步电机健康和轴承故障状态进行了分类识别,验证了SOM对异步电机轴承故障诊断的有效性,以及mRMR对故障诊断结果的影响。研究结果表明:基于mRMR-SOM的异步电机轴承故障诊断方法能够准确地区分健康和故障状态,测试集分类准确率达到89%;使用mRMR特征筛选能够将154维特征降低至17维,缩短23.5%的网络收敛时间,并将分类准确率由89%提升至98%;试验结果验证了基于mRMR-SOM的异步电机轴承故障诊断方法对于异步电机轴承故障诊断问题的有效性,且证实其具备良好的诊断效果。

Multiple input self-organizing-map ResNet model for optimization of petroleum refinery conversion units

This work introduces a deep-learning network,i.e.,multi-input self-organizing-map ResNet(MISR),for modeling refining units comprised of two reactors and a separation train.The model is comprised of self-organizing-map and the neural network parts.The self-organizing-map part maps the input data into multiple two-dimensional planes and sends them to the neural network part.In the neural network part,residual blocks enhance the convergence and accuracy,ensuring that the structure will not be overfitted easily.Development of the MISR model of hydrocracking unit also benefits from the utilization of prior knowledge of the importance of the input variables for predicting properties of the products.The results show that the proposed MISR structure predicts more accurately the product yields and properties than the previously introduced self-organizing-map convolutional neural network model,thus leading to more accurate optimization of the hydrocracker operation.Moreover,the MISR model has smoother error convergence than the previous model.Optimal operating conditions have been determined via multi-round-particle-swarm and differential evolution algorithms.Numerical experiments show that the MISR model is suitable for modeling nonlinear conversion units which are often encountered in refining and petrochemical plants.

量子自组织特征映射神经网络

自组织特征映射是典型的无监督神经网络算法。它运用竞争学习策略实现数据分类。然而当网络中神经元个数为多项式时,自组织特征映射算法训练容易受到计算力挑战。为了降低算法训练的时间复杂度,本文提出了一个量子经典混合的自组织特征映射神经网络算法,利用量子叠加性和量子纠缠性对经典算法进行加速。在神经网络训练过程中,算法利用量子相位估计和Grover搜索算法并行实现相似度计算和标签提取。理论分析表明,本文提出的量子算法相比于经典算法在数据维度上具有指数加速。

An improved de-interleaving algorithm of radar pulses based on SOFM with self-adaptive network topology

As a core part of the electronic warfare(EW) system,de-interleaving is used to separate interleaved radar signals. As interleaved radar pulses become more complex and denser, intelligent classification of radar signals has become very important. The self-organizing feature map(SOFM) is an excellent artificial neural network, which has huge advantages in intelligent classification of complex data. However, the de-interleaving process based on SOFM is faced with the problems that the initialization of the map size relies on prior information and the network topology cannot be adaptively adjusted. In this paper, an SOFM with self-adaptive network topology(SANT-SOFM) algorithm is proposed to solve the above problems. The SANT-SOFM algorithm first proposes an adaptive proliferation algorithm to adjust the map size, so that the initialization of the map size is no longer dependent on prior information but is gradually adjusted with the input data. Then,structural optimization algorithms are proposed to gradually optimize the topology of the SOFM network in the iterative process,constructing an optimal SANT. Finally, the optimized SOFM network is used for de-interleaving radar signals. Simulation results show that SANT-SOFM could get excellent performance in complex EW environments and the probability of getting the optimal map size is over 95% in the absence of priori information.

Pattern recognition of messily grown nanowire morphologies applying multi-layer connected self-organized feature maps

Multi-layer connected self-organizing feature maps(SOFMs) and the associated learning procedure were proposed to achieve efficient recognition and clustering of messily grown nanowire morphologies. The network is made up by several paratactic 2-D SOFMs with inter-layer connections. By means of Monte Carlo simulations, virtual morphologies were generated to be the training samples. With the unsupervised inner-layer and inter-layer learning, the neural network can cluster different morphologies of messily grown nanowires and build connections between the morphological microstructure and geometrical features of nanowires within. Then, the as-proposed networks were applied on recognitions and quantitative estimations of the experimental morphologies. Results show that the as-trained SOFMs are able to cluster the morphologies and recognize the average length and quantity of the messily grown nanowires within. The inter-layer connections between winning neurons on each competitive layer have significant influence on the relations between the microstructure of the morphology and physical parameters of the nanowires within.

Application of self-organizing neural networks to classification of plant communities in Pangquangou Nature Reserve, North China

Vegetation classification is an important topic in plant ecology and many quantitative techniques for classification have been developed in the field.The artificial neural network is a comparatively new tool for data analysis.The self-organizing feature map(SOFM)is powerful tool for clustering analysis.SOFM has been applied to many research fields and it was applied to the classification of plant communities in the Pangquangou Nature Reserve in the present work.Pangquangou Nature Reserve,located at 37°20′–38°20′ N,110°18′–111°18′ E,is a part of the Luliang Mountain range.Eighty-nine samples(quadrats)of 10 m×10 m for forest,4 m×4 m for shrubland and 1 m×1 m for grassland along an elevation gradient,were set up and species data was recorded in each sample.After discussion of the mathematical algorism,clustering technique and the procedure of SOFM,the classification was carried out by using NNTool box in MATLAB(6.5).As a result,the 89 samples were clustered into 13 groups representing 13 types of plant communities.The characteristics of each community were described.The result of SOFM classification was identical to the result of fuzzy c-mean clustering and consistent with the distribution patterns of vegetation in the study area and shows significant ecological meanings.This suggests that SOFM may clearly describe the ecological relationships between plant communities and it is a very effective quantitative technique in plant ecology research.

一种GOA优化SOM神经网络的VP型倾斜仪故障智能诊断方法

提出一种VP型倾斜仪故障智能诊断方法。利用经验模态分解(EMD)将归一化故障信号分解为6个本征模态函数(IMF),分别计算其近似熵,构建EMD多尺度近似熵输入矩阵;结合蝗虫优化算法(GOA)对自组织特征映射(SOM)神经网络的参数进行优化,将得到的GOA最优值嵌入到SOM模型中,组建GOA-SOM诊断模型。应用诊断测试集得到诊断目标的聚类标签值,将其与训练集的聚类标签以及真实故障类型进行比对,得到故障诊断结果。结果证明,GOA-SOM模型在100次随机抽样条件下的诊断正确率均值和标准差分别为99.329 7%、1.218 8,优于传统诊断模型。

VP型宽频带倾斜仪故障信号的BBA-SOM智能诊断

针对现有VP型倾斜仪故障诊断主要依靠人工经验和诊断流程较为复杂的问题,提出以互补集合经验模态分解(complete ensemble empirical mode decomposition,CEEMD)多尺度近似熵和二进制蝙蝠算法(binary bat algorithm,BBA)优化SOM神经网络参数的VP型倾斜仪故障诊断新方。首先,将归一化后的仪器故障信号进行CEEMD分解,对6阶本征模态函数(intrinsic mode function,IMF)求取多尺度近似熵值;然后将网络输入法按比例分为训练集和测试集,以训练集的识别率为适应度函数,应用二进制蝙蝠算法(binary bat algorithm,BBA)优化SOM神经网络的竞争层维数和网络训练次数;最后应用上述得到的BBA-SOM网络模型对倾斜仪故障特征数据进行辨识。实验表明:CEEMD多尺度近似熵判据对倾斜仪故障特征的区分效果符合预期;相对于朴素贝叶斯、AdaBoost集成学习与LDA等学习模型,BBA-SOM模型可以准确进行故障诊断;该方法对实现VP型倾斜仪故障的自动诊断有重要现实意义。

基于特征映射和联合学习的可解释新闻推荐

为解决现有个性化推荐系统大多是黑箱模式,无法提供可靠的推荐理由这一问题,对可解释性推荐进行深入研究。为在消除元数据需求的情况下,实现推荐的可解释性和性能之间权衡,提出一种特征映射方法,将不可解释的一般特征映射到可解释的方面特征,该方面特征可用于解释生成;同时使用一个联合学习模型平衡准确预测和生成解释这两个任务,实现推荐中令人满意的准确性和可解释性。通过在真实数据集上的实验,验证了该方法在推荐准确度和解释语句质量两方面都有所提升。

基于特征融合的牵引电机轴承声学故障诊断

滚动轴承作为高速列车牵引电机的重要部件,其故障情况严重影响列车运行安全。声学轴承故障诊断方式具有无安装侵入性、运维成本低的优点,但也具有信噪比低、故障特征难以提取的缺点,机器学习则具有克服噪声影响的鲁棒性。针对应用机器学习进行声学故障诊断时,少量特征无法全面表征轴承故障的难题,文章提出将格拉姆角场(GAF)与小波时频图进行叠加融合,构成6通道融合特征图用以有效表征轴承的故障。首先,建立牵引电机轴承声学故障试验台获取故障声学信号;其次,建立基于GAF的声学信号融合特征图,然后使用残差网络(ResNET)模型针对融合特征图特征训练并验证故障分类模型,并与以单种特征图作为特征的故障分类方法进行准确率对比。结果表明,基于GAF的融合特征图的声学故障分类模型具有99.89%的准确率,融合特征图能更有效地映射轴承故障。

基于特征图融合的对抗样本生成方法

为检验现有深度学习算法的鲁棒性和安全性,提出一种基于特征图融合的对抗样本生成方法。首先,分析卷积神经网络在图像分类任务中所提取不同层次特征图的特点,提出利用多层次特征图进行对抗扰动构造的方法思想;其次,引入通道注意力模块对卷积层输出特征图进行权重分配,以此代表不同特征图对分类结果的影响程度;再次,构建基础网络用于选取高权重特征图,并对显著特征信息进行像素值修改来生成扰动特征图;最后,将不同扰动特征图融合为对抗扰动,并添加至原始输入样本中生成对抗样本。实验结果表明,所提对抗样本生成方法在CIFAR-10和MNIST数据集上兼顾了攻击成功率和样本视觉感知效果,与现有代表性对抗样本生成方法相比,在高难度的非交互式黑盒模型上取得了较好的攻击效果。

基于特征融合编解码的人群计数和密度估计

为解决人群计数任务中因人群大小不一导致的计数偏差问题,提出一种基于特征融合的编解码卷积神经网络模型(CFFNet)。前端网络模块对输入的人群图像自动编码,提取不同尺度的人群特征语义信息;后端网络模块对编码后的人群特征信息进行融合和解码,得到最终的估计密度图。将该模型在4个公开数据集上进行实验,并与历年的主要方法进行对比,实验结果表明,该模型在ShanghaiTech PartA、UCSD和Mall数据集上取得了更好的MAE指标,优于目前的这些算法,验证了模型对不同的人群尺度具有很好的适应性。