This paper focuses on the intrusion classification of huge amounts of data in a network intrusion detection system. An intrusion detection model based on deep belief nets （DBN） is proposed to conduct intrusion detec...This paper focuses on the intrusion classification of huge amounts of data in a network intrusion detection system. An intrusion detection model based on deep belief nets （DBN） is proposed to conduct intrusion detection,and the principles regarding DBN are discussed.The DBN is composed of a multiple unsupervised restricted Boltzmann machine （RBM） and a supervised back propagation （BP）network.First,the DBN in the proposed model is pre-trained in a fast and greedy way,and each RBM is trained by the contrastive divergence algorithm.Secondly,the whole network is fine-tuned by the supervised BP algorithm,which is employed for classifying the low-dimensional features of the intrusion data generated by the last RBM layer simultaneously.The experimental results on the KDD CUP 1999 dataset demonstrate that the DBN using the RBM network with three or more layers outperforms the self-organizing maps （SOM）and neural network （NN）in intrusion classification.Therefore,the DBN is an efficient approach for intrusion detection in high-dimensional space.展开更多
In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network...In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network data and cannot detect currently unknown attacks. Therefore, this paper proposes a network attack detection method combining a flow calculation and deep learning. The method consists of two parts: a real-time detection algorithm based on flow calculations and frequent patterns and a classification algorithm based on the deep belief network and support vector machine(DBN-SVM). Sliding window(SW) stream data processing enables real-time detection, and the DBN-SVM algorithm can improve classification accuracy. Finally, to verify the proposed method, a system is implemented.Based on the CICIDS2017 open source data set, a series of comparative experiments are conducted. The method's real-time detection efficiency is higher than that of traditional machine learning algorithms. The attack classification accuracy is 0.7 percentage points higher than that of a DBN, which is 2 percentage points higher than that of the integrated algorithm boosting and bagging methods. Hence, it is suitable for the real-time detection of high-speed network intrusions.展开更多
An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-v...An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-varying characteristics.Therefore, in several previous studies, various machine-learning methods have been applied. A DBN is a fast, greedy learning algorithm that can find a fairly good set of weights rapidly, even in deep networks with a large number of parameters and many hidden layers. To evaluate this model, we acquired EMG signals, extracted their features, and then compared the model with the DBN and other conventional classifiers. The accuracy of the DBN is higher than that of the other algorithms. The classification performance of the DBN model designed is approximately 88.60%. It is 7.55%(p=9.82×10-12) higher than linear discriminant analysis(LDA) and 2.89%(p=1.94×10-5) higher than support vector machine(SVM). Further, the DBN is better than shallow learning algorithms or back propagation(BP), and this model is effective for an EMG-based user-interfaced system.展开更多
High-precision localization technology is attracting widespread attention in harsh indoor environments.In this paper,we present a fingerprint localization and tracking system to estimate the locations of the tag based...High-precision localization technology is attracting widespread attention in harsh indoor environments.In this paper,we present a fingerprint localization and tracking system to estimate the locations of the tag based on a deep belief network(DBN).In this system,we propose using coefficients as fingerprints to combine the ultra-wideband(UWB)and inertial measurement unit(IMU)estimation linearly,termed as a HUID system.In particular,the fingerprints are trained by a DBN and estimated by a radial basis function(RBF).However,UWB-based estimation via a trilateral method is severely affected by the non-line-of-sight(NLoS)problem,which limits the localization precision.To tackle this problem,we adopt the random forest classifier to identify line-of-sight(LoS)and NLoS conditions.Then,we adopt the random forest regressor to mitigate ranging errors based on the identification results for improving UWB localization precision.The experimental results show that the mean square error(MSE)of the localization error for the proposed HUID system reduces by 12.96%,50.16%,and 64.92%compared with that of the existing extended Kalman filter(EKF),single UWB,and single IMU estimation methods,respectively.展开更多
传统的多模态过程故障等级评估方法对模态之间的共性特征考虑较少,导致当被评估模态故障信息不充分时,评估的准确性较低.针对此问题,首先,提出一种共性–个性深度置信网络(Common and specific deep belief network,CS-DBN),该网络充分...传统的多模态过程故障等级评估方法对模态之间的共性特征考虑较少,导致当被评估模态故障信息不充分时,评估的准确性较低.针对此问题,首先,提出一种共性–个性深度置信网络(Common and specific deep belief network,CS-DBN),该网络充分利用深度置信网络(Deep belief network,DBN)的深度分层特征提取能力,通过度量多模态数据间分布的相似性和差异性,进一步得到能够反映多模态过程共有信息的共性特征以及反映每个模态独有信息的个性特征;其次,基于CS-DBN,利用多模态过程的已知故障等级数据生成多模态共性–个性特征集,通过加权逻辑回归构建故障等级评估模型;最后,将所提方法应用于带钢热连轧生产过程的故障等级评估中.应用结果表明,随着多模态故障等级数据的增加,所提方法的评估准确率逐渐增加,当故障信息充足时,评估准确率可达98.75%;故障信息不足时,与传统方法相比,评估准确率提升近10%.展开更多
遥感图像分类是地理信息系统(geographic information system,GIS)的关键技术,对城市规划与管理起到十分重要的作用.近年来,深度学习成为机器学习领域的一个新兴研究方向.深度学习采用模拟人脑多层结构的方式,对数据从低层到高层渐进地...遥感图像分类是地理信息系统(geographic information system,GIS)的关键技术,对城市规划与管理起到十分重要的作用.近年来,深度学习成为机器学习领域的一个新兴研究方向.深度学习采用模拟人脑多层结构的方式,对数据从低层到高层渐进地进行特征提取,从而发掘数据在时间与空间上的规律,进而提高分类的准确性.深度信念网络(deep belief network,DBN)是一种得到广泛研究与应用的深度学习模型,它结合了无监督学习和有监督学习的优点,对高维数据具有较好的分类能力.提出一种基于DBN模型的遥感图像分类方法,并利用RADARSAT-2卫星6d的极化合成孔径雷达(synthetic aperture radar,SAR)图像进行了验证.实验表明,与支持向量机(SVM)及传统的神经网络(NN)方法相比,基于DBN模型的方法可以取得更好的分类效果.展开更多
基金The National Key Technology R&D Program during the 12th Five-Year Plan Period(No.2013BAK01B02)the National Natural Science Foundation of China(No.61373176)the Scientific Research Projects of Shaanxi Educational Committee(No.14JK1693)
文摘This paper focuses on the intrusion classification of huge amounts of data in a network intrusion detection system. An intrusion detection model based on deep belief nets （DBN） is proposed to conduct intrusion detection,and the principles regarding DBN are discussed.The DBN is composed of a multiple unsupervised restricted Boltzmann machine （RBM） and a supervised back propagation （BP）network.First,the DBN in the proposed model is pre-trained in a fast and greedy way,and each RBM is trained by the contrastive divergence algorithm.Secondly,the whole network is fine-tuned by the supervised BP algorithm,which is employed for classifying the low-dimensional features of the intrusion data generated by the last RBM layer simultaneously.The experimental results on the KDD CUP 1999 dataset demonstrate that the DBN using the RBM network with three or more layers outperforms the self-organizing maps （SOM）and neural network （NN）in intrusion classification.Therefore,the DBN is an efficient approach for intrusion detection in high-dimensional space.
基金supported by the National Key Research and Development Program of China(2017YFB1401300,2017YFB1401304)the National Natural Science Foundation of China(61702211,L1724007,61902203)+3 种基金Hubei Provincial Science and Technology Program of China(2017AKA191)the Self-Determined Research Funds of Central China Normal University(CCNU)from the Colleges’Basic Research(CCNU17QD0004,CCNU17GF0002)the Natural Science Foundation of Shandong Province(ZR2017QF015)the Key Research and Development Plan–Major Scientific and Technological Innovation Projects of Shandong Province(2019JZZY020101)。
文摘In recent years, network traffic data have become larger and more complex, leading to higher possibilities of network intrusion. Traditional intrusion detection methods face difficulty in processing high-speed network data and cannot detect currently unknown attacks. Therefore, this paper proposes a network attack detection method combining a flow calculation and deep learning. The method consists of two parts: a real-time detection algorithm based on flow calculations and frequent patterns and a classification algorithm based on the deep belief network and support vector machine(DBN-SVM). Sliding window(SW) stream data processing enables real-time detection, and the DBN-SVM algorithm can improve classification accuracy. Finally, to verify the proposed method, a system is implemented.Based on the CICIDS2017 open source data set, a series of comparative experiments are conducted. The method's real-time detection efficiency is higher than that of traditional machine learning algorithms. The attack classification accuracy is 0.7 percentage points higher than that of a DBN, which is 2 percentage points higher than that of the integrated algorithm boosting and bagging methods. Hence, it is suitable for the real-time detection of high-speed network intrusions.
基金supported by Inha University Research Grant,Korea
文摘An enhanced algorithm is proposed to recognize multi-channel electromyography(EMG) patterns using deep belief networks(DBNs). It is difficult to classify the EMG features because an EMG signal has nonlinear and time-varying characteristics.Therefore, in several previous studies, various machine-learning methods have been applied. A DBN is a fast, greedy learning algorithm that can find a fairly good set of weights rapidly, even in deep networks with a large number of parameters and many hidden layers. To evaluate this model, we acquired EMG signals, extracted their features, and then compared the model with the DBN and other conventional classifiers. The accuracy of the DBN is higher than that of the other algorithms. The classification performance of the DBN model designed is approximately 88.60%. It is 7.55%(p=9.82×10-12) higher than linear discriminant analysis(LDA) and 2.89%(p=1.94×10-5) higher than support vector machine(SVM). Further, the DBN is better than shallow learning algorithms or back propagation(BP), and this model is effective for an EMG-based user-interfaced system.
基金supported in part by the National Natural Science Foundation of China under Grant No.61771474in part by the Postgraduate Research&Practice Innovation Program of Jiangsu Province under Grant No.KYCX212243+2 种基金in part by the Young Talents of Xuzhou Science and Technology Plan Project under Grant No.KC19051in part by the Open Research Fund of National Mobile Communications Research Laboratory,Southeast University under Grant No.2021D02in part by the Open Fund of Information Photonics and Optical Communications (IPOC) (BUPT)。
文摘High-precision localization technology is attracting widespread attention in harsh indoor environments.In this paper,we present a fingerprint localization and tracking system to estimate the locations of the tag based on a deep belief network(DBN).In this system,we propose using coefficients as fingerprints to combine the ultra-wideband(UWB)and inertial measurement unit(IMU)estimation linearly,termed as a HUID system.In particular,the fingerprints are trained by a DBN and estimated by a radial basis function(RBF).However,UWB-based estimation via a trilateral method is severely affected by the non-line-of-sight(NLoS)problem,which limits the localization precision.To tackle this problem,we adopt the random forest classifier to identify line-of-sight(LoS)and NLoS conditions.Then,we adopt the random forest regressor to mitigate ranging errors based on the identification results for improving UWB localization precision.The experimental results show that the mean square error(MSE)of the localization error for the proposed HUID system reduces by 12.96%,50.16%,and 64.92%compared with that of the existing extended Kalman filter(EKF),single UWB,and single IMU estimation methods,respectively.
文摘传统的多模态过程故障等级评估方法对模态之间的共性特征考虑较少,导致当被评估模态故障信息不充分时,评估的准确性较低.针对此问题,首先,提出一种共性–个性深度置信网络(Common and specific deep belief network,CS-DBN),该网络充分利用深度置信网络(Deep belief network,DBN)的深度分层特征提取能力,通过度量多模态数据间分布的相似性和差异性,进一步得到能够反映多模态过程共有信息的共性特征以及反映每个模态独有信息的个性特征;其次,基于CS-DBN,利用多模态过程的已知故障等级数据生成多模态共性–个性特征集,通过加权逻辑回归构建故障等级评估模型;最后,将所提方法应用于带钢热连轧生产过程的故障等级评估中.应用结果表明,随着多模态故障等级数据的增加,所提方法的评估准确率逐渐增加,当故障信息充足时,评估准确率可达98.75%;故障信息不足时,与传统方法相比,评估准确率提升近10%.
