结合马氏距离与自编码器的网络流量异常检测方法

Abnormal Network Traffic Detection Method Combining Mahalanobis Distance and Autoencoder

当前网络流量数据规模较大且分布不均衡,传统网络流量异常检测方法检测准确率较低。提出一种结合马氏距离和自编码器的检测方法,使用马氏距离倒数及判别阈值快速检测部分正常数据以减少训练数据量,同时,在自编码器代价函数中添加马氏距离度量项以增强自编码器的特征提取能力。在此基础上,将自编码器与分类器相结合以解决网络参数初始化问题,并通过调整自编码神经网络交叉熵损失函数中各项的权重,提高自编码神经网络对数据分布不均衡数据集的训练效果。实验结果表明,该方法在CICIDS2017数据集、NSL-KDD数据集上的异常检测准确率分别高达97.60%、99.84%,在CICIDS2017数据集上的F1值为0.9413,高于DNN、LSTM、C-LSTM等方法。

The existing abnormal traffic detection methods are limited in the accuracy due to the large scale of network traffic data and its imbalanced distribution.To address the problem,a method combining Mahalanobis distance and autoencoder is proposed to detect abnormal network traffic.This method employs the reciprocal Mahalanobis distance and discriminant threshold to quickly identify part of the normal data,so the amount of network training can be reduced.At the same time,the Mahalanobis distance item is added to the autoencoder cost function to improve the autoencoder,enhancing its ability of feature extraction.On this basis,the autoencoder is combined with the classifier to solve the problem of network parameter initialization.Then by adjusting the weight of each item in the cross-entropy loss function of the autoencoder neural network,the training effect of imbalanced data sets for the autoencoder neural network is improved.The experimental results show that the proposed method exhibits an anomaly detection accuracy of 97.60%on the CICIDS2017 data set,and 99.84%on the NSL-KDD data set.It also displays the F1 score on the CICIDS2017 is 0.9413,higher than DNN,LSTM,C-LSTM and other methods.