为了提高网络入侵检测率,提出一种人工鱼群算法(AFSA)优化ELM神经网络的网络入侵检测模型。首先将ELM神经网络参数编码成人工鱼的位置,然后利用人工鱼群算法通过模拟鱼群的觅食、聚群及追尾行为找到最优ELM神经网络参数,最后利用最优参...为了提高网络入侵检测率,提出一种人工鱼群算法(AFSA)优化ELM神经网络的网络入侵检测模型。首先将ELM神经网络参数编码成人工鱼的位置,然后利用人工鱼群算法通过模拟鱼群的觅食、聚群及追尾行为找到最优ELM神经网络参数,最后利用最优参数的ELM神经网络建立网络入侵检测模型,并采用KDD CUP 99数据集进行仿真测试。仿真结果表明,模型不仅提高了入侵检测正确率,而且加快了网络入侵检测速度。展开更多
Machine learning approaches have been promising in constructing high-dimensional potential energy surfaces （PESs） for molecules and materials. Neural networks （NNs） are one of the most popular such tools because o...Machine learning approaches have been promising in constructing high-dimensional potential energy surfaces （PESs） for molecules and materials. Neural networks （NNs） are one of the most popular such tools because of its simplicity and efficiency. The training algorithm for NNs becomes essential to achieve a fast and accurate fit with numerous data. The Levenberg-Marquardt （LM） algorithm has been recognized as one of the fastest and robust algorithms to train medium sized NNs and widely applied in recent NN based high quality PESs. However, when the number of ab initio data becomes large, the efficiency of LM is limited, making the training time consuming. Extreme learning machine （ELM） is a recently proposed algorithm which determines the weights and biases of a single hidden layer NN by a linear solution and is thus extremely fast. It, however, does not produce sufficiently small fitting error because of its random nature. Taking advantages of both algorithms, we report a generalized hybrid algorithm in training multilayer NNs. Tests on H＋H2 and CH4＋Ni（111） systems demonstrate the much higher efficiency of this hybrid algorithm （ELM-LM） over the original LM. We expect that ELM-LM will find its widespread applications in building up high-dimensional NN based PESs.展开更多
As a new neural network model,extreme learning machine(ELM)has a good learning rate and generalization ability.However,ELM with a single hidden layer structure often fails to achieve good results when faced with large...As a new neural network model,extreme learning machine(ELM)has a good learning rate and generalization ability.However,ELM with a single hidden layer structure often fails to achieve good results when faced with large-scale multi-featured problems.To resolve this problem,we propose a multi-layer framework for the ELM learning algorithm to improve the model’s generalization ability.Moreover,noises or abnormal points often exist in practical applications,and they result in the inability to obtain clean training data.The generalization ability of the original ELM decreases under such circumstances.To address this issue,we add model bias and variance to the loss function so that the model gains the ability to minimize model bias and model variance,thus reducing the influence of noise signals.A new robust multi-layer algorithm called ML-RELM is proposed to enhance outlier robustness in complex datasets.Simulation results show that the method has high generalization ability and strong robustness to noise.展开更多
文摘为了提高网络入侵检测率,提出一种人工鱼群算法(AFSA)优化ELM神经网络的网络入侵检测模型。首先将ELM神经网络参数编码成人工鱼的位置,然后利用人工鱼群算法通过模拟鱼群的觅食、聚群及追尾行为找到最优ELM神经网络参数,最后利用最优参数的ELM神经网络建立网络入侵检测模型,并采用KDD CUP 99数据集进行仿真测试。仿真结果表明,模型不仅提高了入侵检测正确率,而且加快了网络入侵检测速度。
文摘Machine learning approaches have been promising in constructing high-dimensional potential energy surfaces （PESs） for molecules and materials. Neural networks （NNs） are one of the most popular such tools because of its simplicity and efficiency. The training algorithm for NNs becomes essential to achieve a fast and accurate fit with numerous data. The Levenberg-Marquardt （LM） algorithm has been recognized as one of the fastest and robust algorithms to train medium sized NNs and widely applied in recent NN based high quality PESs. However, when the number of ab initio data becomes large, the efficiency of LM is limited, making the training time consuming. Extreme learning machine （ELM） is a recently proposed algorithm which determines the weights and biases of a single hidden layer NN by a linear solution and is thus extremely fast. It, however, does not produce sufficiently small fitting error because of its random nature. Taking advantages of both algorithms, we report a generalized hybrid algorithm in training multilayer NNs. Tests on H＋H2 and CH4＋Ni（111） systems demonstrate the much higher efficiency of this hybrid algorithm （ELM-LM） over the original LM. We expect that ELM-LM will find its widespread applications in building up high-dimensional NN based PESs.
基金Project(21878081)supported by the National Natural Science Foundation of ChinaProject(222201917006)supported by the Fundamental Research Funds for the Central Universities,China。
文摘As a new neural network model,extreme learning machine(ELM)has a good learning rate and generalization ability.However,ELM with a single hidden layer structure often fails to achieve good results when faced with large-scale multi-featured problems.To resolve this problem,we propose a multi-layer framework for the ELM learning algorithm to improve the model’s generalization ability.Moreover,noises or abnormal points often exist in practical applications,and they result in the inability to obtain clean training data.The generalization ability of the original ELM decreases under such circumstances.To address this issue,we add model bias and variance to the loss function so that the model gains the ability to minimize model bias and model variance,thus reducing the influence of noise signals.A new robust multi-layer algorithm called ML-RELM is proposed to enhance outlier robustness in complex datasets.Simulation results show that the method has high generalization ability and strong robustness to noise.
