弹性网络核极限学习机的多标记学习算法

Multi-label learning algorithm of an elastic net kernel extreme learning machine

将正则化极限学习机或者核极限学习机理论应用到多标记分类中,一定程度上提高了算法的稳定性。但目前这些算法关于损失函数添加的正则项都基于L2正则,导致模型缺乏稀疏性表达。同时,弹性网络正则化既保证模型鲁棒性且兼具模型稀疏化学习,但结合弹性网络的极限学习机如何解决多标记问题鲜有研究。基于此,本文提出一种对核极限学习机添加弹性网络正则化的多标记学习算法。首先,对多标记数据特征空间使用径向基核函数映射;随后,对核极限学习机损失函数施加弹性网络正则项;最后,采用坐标下降法迭代求解输出权值以得到最终预测标记。通过对比试验和统计分析表明,提出的算法具有更好的性能表现。

Regularized extreme learning machine or kernel extreme learning machine theory was applied to multi-label classification,which improves the stability of the algorithm to a certain extent.However,the regularization terms added by these algorithms for loss functions are all based on L2 regularization,which leads to the lack of sparse expression of the model.Simultaneously,elastic net regularization guarantees both model robustness and model sparse learning.Nevertheless,there is insufficient research on how to solve multi-label learning problems by combining elastic net kernel extreme learning machines.Based on this hypothesis,this paper proposes a multi-label learning algorithm that adds elastic network regularization to kernel extreme learning machines.It first uses radial basis function mapping for feature spacing of multi-label;subsequently,it applies the elastic net regularization to the loss function of kernel extreme learning machine.Finally,it uses the coordinate descent method to iteratively solve the output weights to get the final prediction labels.Through comparative experiments and statistical analyses,the proposed method demonstrates better performance.