融合注意力胶囊的深度因子分解机模型

Deep factorization machine model based on attention capsule

针对深度学习中推荐模型特征组合单一、消解大量有价值特征信息以及过拟合等问题,设计了一种新型的注意力得分机制——注意力胶囊,提出了一种融合注意力胶囊的深度因子分解机模型。基于DeepFM模型,将用户历史点击行为与候选物品进行权重计算,降低了无关特征对模型的影响,充分挖掘了不同历史行为对用户兴趣的差异性影响。训练过程中加入自适应正则化式,在不影响训练速度的前提下,有效地减少了过拟合。在2个公开数据集上进行对比实验,实验结果表明,所提模型相对于其他模型在损失函数和GAUC上均有明显提升。

Aiming at the problems of single feature combination of recommendation model,resolution of a large amount of valuable feature information,and over-fitting in deep learning,a new attentional scoring mechanism called attention capsule was designed,and a deep factorization machine model based on attention capsule was proposed.Users’historical clicking and candidate items were processed through weight calculation based on the DeepFM model,reducing the impact of irrelevant features on the model,and the differential impact of different historical behaviors on users’interests was fully explored.The adaptive regularization formulation was added to the training,which effectively reduced over-fitting without affecting the training speed.The comparison test on two public data sets shows that the proposed model is significantly enhanced in loss function and GAUC compared to other models.