基于小批量随机梯度下降法的SVM训练隐私保护方案

Privacy-preserving Scheme for SVM Training Based on Mini-batch

使用支持向量机(support vector machine,SVM)处理敏感数据时,隐私保护很重要,已有SVM隐私保护方案基于批量梯度下降法(batch gradient descent,BGD)进行训练,计算开销巨大.针对该问题,提出基于小批量随机梯度下降法(mini-batch stochastic gradient descent,Mini-batch SGD)的SVM隐私保护方案.首先,设计基于Mini-batch SGD的SVM训练算法;然后在此基础上,对模型权重进行乘法扰动,利用大整数分解问题困难假设确保模型的隐私性,使用同态密码体制对数据加密后再执行SVM训练,之后运用同态哈希函数进行验证;最终构建了SVM隐私保护方案.针对安全威胁,论证了数据隐私性、模型隐私性、模型正确性.对方案进行仿真实验和分析,结果表明,该方案在分类性能接近已有方案的情况下,其计算时间开销平均节约了92.4%.

When using a support vector machine(SVM)to process sensitive data,privacy protection is very important.The existing SVM privacy-preserving schemes are trained based on batch gradient descent(BGD)algorithm,and they have huge computational overhead.To solve this problem,this paper proposed a privacy-preserving scheme for SVM training based on mini-batch stochastic gradient descent(Mini-batch SGD).Firstly,it designed the SVM training algorithm based on Mini-batch SGD.Then,on this basis,it perturbed the model weights by multiplication,used the hardness assumption of integer factorization to ensure the privacy of the model,engaged the homomorphic cryptosystem to encrypt the data,performed SVM training,and then applied the homomorphic hash function for verification.Finally,it constructed the SVM privacy-preserving scheme.Against security threats,the paper demonstrated data privacy,model privacy,and model correctness.It carried out simulation experiments and analysis of the scheme.The results show that the proposed scheme can save 92.4%of the computation time on average,while the classification performance is close to the existing schemes.