摘要
为解决现有的差分隐私联邦学习算法中使用固定的裁剪阈值和噪声尺度进行训练,从而导致数据隐私泄露、模型精度较低的问题,提出了一种基于差分隐私的分段裁剪联邦学习算法。首先,根据客户端的隐私需求分为隐私需求高和低。对于高隐私需求用户使用自适应裁剪来动态裁剪梯度,而低隐私需求用户则采用比例裁剪。其次根据裁剪后阈值大小自适应地添加噪声尺度。通过实验分析可得,该算法可以更好地保护隐私数据,同时通信代价也低于ADP-FL和DP-FL算法,并且与ADP-FL和DP-FL相比,模型准确率分别提高了2.25%和4.41%。
To solve the problems caused by using fixed cropping thresholds and noise scales for training in existing differential privacy federated learning algorithms,such as data privacy leakage and low model accuracy,the paper proposed a segmented cropping federated learning algorithm based on differential privacy.Firstly,the clients divided the privacy requirements into high and low privacy demands.For users with high privacy demands,it employed adaptive clipping to dynamically clip the gradients.Conversely,for users with low privacy demands,it adopted proportional clipping.Secondly,the clients adaptively added noise scales based on the size of the clipped threshold.The experimental analysis shows that this algorithm effectively safeguards privacy data,while reducing communication costs compared to ADP-FL and DP-FL algorithms.Additionally,it achieves an improvement in model accuracy by 2.25%and 4.41%compared to ADP-FL and DP-FL respectively.
作者
吴俊仪
李晓会
Wu Junyi;Li Xiaohui(School of Electronics&Information Engineering,Liaoning University of Technology,Jinzhou Liaoning 121000,China)
出处
《计算机应用研究》
CSCD
北大核心
2024年第5期1532-1537,共6页
Application Research of Computers
基金
国家自然科学基金青年基金资助项目(61802161)
辽宁省应用基础研究计划资助项目(2022JH2/101300278)
辽宁工业大学研究生教育改革创新项目(YJG2023013)。
关键词
联邦学习
差分隐私
分段裁剪
隐私分类
自适应加噪
federated learning
differential privacy
segmental tailoring
privacy classification
adaptive noise addition