基于深度Q网络的在线服务功能链部署方法

Online Service Function Chain Deployment Method Based on Deep Q Network

针对5G网络资源状态动态变化和网络模型高维度下服务功能链部署的复杂性问题,该文提出一种基于深度Q网络的在线服务功能链部署方法(DeePSCD)。首先,为描述网络资源动态变化的特征,将服务功能链部署建模成马尔可夫决策过程,然后,针对系统资源模型的高维度问题采用深度Q网络的方法进行在线服务功能链部署策略求解。该方法可以有效描述网络资源状态的动态变化,特别是深度Q网络能有效克服求解复杂度,优化服务功能链的部署开销。仿真结果表明,所提方法在满足服务时延约束条件下降低了服务功能链的部署开销,提高了运营商网络的服务请求接受率。

To deal with the dynamic nature of 5G network resource state and the difficulty of service function chain deployment under the high-dimensional network state model,an online Service function Chain Deployment method based on Deep Q network(DeePSCD)is proposed.First,to describe the dynamic nature of network resource state,the service function chain deployment is modeled as a Markov decision process.Then,the deep Q network is used to solve the online service function chain deployment problem in the highdimensional system resource model.This method can effectively describe the dynamic changes of network resource state.Specifically,deep Q network handles the complexity of problem and determines the optimal deployment solution of service function chain.Simulation results show that the proposed method can reduce the deployment cost of the service function chain and increase the acceptance rate while meeting the service delay constraint.