Deep Reinforcement Learning-Based Task Offloading and Service Migrating Policies in Service Caching-Assisted Mobile Edge Computing

Emerging mobile edge computing(MEC)is considered a feasible solution for offloading the computation-intensive request tasks generated from mobile wireless equipment(MWE)with limited computational resources and energy.Due to the homogeneity of request tasks from one MWE during a longterm time period,it is vital to predeploy the particular service cachings required by the request tasks at the MEC server.In this paper,we model a service caching-assisted MEC framework that takes into account the constraint on the number of service cachings hosted by each edge server and the migration of request tasks from the current edge server to another edge server with service caching required by tasks.Furthermore,we propose a multiagent deep reinforcement learning-based computation offloading and task migrating decision-making scheme(MBOMS)to minimize the long-term average weighted cost.The proposed MBOMS can learn the near-optimal offloading and migrating decision-making policy by centralized training and decentralized execution.Systematic and comprehensive simulation results reveal that our proposed MBOMS can converge well after training and outperforms the other five baseline algorithms.

Learning-Based Joint Service Caching and Load Balancing for MEC Blockchain Networks

Integrating the blockchain technology into mobile-edge computing(MEC)networks with multiple cooperative MEC servers(MECS)providing a promising solution to improving resource utilization,and helping establish a secure reward mechanism that can facilitate load balancing among MECS.In addition,intelligent management of service caching and load balancing can improve the network utility in MEC blockchain networks with multiple types of workloads.In this paper,we investigate a learningbased joint service caching and load balancing policy for optimizing the communication and computation resources allocation,so as to improve the resource utilization of MEC blockchain networks.We formulate the problem as a challenging long-term network revenue maximization Markov decision process(MDP)problem.To address the highly dynamic and high dimension of system states,we design a joint service caching and load balancing algorithm based on the double-dueling Deep Q network(DQN)approach.The simulation results validate the feasibility and superior performance of our proposed algorithm over several baseline schemes.

Service Caching and Task Offloading for Mobile Edge Computing-Enabled Intelligent Connected Vehicles

The development of intelligent connected vehicles(ICVs)has tremendously inspired the emergence of a new computing paradigm called mobile edge computing(MEC),which meets the demands of delay-sensitive on-vehicle applications.Most existing studies focusing on the issue of task offloading in ICVs assume that the MEC server can directly complete computation tasks without considering the necessity of service caching.However,this is unrealistic in practice because a large number of tasks require the use of corresponding third-party libraries and databases,that is,service caching.Therefore,we investigate the delay optimization in an MEC-enabled ICVs system with multiple mobile vehicles,resource-limited base stations(BSs),and one cloud server.We aim to determine the optimal service caching and task offloading decisions to minimize the overall system delay using mixed-integer nonlinear programming.To address this problem,we first convert it into a quadratically constrained quadratic program and then propose an efficient semidefinite relaxation-based joint service caching and task offloading(JSCTO)algorithm to obtain the service caching and task offloading decisions.In the simulations,we validate the efficiency of our proposed method by setting different numbers of vehicles and the storage capacity of BSs.The results show that our proposed JSCTO algorithm can significantly decrease the total delay of all offloaded tasks compared with the cloud processing only scheme.