Edge computing enabled Intelligent Road Network(EC-IRN)provides powerful and convenient computing services for vehicles and roadside sensing devices.The continuous emergence of transportation applications has caused a...Edge computing enabled Intelligent Road Network(EC-IRN)provides powerful and convenient computing services for vehicles and roadside sensing devices.The continuous emergence of transportation applications has caused a huge burden on roadside units(RSUs)equipped with edge servers in the Intelligent Road Network(IRN).Collaborative task scheduling among RSUs is an effective way to solve this problem.However,it is challenging to achieve collaborative scheduling among different RSUs in a completely decentralized environment.In this paper,we first model the interactions involved in task scheduling among distributed RSUs as a Markov game.Given that multi-agent deep reinforcement learning(MADRL)is a promising approach for the Markov game in decision optimization,we propose a collaborative task scheduling algorithm based on MADRL for EC-IRN,named CA-DTS,aiming to minimize the long-term average delay of tasks.To reduce the training costs caused by trial-and-error,CA-DTS specially designs a reward function and utilizes the distributed deployment and collective training architecture of counterfactual multi-agent policy gradient(COMA).To improve the stability of performance in large-scale environments,CA-DTS takes advantage of the action semantics network(ASN)to facilitate cooperation among multiple RSUs.The evaluation results of both the testbed and simulation demonstrate the effectiveness of our proposed algorithm.Compared with the baselines,CA-DTS can achieve convergence about 35%faster,and obtain average task delay that is lower by approximately 9.4%,9.8%,and 6.7%,in different scenarios with varying numbers of RSUs,service types,and task arrival rates,respectively.展开更多
Introduction Psoriasis characterized by red scaly skin lesions clinically is a chronic inflammatory skin disease,and there are 0.53%-11.43% of the adults around the world suffered[1].The pathophysiological changes o...Introduction Psoriasis characterized by red scaly skin lesions clinically is a chronic inflammatory skin disease,and there are 0.53%-11.43% of the adults around the world suffered[1].The pathophysiological changes of psoriasis are characterized by proliferation accelerated in epidermal basal keratinocytes and infiltration of inflammatory cells from epidermis and dermis.Many studies have shown that the occurrence and development of psoriasis is closely related to genes,cell signaling pathways and proliferation.The relationships between peroxisome proliferator-activated receptor-γ(PPARγ) and TGF-β/Smad signaling pathway and psoriasis has been mostly studied in recent years[2].展开更多
基金supported by the National Natural Science Foundation of China under Grant Nos.62202140,61832005,62072216,62372214,and 62101463the Natural Science Foundation of Jiangsu Province of China under Grant No.BK20220974+2 种基金the Future Network Scientific Research Foundation Project FNSRFP-2021-ZD-7the Natural Science Foundation of Sichuan Province of China under Grant No.2022NSFSC0863the Sichuan Science and Technology Program under Grant Nos.2023YFH0012 and 2023ZHCG0010.
文摘Edge computing enabled Intelligent Road Network(EC-IRN)provides powerful and convenient computing services for vehicles and roadside sensing devices.The continuous emergence of transportation applications has caused a huge burden on roadside units(RSUs)equipped with edge servers in the Intelligent Road Network(IRN).Collaborative task scheduling among RSUs is an effective way to solve this problem.However,it is challenging to achieve collaborative scheduling among different RSUs in a completely decentralized environment.In this paper,we first model the interactions involved in task scheduling among distributed RSUs as a Markov game.Given that multi-agent deep reinforcement learning(MADRL)is a promising approach for the Markov game in decision optimization,we propose a collaborative task scheduling algorithm based on MADRL for EC-IRN,named CA-DTS,aiming to minimize the long-term average delay of tasks.To reduce the training costs caused by trial-and-error,CA-DTS specially designs a reward function and utilizes the distributed deployment and collective training architecture of counterfactual multi-agent policy gradient(COMA).To improve the stability of performance in large-scale environments,CA-DTS takes advantage of the action semantics network(ASN)to facilitate cooperation among multiple RSUs.The evaluation results of both the testbed and simulation demonstrate the effectiveness of our proposed algorithm.Compared with the baselines,CA-DTS can achieve convergence about 35%faster,and obtain average task delay that is lower by approximately 9.4%,9.8%,and 6.7%,in different scenarios with varying numbers of RSUs,service types,and task arrival rates,respectively.
基金National Natural Science Foundation of Jiangxi Provice of China (20122BAB205059)
文摘Introduction Psoriasis characterized by red scaly skin lesions clinically is a chronic inflammatory skin disease,and there are 0.53%-11.43% of the adults around the world suffered[1].The pathophysiological changes of psoriasis are characterized by proliferation accelerated in epidermal basal keratinocytes and infiltration of inflammatory cells from epidermis and dermis.Many studies have shown that the occurrence and development of psoriasis is closely related to genes,cell signaling pathways and proliferation.The relationships between peroxisome proliferator-activated receptor-γ(PPARγ) and TGF-β/Smad signaling pathway and psoriasis has been mostly studied in recent years[2].