This paper proposes a deep-Q-network(DQN) controller for network selection and adaptive resource allocation in heterogeneous networks, developed on the ground of a Markov decision process(MDP) model of the problem. Ne...This paper proposes a deep-Q-network(DQN) controller for network selection and adaptive resource allocation in heterogeneous networks, developed on the ground of a Markov decision process(MDP) model of the problem. Network selection is an enabling technology for multi-connectivity, one of the core functionalities of 5G. For this reason, the present work considers a realistic network model that takes into account path-loss models and intra-RAT(radio access technology) interference. Numerical simulations validate the proposed approach and show the improvements achieved in terms of connection acceptance, resource allocation, and load balancing.In particular, the DQN algorithm has been tested against classic reinforcement learning one and other baseline approaches.展开更多
The aim of this work is to develop a robust control strategy able to drive the attitude of a spacecraft to a reference value,despite the presence of unknown but bounded uncertainties in the system parameters and exter...The aim of this work is to develop a robust control strategy able to drive the attitude of a spacecraft to a reference value,despite the presence of unknown but bounded uncertainties in the system parameters and external disturbances.Thanks to the use of an extended observer design,the proposed control law is robust against all the uncertainties that affect the high-frequency gain matrix,which is shown to capture a broad spectrum of modelling issues,some of which are often neglected by traditional approaches.The proposed controller then provides robustness against parametric uncertainties,as moment of inertia estimation,payload deformations,actuator faults and external disturbances,while maintaining its asymptotic properties.展开更多
基金supported by the European Commission in the framework of the H2020 EU-Korea project 5GALLSTAR(5G Agi Le and f Lexible integration of Sa Tellite And cellula R,www.5g-allstar.eu)(No.815323)。
文摘This paper proposes a deep-Q-network(DQN) controller for network selection and adaptive resource allocation in heterogeneous networks, developed on the ground of a Markov decision process(MDP) model of the problem. Network selection is an enabling technology for multi-connectivity, one of the core functionalities of 5G. For this reason, the present work considers a realistic network model that takes into account path-loss models and intra-RAT(radio access technology) interference. Numerical simulations validate the proposed approach and show the improvements achieved in terms of connection acceptance, resource allocation, and load balancing.In particular, the DQN algorithm has been tested against classic reinforcement learning one and other baseline approaches.
文摘The aim of this work is to develop a robust control strategy able to drive the attitude of a spacecraft to a reference value,despite the presence of unknown but bounded uncertainties in the system parameters and external disturbances.Thanks to the use of an extended observer design,the proposed control law is robust against all the uncertainties that affect the high-frequency gain matrix,which is shown to capture a broad spectrum of modelling issues,some of which are often neglected by traditional approaches.The proposed controller then provides robustness against parametric uncertainties,as moment of inertia estimation,payload deformations,actuator faults and external disturbances,while maintaining its asymptotic properties.
