This article studies the adaptive optimal output regulation problem for a class of interconnected singularly perturbed systems(SPSs) with unknown dynamics based on reinforcement learning(RL).Taking into account the sl...This article studies the adaptive optimal output regulation problem for a class of interconnected singularly perturbed systems(SPSs) with unknown dynamics based on reinforcement learning(RL).Taking into account the slow and fast characteristics among system states,the interconnected SPS is decomposed into the slow time-scale dynamics and the fast timescale dynamics through singular perturbation theory.For the fast time-scale dynamics with interconnections,we devise a decentralized optimal control strategy by selecting appropriate weight matrices in the cost function.For the slow time-scale dynamics with unknown system parameters,an off-policy RL algorithm with convergence guarantee is given to learn the optimal control strategy in terms of measurement data.By combining the slow and fast controllers,we establish the composite decentralized adaptive optimal output regulator,and rigorously analyze the stability and optimality of the closed-loop system.The proposed decomposition design not only bypasses the numerical stiffness but also alleviates the high-dimensionality.The efficacy of the proposed methodology is validated by a load-frequency control application of a two-area power system.展开更多
The proportionate recursive least squares(PRLS)algorithm has shown faster convergence and better performance than both proportionate updating(PU)mechanism based least mean squares(LMS)algorithms and RLS algorithms wit...The proportionate recursive least squares(PRLS)algorithm has shown faster convergence and better performance than both proportionate updating(PU)mechanism based least mean squares(LMS)algorithms and RLS algorithms with a sparse regularization term.In this paper,we propose a variable forgetting factor(VFF)PRLS algorithm with a sparse penalty,e.g.,l_(1)-norm,for sparse identification.To reduce the computation complexity of the proposed algorithm,a fast implementation method based on dichotomous coordinate descent(DCD)algorithm is also derived.Simulation results indicate superior performance of the proposed algorithm.展开更多
针对短波信道中信号传输产生的码间串扰问题,文中结合人工神经网络(Artificial Neural Network,ANN)与递归最小二乘法(Recursive Least Square,RLS)算法,实现改进的RLS-ANN短波信道均衡算法。通过有监督与无监督分段均衡处理,实时校准...针对短波信道中信号传输产生的码间串扰问题,文中结合人工神经网络(Artificial Neural Network,ANN)与递归最小二乘法(Recursive Least Square,RLS)算法,实现改进的RLS-ANN短波信道均衡算法。通过有监督与无监督分段均衡处理,实时校准经由短波信道传播之后产生的信号幅度和相位失真。对实测的高频数据链(High Frequency Data Link,HFDL)短波信号进行均衡处理,结果表明RLS-ANN算法相比传统的最小均方算法(Least Mean Square,LMS)和RLS算法在星座图收敛速度、平均误差及误码率等方面效果更优,该算法通过降低误码率,可有效改善信号经由短波信道传输的通信质量。展开更多
基金supported by the National Natural Science Foundation of China (62073327,62273350)the Natural Science Foundation of Jiangsu Province (BK20221112)。
文摘This article studies the adaptive optimal output regulation problem for a class of interconnected singularly perturbed systems(SPSs) with unknown dynamics based on reinforcement learning(RL).Taking into account the slow and fast characteristics among system states,the interconnected SPS is decomposed into the slow time-scale dynamics and the fast timescale dynamics through singular perturbation theory.For the fast time-scale dynamics with interconnections,we devise a decentralized optimal control strategy by selecting appropriate weight matrices in the cost function.For the slow time-scale dynamics with unknown system parameters,an off-policy RL algorithm with convergence guarantee is given to learn the optimal control strategy in terms of measurement data.By combining the slow and fast controllers,we establish the composite decentralized adaptive optimal output regulator,and rigorously analyze the stability and optimality of the closed-loop system.The proposed decomposition design not only bypasses the numerical stiffness but also alleviates the high-dimensionality.The efficacy of the proposed methodology is validated by a load-frequency control application of a two-area power system.
基金supported by National Key Research and Development Program of China(2020YFB0505803)National Key Research and Development Program of China(2016YFB0501700)。
文摘The proportionate recursive least squares(PRLS)algorithm has shown faster convergence and better performance than both proportionate updating(PU)mechanism based least mean squares(LMS)algorithms and RLS algorithms with a sparse regularization term.In this paper,we propose a variable forgetting factor(VFF)PRLS algorithm with a sparse penalty,e.g.,l_(1)-norm,for sparse identification.To reduce the computation complexity of the proposed algorithm,a fast implementation method based on dichotomous coordinate descent(DCD)algorithm is also derived.Simulation results indicate superior performance of the proposed algorithm.
文摘针对短波信道中信号传输产生的码间串扰问题,文中结合人工神经网络(Artificial Neural Network,ANN)与递归最小二乘法(Recursive Least Square,RLS)算法,实现改进的RLS-ANN短波信道均衡算法。通过有监督与无监督分段均衡处理,实时校准经由短波信道传播之后产生的信号幅度和相位失真。对实测的高频数据链(High Frequency Data Link,HFDL)短波信号进行均衡处理,结果表明RLS-ANN算法相比传统的最小均方算法(Least Mean Square,LMS)和RLS算法在星座图收敛速度、平均误差及误码率等方面效果更优,该算法通过降低误码率,可有效改善信号经由短波信道传输的通信质量。
基金National Natural Science(52177039)Fundamental Research Funds for the Universities of Henan Province (NSFRF210332, NSFRF230604)+1 种基金Key scientific research projects of colleges and universities in Henan Province (23A470006)Science and Technology Research Project of Henan Province (232102240078)。
