摘要
对非周期不可约Markov链上的线性函数近似平均报酬指标即时差分学习方法进行了研究.近似器由权值进行增量更新的固定特征函数线性加权组合构成,在对已有的算法进行比较分析的基础上,利用线性参数估计理论的有关成果,提出了基于值函数线性近似表示的平均报酬指标多步递推最小二乘即时差分强化学习算法,并给出了其一致收敛性证明.
Average reward temporal-difference learning of an irreducible aperiodic Markov chain based on linear function approximations is investigated. Approximations are comprised of linear combinations of fixed basis function whose weight are incrementally updated. On the basis of analyzing and investigating the exist algorithms,and using the linear parameter estimation theory, a new class of average reward multi-step temporal-difference learning algorithms based on linear function approximations and recursive least squares methods is proposed. A proof of uniform converge is presented.
出处
《内蒙古大学学报(自然科学版)》
CAS
CSCD
北大核心
2008年第5期560-565,共6页
Journal of Inner Mongolia University:Natural Science Edition
基金
广西自然科学基金(桂科自0481016)
教育部重点(204031)
内蒙古大学博士基金(203043)
内蒙古大学“513”人才计划(205144)资助项目
关键词
即时差分学习
平均报酬
函数近似
最小二乘
递推
temporal-difference learning
average reward
function approximation
least squares recursive